{"id":1204,"date":"2018-03-09T03:35:24","date_gmt":"2018-03-09T03:35:24","guid":{"rendered":"http:\/\/blog.cloudxlab.com\/?p=1204"},"modified":"2019-01-08T12:39:01","modified_gmt":"2019-01-08T12:39:01","slug":"install-hdp-on-aws","status":"publish","type":"post","link":"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/","title":{"rendered":"How to Install Hortonworks Data Platform &#8211; HDP 2.6 on AWS"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">In this post, we will show you how you can install Hortonworks Data Platform on AWS.<\/span><\/p>\n<p>You can also watch the video of this tutorial here<\/p>\n<div style=\"max-width: 1778px;\">\n<div style=\"left: 0; width: 100%; height: 0; position: relative; padding-bottom: 56.25%;\"><iframe title=\"Installing Hortonworks Data Platform on AWS | Big Data Hadoop Spark | CloudxLab\" src=\"https:\/\/www.youtube.com\/embed\/3uYY2sMBCz4?rel=0\" style=\"border: 0; top: 0; left: 0; width: 100%; height: 100%; position: absolute;\" allowfullscreen scrolling=\"no\" allow=\"encrypted-media; accelerometer; clipboard-write; gyroscope; picture-in-picture\"><\/iframe><\/div>\n<\/div>\n<p><script type=\"text\/javascript\">window.addEventListener(\"message\",function(e){\n                window.parent.postMessage(e.data,\"*\");\n            },false);<\/script><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">We start with three machines. We could install Hadoop on these machines by manually downloading and configuring them, but that\u2019s very insufficient. So either we could use Cloudera manager or Ambari. In this tutorial, we are going to use Ambari.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">On the first machine, we are going to install the Ambari server. For that, we need to buy these three instances at Amazon and we will follow the Ambari guidelines.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Ambari will then install all the components that are required in other two machines. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Please note, we will use 16 GB ram machines so that installation goes smoothly.\u00a0<\/span><\/p>\n<p>Let&#8217;s get started.<\/p>\n<p><!--more--><\/p>\n<h2><span style=\"font-weight: 400;\">Step 1 &#8211;\u00a0Launch 3 instances of t2.xlarge type<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">AWS gives us these various configurations. The one which we are going with is 16 GB RAM which is t2.xlarge. You can see how AWS console will look like<\/span><\/p>\n<p><img class=\"aligncenter size-large wp-image-1205\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-1024x552.png\" alt=\"\" width=\"840\" height=\"453\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-1024x552.png 1024w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-300x162.png 300w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-768x414.png 768w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-1200x647.png 1200w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM.png 1233w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">As you can see in the above image, we have selected the centos 7. Now the next step is to select the instance type. As stated earlier, we are going with\u00a0<strong>t2.xlarge<\/strong> instance type.<\/span><\/p>\n<p><img class=\"aligncenter size-large wp-image-1206\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.18.55-PM-1024x547.png\" alt=\"\" width=\"840\" height=\"449\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.18.55-PM-1024x547.png 1024w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.18.55-PM-300x160.png 300w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.18.55-PM-768x410.png 768w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.18.55-PM-1200x641.png 1200w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.18.55-PM.png 1227w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">In the next step, we will add storage of 100 GB. Please make sure that you select Magnetic volume type because<\/span><span style=\"font-weight: 400;\">\u00a0SSD will cost more and provide less storage. For a reference, HDFS will consume 3 GB storage in order to give you 1 GB of storage, therefore, it makes more sense economically to go with the magnetic value type. <\/span><\/p>\n<p><img class=\"aligncenter size-large wp-image-1209\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Step-4-1024x265.png\" alt=\"\" width=\"840\" height=\"217\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-4-1024x265.png 1024w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-4-300x78.png 300w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-4-768x198.png 768w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-4.png 1188w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">In the next step, we give name to the server.<\/span><\/p>\n<p><img class=\"aligncenter size-large wp-image-1211\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Step-5-1024x236.png\" alt=\"\" width=\"840\" height=\"194\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-5-1024x236.png 1024w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-5-300x69.png 300w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-5-768x177.png 768w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-5.png 1188w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">After you give a name to the server, the next step is to create a security group. Here, we are allowing all the ports so that there is no restriction. <\/span><\/p>\n<p><img class=\"aligncenter size-large wp-image-1212\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Step-6-1024x320.png\" alt=\"\" width=\"840\" height=\"263\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-6-1024x320.png 1024w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-6-300x94.png 300w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-6-768x240.png 768w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-6-1200x375.png 1200w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Step-6.png 1222w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">In the next step, you need to create a new key pair.<\/span><\/p>\n<p>Amazon provides you a feature of the private &amp; public key. It takes away the headache of login every time on each machine. It will generate a private-public key and give you the private one and it will save the public key on all the machines. This will allow you to connect to your instance securely and easily.<\/p>\n<p><span style=\"font-weight: 400;\">You then download the key pair for this purpose and save it in your home directory later. And you use this to log in to your cluster. <\/span><\/p>\n<p>As you can see below, we have successfully initialized the three instances.<\/p>\n<p><img class=\"aligncenter wp-image-1214\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-08-at-4.47.10-PM.png\" alt=\"\" width=\"840\" height=\"234\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-08-at-4.47.10-PM.png 982w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-08-at-4.47.10-PM-300x83.png 300w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-08-at-4.47.10-PM-768x214.png 768w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<h2><span style=\"font-weight: 400;\">Step 2 &#8211; Change permission of the downloaded key so that nobody else can access it<\/span><\/h2>\n<p><span style=\"font-weight: 400;\"> chmod 400 hadoop-hdp-demo.pem (Here you are not allowing anyone to read or view)<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Step 3 &#8211; Give the name to servers<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Name one of the nodes to &#8220;hadoop-ambari-server&#8221; and<\/span><span style=\"font-weight: 400;\">\u00a0others two to &#8220;hadoop-data-node&#8221;<\/span><\/p>\n<h2><img class=\"aligncenter size-full wp-image-1215\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-08-at-4.57.35-PM.png\" alt=\"\" width=\"762\" height=\"179\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-08-at-4.57.35-PM.png 762w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-08-at-4.57.35-PM-300x70.png 300w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><span style=\"font-weight: 400;\">Step 4 &#8211; Login to each of the node using the downloaded private key<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In this step, you need to provide the private key and your public IP address. For example, ssh -i ~\/hadoop-demo.pem centos@<\/span><span style=\"font-weight: 400; color: #000000;\">54.236.213.53<\/span><\/p>\n<p><span style=\"font-weight: 400;\">You can locate the Public IP address on AWS server as shown in the image below<\/span><\/p>\n<p><img class=\"aligncenter size-large wp-image-1207\" src=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-06-at-6.44.44-PM-1024x273.png\" alt=\"\" width=\"840\" height=\"224\" srcset=\"https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-06-at-6.44.44-PM-1024x273.png 1024w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-06-at-6.44.44-PM-300x80.png 300w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-06-at-6.44.44-PM-768x205.png 768w, https:\/\/cloudxlab.com\/blog\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-06-at-6.44.44-PM.png 1043w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<h2><span style=\"font-weight: 400;\">Step 5 &#8211; Run &#8220;sudo yum update&#8221; to update the packages<\/span><\/h2>\n<p>It will update the packages on all the machines because the instances that have been given by Amazon are a bit old, thus we need to update the software on these machines. Yum is the package manager on Red Head (Centos machine). You will run this command on all of the machines.<\/p>\n<h2><span style=\"font-weight: 400;\">Step 6 &#8211; Make centos sudoers on all machines<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Sudoer is somebody who can do administrative tasks, therefore, we make centos the sudoer.<\/span><\/p>\n<pre class=\"lang:default decode:true \">sudo visudo\r\n\r\ncentos ALL=(ALL) ALL<\/pre>\n<p><span style=\"font-weight: 400;\">With these commands, centos will be able to run command anywhere without any restriction.<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Step 7 &#8211; Now on each machine, verify if the hostname is properly set<\/span><\/h2>\n<pre class=\"lang:default decode:true \">hostname -f<\/pre>\n<p>With the above command, it will give the full details of the hostname.<\/p>\n<h2><span style=\"font-weight: 400;\">Step 8 &#8211; Edit the Network Configuration File<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In this step, we are setting up the hostname properly.<\/span><\/p>\n<pre class=\"lang:default decode:true\">sudo vi \/etc\/sysconfig\/network\r\n\r\nNETWORKING=yes\r\n\r\nHOSTNAME=&lt;fqdn&gt;<\/pre>\n<p>Please make sure to replace &lt;fqdn&gt; with a proper hostname. You can get this detail from the command used in step 7 i.e hostname -f<\/p>\n<h2><span style=\"font-weight: 400;\">Step 9 &#8211; Configuring IP tables<\/span><\/h2>\n<pre class=\"lang:default decode:true \">sudo systemctl disable firewalld\r\n\r\nsudo service firewalld stop<\/pre>\n<p>Here we are disabling the firewall. It is always safer to disable the firewall when you install or configure services.<\/p>\n<h2><span style=\"font-weight: 400;\">Step 10 &#8211;\u00a0<\/span><span style=\"font-weight: 400;\">sudo yum install unzip <\/span><\/h2>\n<h2><span style=\"font-weight: 400;\">Step 11 &#8211; sudo yum install wget<\/span><\/h2>\n<h2><span style=\"font-weight: 400;\">Step 12 &#8211; Disable SELinux<\/span><\/h2>\n<pre class=\"lang:default decode:true \">sudo setenforce 0 \/\/ For current session\r\n\r\nsudo vi \/etc\/selinux\/config\r\n\r\nSELINUX=disabled \/\/ Permanent<\/pre>\n<p><span style=\"font-weight: 400;\">Save the file.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">We have to reboot the machine.<\/span><\/p>\n<pre class=\"lang:default decode:true\">sudo vi \/etc\/profile<\/pre>\n<p><span style=\"font-weight: 400;\">Add umask 0022 in the last ## An\u00a0umask value of 022 grants read, write, execute permissions of 755 for new files or folders<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Step 13 &#8211; Install NTP<\/span><\/h2>\n<pre class=\"lang:default decode:true\">sudo systemctl disable chronyd.service<\/pre>\n<pre class=\"lang:default decode:true \">sudo yum install -y ntp &amp;&amp; sudo systemctl start ntpd &amp;&amp; sudo systemctl enable ntpd\r\n\r\nsudo systemctl disable chronyd.service<\/pre>\n<p><span style=\"font-weight: 400;\">So that NTP will be up during reboot<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Step 14 &#8211; Setup passwordless access for Ambari<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Copy the private key to the node where we will install ambari server<\/span><\/p>\n<pre class=\"lang:default decode:true \">scp -i ~\/hadoop-demo.pem hadoop-demo.pem centos@54.236.213.53:<\/pre>\n<p>Now see if you are able to login to other two nodes from ambari server node<\/p>\n<pre class=\"lang:default decode:true \">ssh -i hadoop-demo.pem centos@ip-172-31-54-74.ec2.internal\r\n\r\nssh -i hadoop-demo.pem centos@ip-172-31-52-125.ec2.internal<\/pre>\n<h2><span style=\"font-weight: 400;\">Step 15 &#8211; install mysql server on the last datanode<\/span><\/h2>\n<pre class=\"lang:default decode:true\">wget http:\/\/repo.mysql.com\/mysql-community-release-el7-5.noarch.rpm\r\n\r\nsudo rpm -ivh mysql-community-release-el7-5.noarch.rpm\r\n\r\nsudo yum update\r\n\r\nsudo yum install mysql-server\r\n\r\nsudo systemctl start mysqld\r\n\r\nmysql_secure_installation<\/pre>\n<p><span style=\"font-weight: 400;\">(set root password, disallow remote root login, remove test database and anonymous users)<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Step 16 &#8211; Create databases for oozie<\/span><\/h2>\n<pre class=\"lang:default decode:true\">mysql -u root -p\r\n\r\nCREATE USER 'oozie'@'%' IDENTIFIED BY 'oozie123';\r\n\r\nGRANT ALL PRIVILEGES ON *.* TO 'oozie'@'%';\r\n\r\nFLUSH PRIVILEGES;\r\n\r\nCREATE DATABASE oozie;<\/pre>\n<h2><span style=\"font-weight: 400;\">Step 17 &#8211; Create a database for hive<\/span><\/h2>\n<pre class=\"lang:default decode:true\">mysql -u root -p\r\n\r\nCREATE USER hive@'%' IDENTIFIED BY 'hive123';\r\n\r\nGRANT ALL PRIVILEGES ON *.* TO 'hive'@'%';\r\n\r\nFLUSH PRIVILEGES;\r\n\r\nCREATE DATABASE hive;<\/pre>\n<h2><span style=\"font-weight: 400;\">Step 18 &#8211; Create a database for ranger<\/span><\/h2>\n<pre class=\"lang:default decode:true\">mysql -u root -p\r\n\r\nCREATE USER ranger@'%' IDENTIFIED BY 'ranger123';\r\n\r\nGRANT ALL PRIVILEGES ON *.* TO 'ranger'@'%';\r\n\r\nFLUSH PRIVILEGES;<\/pre>\n<h2><span style=\"font-weight: 400;\">Step 19 &#8211; Download and check mysql connector on ambari server host<\/span><\/h2>\n<pre class=\"lang:default decode:true\">sudo yum install mysql-connector-java*\r\n\r\nls -lh \/usr\/share\/java\/mysql-connector-java.jar<\/pre>\n<h2><span style=\"font-weight: 400;\">Step 20 &#8211; Install java on each machine apart from ambari server<\/span><\/h2>\n<pre class=\"lang:default decode:true\">wget --no-cookies --no-check-certificate --header \"Cookie: gpw_e24=http%3A%2F%2Fwww.oracle.com%2F; oraclelicense=accept-securebackup-cookie\" \"http:\/\/download.oracle.com\/otn-pub\/java\/jdk\/8u161-b12\/2f38c3b165be4555a1fa6e98c45e0808\/jdk-8u161-linux-x64.rpm\"\r\n\r\nsudo yum localinstall jdk-8u161-linux-x64.rpm\r\n\r\nsudo rm jdk-8u161-linux-x64.rpm<\/pre>\n<h2><span style=\"font-weight: 400;\">Step 21 &#8211; install JCE on all hosts apart from ambari server<\/span><\/h2>\n<p><span style=\"font-weight: 400;\"> \u00a0<\/span><a href=\"http:\/\/www.oracle.com\/technetwork\/java\/javase\/downloads\/jce8-download-2133166.html\"><span style=\"font-weight: 400;\">http:\/\/www.oracle.com\/technetwork\/java\/javase\/downloads\/jce8-download-2133166.html<\/span><\/a><\/p>\n<pre class=\"lang:default decode:true\">sudo unzip -o -j -q jce_policy-8.zip -d \/usr\/java\/jdk1.8.0_161\/jre\/lib\/security<\/pre>\n<h2><span style=\"font-weight: 400;\">Step 22 &#8211; Install Ambari server<\/span><\/h2>\n<pre class=\"lang:default decode:true \">sudo wget -nv http:\/\/public-repo-1.hortonworks.com\/ambari\/centos7\/2.x\/updates\/2.6.1.3\/ambari.repo -O \/etc\/yum.repos.d\/ambari.repo\r\n\r\nsudo yum repolist\r\n\r\nsudo yum install ambari-server\r\n\r\nsudo ambari-server setup --jdbc-db=mysql --jdbc-driver=\/usr\/share\/java\/mysql-connector-java.jar\r\n\r\nsudo ambari-server start\r\n\r\n<\/pre>\n<h2>Summary<\/h2>\n<p>We launched 3 nodes with CentOS in AWS with at least 16 GB of RAM and 100 GB of Magnetic hard disk. We then installed Ambari 2.6 on one of the nodes. Finally, we opened all the ports for demo purpose.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this post, we will show you how you can install Hortonworks Data Platform on AWS. You can also watch the video of this tutorial here &nbsp; We start with three machines. We could install Hadoop on these machines by manually downloading and configuring them, but that\u2019s very insufficient. So either we could use Cloudera &hellip; <a href=\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;How to Install Hortonworks Data Platform &#8211; HDP 2.6 on AWS&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[14],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v16.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Install Hortonworks Data Platform - HDP on AWS | CloudxLab Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Install Hortonworks Data Platform - HDP on AWS | CloudxLab Blog\" \/>\n<meta property=\"og:description\" content=\"In this post, we will show you how you can install Hortonworks Data Platform on AWS. You can also watch the video of this tutorial here &nbsp; We start with three machines. We could install Hadoop on these machines by manually downloading and configuring them, but that\u2019s very insufficient. So either we could use Cloudera &hellip; Continue reading &quot;How to Install Hortonworks Data Platform &#8211; HDP 2.6 on AWS&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/\" \/>\n<meta property=\"og:site_name\" content=\"CloudxLab Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cloudxlab\" \/>\n<meta property=\"article:published_time\" content=\"2018-03-09T03:35:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-01-08T12:39:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-1024x552.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@CloudxLab\" \/>\n<meta name=\"twitter:site\" content=\"@CloudxLab\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data1\" content=\"6 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/#website\",\"url\":\"https:\/\/cloudxlab.com\/blog\/\",\"name\":\"CloudxLab Blog\",\"description\":\"Learn AI, Machine Learning, Deep Learning, Devops &amp; Big Data\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/cloudxlab.com\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-1024x552.png\",\"contentUrl\":\"https:\/\/blog.cloudxlab.com\/wp-content\/uploads\/2018\/03\/Screen-Shot-2018-03-05-at-7.13.02-PM-1024x552.png\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/#webpage\",\"url\":\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/\",\"name\":\"How to Install Hortonworks Data Platform - HDP on AWS | CloudxLab Blog\",\"isPartOf\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/#primaryimage\"},\"datePublished\":\"2018-03-09T03:35:24+00:00\",\"dateModified\":\"2019-01-08T12:39:01+00:00\",\"author\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/#\/schema\/person\/0efa3c54df68406de820ea466f002d3c\"},\"breadcrumb\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/\",\"url\":\"https:\/\/cloudxlab.com\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@id\":\"https:\/\/cloudxlab.com\/blog\/install-hdp-on-aws\/#webpage\"}}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/#\/schema\/person\/0efa3c54df68406de820ea466f002d3c\",\"name\":\"Abhinav Singh\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/cloudxlab.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/fc74fe31169bf872f6ab11bbab621d53?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/fc74fe31169bf872f6ab11bbab621d53?s=96&d=mm&r=g\",\"caption\":\"Abhinav Singh\"},\"sameAs\":[\"https:\/\/cloudxlab.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts\/1204"}],"collection":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/comments?post=1204"}],"version-history":[{"count":14,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts\/1204\/revisions"}],"predecessor-version":[{"id":1482,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/posts\/1204\/revisions\/1482"}],"wp:attachment":[{"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/media?parent=1204"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/categories?post=1204"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudxlab.com\/blog\/wp-json\/wp\/v2\/tags?post=1204"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}