Step by Step : Installation of HDP 2.6 on IBM POWER SYSTEMS

look_w

Short Description:                        Short manual for the install of HDP 2.6 on IBM POWER SYSTEMS                    
                                            Article                        Please consider the following for this install;

• IBM Power servers are on centos 7
• The install is performed by using a non-root user
• there is no access to internet or proxy to remote repos, we installed a local repos

------------------------------------------------------------prerequisite-------------------------------------------------------------
#Check the Maximum Open File Descriptors
#The recommended maximum number of open file descriptors is 10000, or more. To check the current value set for the maximum number of open file descriptors, execute the following shell commands on each host:
ulimit -Sn
ulimit -Hn
#If the output is not greater than 10000, run the following command to set it to a suitable default:
ulimit -n 10000
#SElinux
sudo setenforce 0
sudo sh -c 'sudo sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config'
sudo sh -c 'sudo sed -i 's/SELINUX=permissive/SELINUX=disabled/g' /etc/selinux/config'
sudo umask 0022
sudo echo umask 0022 >> /etc/profile
----------------------------- JDK - open JDK only ( oracle JDK not supported ) -------------------------------------------------
sudo yum install java-1.8.0-openjdk
sudo yum install java-1.8.0-openjdk-devel
sudo yum install java-1.8.0-openjdk-headless
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk
vi ~/.bash_profile
---------------------------------- Installation of Mysql / MariaDB on the server ----------------------------------
sudo yum update
sudo yum install mysql-connector-java
sudo yum install mysql
sudo yum update
sudo yum install mariadb-server
sudo systemctl enable mariadb
sudo systemctl start mariadb
#how to connect :
mysql -u root -p
#no password by default
---------------------------------- Setting Up a Local Repository for HDP on the server - No internet access ---------------------------
sudo yum install yum-utils createrepo
sudo mkdir -p /var/www/html/
-------------------------------- Prepare the httpd service on the server -------------------------------
sudo yum install httpd
sudo service httpd start
sudo systemctl enable httpd
---------------------------- prepare the repos ----------------------------------------
#HDP
#Download

tar -xvf HDP-2.6.0.3-centos7-rpm.tar.gz
sudo mv HDP /var/www/html/
cd /var/www/html/HDP/centos7
#HDP-UTILS
#Download

#Ambari
#Download
ambari-2.5.0.3-centos7-ppc.tar.gz
tar -xvf ambari-2.5.0.3-centos7.tar.gz
sudo mv ambari /var/www/html/
cd /var/www/html/ambari/centos7
----------------------------------------------- HDP.repo Example -----------------------------------------------
#VERSION_NUMBER=2.6.0.3-8
[HDP-2.6.0.3]
name=HDP Version - HDP-2.6.0.3
#baseurl
baseurl=http://XXXXXX/HDP/centos7-ppc/
gpgcheck=1
#gpgkey
gpgkey=http://XXXXXX/HDP/centos7-ppc/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
[HDP-UTILS-1.1.0.21]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.21
baseurl=http://XXXXXX/HDP-UTILS-1.1.0.21/repos/ppc64le
gpgcheck=0
gpgkey
enabled=0
priority=1
---------------------------------------------------- Prepare the the repo files on the server XXXX ---------------------------------------
sudo mv ambari.repo /etc/yum.repos.d/
sudo mv hdp.repo /etc/yum.repos.d/
#on ambari.repo modify the following
[ambari-2.5.0.3]
name=ambari Version - ambari-2.5.0.3
baseurl=http://XXXXXX/ambari/centos7-ppc/
gpgcheck=1
gpgkey=http://XXXX/ambari/centos7-ppc/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
#Confirm that the repository is configured by checking the repo list
yum repolist
sudo yum install lambari-server
sudo ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
ambari-server setup -j $JAVA_HOME
...