CDHhadoop部署

1. 所有免密鑰登陸（all節(jié)點(diǎn)）（centos6 操作系統(tǒng)）

創(chuàng)新互聯(lián)專注于廣元企業(yè)網(wǎng)站建設(shè),自適應(yīng)網(wǎng)站建設(shè),商城網(wǎng)站制作。廣元網(wǎng)站建設(shè)公司,為廣元等地區(qū)提供建站服務(wù)。全流程按需求定制設(shè)計(jì)，專業(yè)設(shè)計(jì)，全程項(xiàng)目跟蹤，創(chuàng)新互聯(lián)專業(yè)和態(tài)度為您提供的服務(wù)

node01?2C??6G
node02?2C??2G
node03?2C??2G
2.node01?安裝數(shù)據(jù)庫(kù)?MySQL5.5（node01節(jié)點(diǎn)）
https://blog.csdn.net/u012402177/article/details/82870433
root/123456
3.下載基礎(chǔ)的軟件（all?節(jié)點(diǎn)）
yum??-y??install??chkconfig?python?bind-utils?psmisc?libxslt??zlib?sqlite?cyrus-sasl-plain??cyrus-sasl-gssapi?fuse??fuse-libs??redhat-lsb
/etc/init.d/ntpd??start??
解決agent啟動(dòng)會(huì)有問(wèn)題：
/opt/cloudera-manager/cm-5.4.3/lib64/cmf/agent/build/env/bin/python:?error?while?loading?shared?libraries:?libpython2.6.so.1.0:?cannot?open?shared?object?file:?No?such?file?or?directory
wget??http://www.python.org/ftp/python/2.6.6/Python-2.6.6.tgz
tar?-xzvf?Python-2.6.6.tgz
cd??Python-2.6.6
./configure?--prefix=/foo/python26?--enable-shared
make
make?altinstall
sudo?ln?-s?/foo/python26/lib/libpython2.6.so.1.0??/usr/lib/libpython2.6.so.1.0
4.clouderamanager安裝(server?和?agent節(jié)點(diǎn)都需要??all)
?mkdir?/opt/cloudera-manager
?tar?xvzf?cloudera-manager*.tar.gz??-C?/opt/cloudera-manager
5.添加用戶所有節(jié)點(diǎn)
useradd?--system?--no-create-home?--shell=/bin/false?--comment?"Cloudera?SCM?User"?cloudera-scm
6.修該所有agent節(jié)點(diǎn)的server的地址
/opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.ini中server_host
7.創(chuàng)建目錄
Server節(jié)點(diǎn)
mkdir?-p?/opt/cloudera/parcel-repo
chown?cloudera-scm:cloudera-scm?/opt/cloudera/parcel-repo
Agent節(jié)點(diǎn)
mkdir?-p?/opt/cloudera/parcels
chown?cloudera-scm:cloudera-scm?/opt/cloudera/parcels
8.server節(jié)點(diǎn)制作源(文件放在如下路徑)
cd??/opt/cloudera/parcel-repo
[root@node01?parcel-repo]#?11
-rw-r--r--?1?root?root?1272629458?Oct?30?13:33?CDH-5.4.0-1.cdh6.4.0.p0.27-el6.parcel
-rw-r--r--?1?root?root?????????41?Oct?30?13:33?CDH-5.4.0-1.cdh6.4.0.p0.27-el6.parcel.sha
-rw-r--r--?1?root?root??????42625?Oct?30?13:32?manifest.json
9.配置CM數(shù)據(jù)庫(kù)??以及數(shù)據(jù)庫(kù)連接驅(qū)動(dòng)
mkdir?-p???/usr/share/java/
cd?/usr/share/java/
cp?-a??/root/install/mysql-connector-java-5.1.26-bin.jar???./
mv??mysql-connector-java-5.1.26-bin.jar??mysql-connector-java.jar
創(chuàng)建庫(kù)（server端執(zhí)行）
刪除mysql.user?里面所有多余的用戶?只剩一個(gè)管理員
grant?all?on?*.*?to?'temp'@'%'?identified?by?'temp'?with?grant?option;
flush??privileges；
cd?/opt/cloudera-manager/cm-5.4.3/share/cmf/schema/
./scm_prepare_database.sh?mysql?temp?-h?node01?-utemp?-ptemp?--scm-host?node01?scm?scm?scm
10.啟動(dòng)服務(wù)
server端?node01
cd?/opt/cloudera-manager/cm-5.4.3/etc/init.d/
./cloudera-scm-server?start
agent??node01??node02??node03
?/opt/cloudera-manager/cm-5.4.3/etc/init.d/cloudera-scm-agent??restart

CDH hadoop 部署