?

在吉安等地區(qū)，都構(gòu)建了全面的區(qū)域性戰(zhàn)略布局，加強發(fā)展的系統(tǒng)性、市場前瞻性、產(chǎn)品創(chuàng)新能力，以專注、極致的服務(wù)理念，為客戶提供網(wǎng)站建設(shè)、做網(wǎng)站 網(wǎng)站設(shè)計制作按需定制開發(fā),公司網(wǎng)站建設(shè),企業(yè)網(wǎng)站建設(shè),品牌網(wǎng)站設(shè)計,全網(wǎng)整合營銷推廣,外貿(mào)網(wǎng)站建設(shè),吉安網(wǎng)站建設(shè)費用合理。

1、軟件環(huán)境

本次部署只涉及偽分布式部署只是要主機hadoop1

?

2.偽分布式部署

偽分布式部署文檔參考官方網(wǎng)站hadoop
Apache > Hadoop > Apache Hadoop Project Dist POM > Apache Hadoop 2.8.3 > Hadoop: Setting up a Single Node Cluster
添加hadoop用戶

[root@hadoop1 ~]# useradd hadoop
[root@hadoop1 ~]# vi /etc/sudoers
# 找到root???? ALL=(ALL)???? ALL，添加
hadoop???? ALL=(ALL)?????? NOPASSWD:ALL
上傳并解壓
[root@hadoop1 software]# rz #上傳hadoop-2.8.1.tar.gz
[root@hadoop1 software]# tar -xzvf hadoop-2.8.1.tar.gz
軟連接
[root@hadoop1 software]# ln -s /opt/software/hadoop-2.8.1 /opt/software/hadoop
設(shè)置環(huán)境變量
[root@hadoop1 software]# vi /etc/profile
export HADOOP_HOME=/opt/software/hadoop
export PATH=$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH
[root@hadoop1 software]# source /etc/profile
設(shè)置用戶、用戶組
[root@hadoop1 software]# chown -R hadoop:hadoop hadoop
[root@hadoop1 software]# chown -R hadoop:hadoop hadoop/*
[root@hadoop1 software]# chown -R hadoop:hadoop hadoop-2.8.1???????
[root@hadoop1 software]# cd hadoop
[root@hadoop1 hadoop]# rm -f *.txt
[root@hadoop1 software]# su - hadoop
[root@hadoop1 hadoop]# ll
total 32
drwxrwxr-x. 2 hadoop hadoop 4096 Jun? 2 14:24 bin
drwxrwxr-x. 3 hadoop hadoop 4096 Jun? 2 14:24 etc
drwxrwxr-x. 2 hadoop hadoop 4096 Jun? 2 14:24 include
drwxrwxr-x. 3 hadoop hadoop 4096 Jun? 2 14:24 lib
drwxrwxr-x. 2 hadoop hadoop 4096 Aug 20 13:59 libexec
drwxr-xr-x. 2 hadoop hadoop 4096 Aug 20 13:59 logs
drwxrwxr-x. 2 hadoop hadoop 4096 Jun? 2 14:24 sbin
drwxrwxr-x. 4 hadoop hadoop 4096 Jun? 2 14:24 share???
???????
# bin:??????? 可執(zhí)行文件
# etc:???????? 配置文件
# sbin:??????? shell腳本，啟動關(guān)閉hdfs,yarn等配置文件
[hadoop@hadoop1 ~]# cd /opt/software/hadoop
[hadoop@hadoop1 hadoop]# vi etc/hadoop/core-site.xml

???
??????? fs.defaultFS
??????? hdfs://172.168.18.133:9000??? # 配置自己機器的IP
???

???????
[hadoop@hadoop1 hadoop]# vi etc/hadoop/hdfs-site.xml

???
??????? dfs.replication
??????? 1
???

---紅色部分新增
配置hadoop用戶的ssh信任關(guān)系
# 公鑰/密鑰?? 配置無密碼登錄
[hadoop@hadoop1 ~]# ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
[hadoop@hadoop1 ~]# cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
[hadoop@hadoop1 ~]# chmod 0600 ~/.ssh/authorized_keys???????
# 查看日期，看是否配置成功
[root@hadoop1 ~]# ssh hadoop1 date
Wed Apr 25 15:22:58 CST 2018

[root@hadoop1 ~]#? ssh localhost date
Wed Apr 25 15:23:25 CST 2018

# 第一次執(zhí)行命令有交互選擇輸入yes
格式化和啟動
[hadoop@hadoop1 hadoop]# bin/hdfs namenode -format
[hadoop@hadoop1 hadoop]# sbin/start-dfs.sh
ERROR:
??? hadoop1: Error: JAVA_HOME is not set and could not be found.
??? localhost: Error: JAVA_HOME is not set and could not be found.
解決方法:添加環(huán)境變量
[hadoop@hadoop1 hadoop]#? vi etc/hadoop/hadoop-env.sh
# 將export JAVA_HOME=${JAVA_HOME}改為
export JAVA_HOME=/usr/java/jdk1.8.0_45
# 繼續(xù)啟動
[hadoop@hadoop1 hadoop]# sbin/start-dfs.sh
檢查是否成功
[hadoop@hadoop1 hadoop]# jps
8026 Jps
7485 NameNode
7597 DataNode
7807 SecondaryNameNode
訪問： http://192.168.137.130:50070

修改dfs啟動的進程，以hadoop1啟動? 啟動的三個進程：
namenode: hadoop1??? bin/hdfs getconf -namenodes
datanode: localhost??? datanodes (using default slaves file)?? etc/hadoop/slaves
secondarynamenode: 0.0.0.0

[hadoop@hadoop1 ~]# cd /opt/software/hadoop
[hadoop@hadoop1 hadoop]# echo? "hadoop1" > ./etc/hadoop/slaves
[hadoop@hadoop1 hadoop]# cat ./etc/hadoop/slaves
hadoop1
[hadoop@hadoop1 hadoop]# vi ./etc/hadoop/hdfs-site.xml

??? dfs.namenode.secondary.http-address
??? hadoop1:50090


??? dfs.namenode.secondary.https-address
??? hadoop1:50091

[hadoop@hadoop1 hadoop]# sbin/stop-dfs.sh
[hadoop@hadoop1 hadoop]# sbin/start-dfs.sh

訪問： http://192.168.137.130:50070界面