這篇文章主要介紹“MacOS下Hadoop3的安裝步驟”，在日常操作中，相信很多人在MacOS下Hadoop3的安裝步驟問題上存在疑惑，小編查閱了各式資料，整理出簡單好用的操作方法，希望對大家解答”MacOS下Hadoop3的安裝步驟”的疑惑有所幫助！接下來，請跟著小編一起來學(xué)習(xí)吧！

10年積累的成都網(wǎng)站建設(shè)、網(wǎng)站建設(shè)經(jīng)驗(yàn)，可以快速應(yīng)對客戶對網(wǎng)站的新想法和需求。提供各種問題對應(yīng)的解決方案。讓選擇我們的客戶得到更好、更有力的網(wǎng)絡(luò)服務(wù)。我雖然不認(rèn)識你，你也不認(rèn)識我。但先建設(shè)網(wǎng)站后付款的網(wǎng)站建設(shè)流程，更有臨沭免費(fèi)網(wǎng)站建設(shè)讓你可以放心的選擇與我們合作。

1 檢查JDK

Matching Java Virtual Machines (1):

    1.8.0_201, x86_64:"Java SE 8"/Library/Java/JavaVirtualMachines/jdk1.8.0_201.jdk/Contents/Home

/Library/Java/JavaVirtualMachines/jdk1.8.0_201.jdk/Contents/Home

2 安裝Brew

nancylulululudeMacBook-Air:~ nancy$ /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

3 密鑰

ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

nancylulululudeMacBook-Air:.ssh nancy$ ls

authorized_keysid_rsaid_rsa.pubknown_hosts

nancylulululudeMacBook-Air:.ssh nancy$ chmod 0600 ~/.ssh/authorized_keys

4 brew安裝hadoop

 brew install hadoop

5 hadoop配置

路徑：

/usr/local/Cellar/hadoop/3.1.1/libexec/etc/hadoop

core-site.xml

 

    fs.default.name

    hdfs://localhost:8020

 

 

    hadoop.tmp.dir

    file:/usr/local/Cellar/hadoop/tmp

 

 

    fs.trash.interval

    4320

 

hdfs-site.xml

   dfs.namenode.name.dir

   file:/usr/local/Cellar/hadoop/tmp/dfs/name

 

 

   dfs.datanode.data.dir

   file:/usr/local/Cellar/hadoop/tmp/dfs/data

 

 

   dfs.replication

   1

 

 

   dfs.webhdfs.enabled

   true

 

 

   dfs.permissions.superusergroup

   admin

 

 

   dfs.permissions.enabled

   false

 

yarn-site.xml

   yarn.resourcemanager.hostname

   localhost

 

   yarn.nodemanager.aux-services

   mapreduce_shuffle

 

 

   yarn.nodemanager.aux-services.mapreduce.shuffle.class

   org.apache.hadoop.mapred.ShuffleHandler

 

 

   yarn.resourcemanager.address

   localhost:18040

 

   yarn.resourcemanager.scheduler.address

   localhost:18030

 

 

   yarn.resourcemanager.resource-tracker.address

   localhost:18025

 

 

   yarn.resourcemanager.admin.address

   localhost:18141

 

   yarn.resourcemanager.webapp.address

   localhost:18088

   yarn.log-aggregation-enable

   true

   yarn.log-aggregation.retain-seconds

   86400

   yarn.log-aggregation.retain-check-interval-seconds

   86400

   yarn.nodemanager.remote-app-log-dir

   /tmp/logs

   yarn.nodemanager.remote-app-log-dir-suffix

   logs

mapred-site.xml

  mapreduce.framework.name

  yarn

  mapreduce.jobtracker.http.address

  localhost:50030

  mapreduce.jobhisotry.address

  localhost:10020

  mapreduce.jobhistory.webapp.address

  localhost:19888

  mapreduce.jobhistory.done-dir

  /jobhistory/done

  mapreduce.intermediate-done-dir

  /jobhisotry/done_intermediate

  mapreduce.job.ubertask.enable

  true

slaves

localhost

6 創(chuàng)建文件夾

nancylulululudeMacBook-Air:hadoop nancy$ mkdir  /usr/local/Cellar/hadoop/tmp

nancylulululudeMacBook-Air:hadoop nancy$ mkdir -p  /usr/local/Cellar/hadoop/tmp/dfs/name

nancylulululudeMacBook-Air:hadoop nancy$ mkdir  /usr/local/Cellar/hadoop/tmp/dfs/data

7 hdfs格式化

 hdfs namenode -format

格式化成功

2019-03-22 16:48:24,632 INFO common.Storage: Storage directory /usr/local/Cellar/hadoop/tmp/dfs/name has been successfully formatted.

Here comes the last step~

startup！

nancylulululudeMacBook-Air:3.1.1 nancy$ cd /usr/local/Cellar/hadoop/3.1.1/sbin

nancylulululudeMacBook-Air:sbin nancy$ ./start-all.sh

WARNING: Attempting to start all Apache Hadoop daemons as nancy in 10 seconds.

WARNING: This is not a recommended production deployment configuration.

WARNING: Use CTRL-C to abort.

Starting namenodes on [localhost]

Starting datanodes

Starting secondary namenodes [nancylulululudeMacBook-Air.local]

nancylulululudeMacBook-Air.local: Warning: Permanently added 'nancylulululudemacbook-air.local,192.168.1.142' (ECDSA) to the list of known hosts.

2019-03-22 17:24:04,021 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Starting resourcemanager

Starting nodemanagers

nancylulululudeMacBook-Air:sbin nancy$ jps

3266 NodeManager

3171 ResourceManager

2980 SecondaryNameNode

2748 NameNode

2847 DataNode

3327 Jps

登陸地址  http://localhost:9870/     

                http://localhost:8088/

到此，關(guān)于“MacOS下Hadoop3的安裝步驟”的學(xué)習(xí)就結(jié)束了，希望能夠解決大家的疑惑。理論與實(shí)踐的搭配能更好的幫助大家學(xué)習(xí)，快去試試吧！若想繼續(xù)學(xué)習(xí)更多相關(guān)知識，請繼續(xù)關(guān)注創(chuàng)新互聯(lián)-成都網(wǎng)站建設(shè)公司網(wǎng)站，小編會繼續(xù)努力為大家?guī)砀鄬?shí)用的文章！

本文題目：MacOS下Hadoop3的安裝步驟-創(chuàng)新互聯(lián)
瀏覽地址：http://weahome.cn/article/eciis.html