本篇內(nèi)容介紹了“hadoop的node manager起不來怎么辦”的有關(guān)知識,在實際案例的操作過程中,不少人都會遇到這樣的困境,接下來就讓小編帶領(lǐng)大家學習一下如何處理這些情況吧!希望大家仔細閱讀,能夠?qū)W有所成!
創(chuàng)新互聯(lián)專注為客戶提供全方位的互聯(lián)網(wǎng)綜合服務(wù),包含不限于成都網(wǎng)站建設(shè)、成都網(wǎng)站制作、渾南網(wǎng)絡(luò)推廣、微信小程序定制開發(fā)、渾南網(wǎng)絡(luò)營銷、渾南企業(yè)策劃、渾南品牌公關(guān)、搜索引擎seo、人物專訪、企業(yè)宣傳片、企業(yè)代運營等,從售前售中售后,我們都將竭誠為您服務(wù),您的肯定,是我們最大的嘉獎;創(chuàng)新互聯(lián)為所有大學生創(chuàng)業(yè)者提供渾南建站搭建服務(wù),24小時服務(wù)熱線:18982081108,官方網(wǎng)址:www.cdcxhl.com
現(xiàn)象: node manager起不來, 執(zhí)行mapreduce 程序hang住
namenode 進程狀態(tài)查詢
[root@hadp-master sbin]# jps
8608 ResourceManager
8257 NameNode
9268 Jps
8453 SecondaryNameNode
datanode 進程狀態(tài)查詢 , 發(fā)現(xiàn) nodemanager 沒有起來
[root@hadp-node1 hadoop]# jps
4179 DataNode
4940 Jps
namenode 單獨起 nodemanager
[root@hadp-master sbin]# yarn nodemanager
18/01/26 03:53:54 INFO webapp.WebApps: Web app node started at 8042
18/01/26 03:53:54 INFO client.RMProxy: Connecting to ResourceManager at hadp-master/10.100.25.30:8031
18/01/26 03:53:54 INFO nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
18/01/26 03:53:54 INFO nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
18/01/26 03:53:54 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdater
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: NodeManager from hadp-master doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the NodeManager. ## 提示 NodeManager 內(nèi)存不足
解決過程:
1、原虛擬機755m內(nèi)存,調(diào)大虛擬機內(nèi)存至2G
2、修改 yarn-site.xml ,添加如下參數(shù)
參數(shù) : yarn.scheduler.minimum-allocation-mb
默認 : 1024 m
官方解釋: The minimum allocation for every container request at the RM, in MBs. Memory requests lower than this will throw a InvalidResourceRequestException.
參數(shù) : yarn.scheduler.maximum-allocation-mb
默認 : 8192 m
官方解釋: The maximum allocation for every container request at the RM, in MBs. Memory requests higher than this will throw a InvalidResourceRequestException.
參數(shù) : yarn.nodemanager.resource.memory-mb
默認 : 8192 m
官方解釋: Amount of physical memory, in MB, that can be allocated for containers.
參數(shù) : yarn.nodemanager.resource.cpu-vcores
默認 : 8
官方解釋: Number of vcores that can be allocated for containers. This is used by the RM scheduler when allocating resources for containers. This is not used to limit the number of physical cores used by YARN containers.
“hadoop的node manager起不來怎么辦”的內(nèi)容就介紹到這里了,感謝大家的閱讀。如果想了解更多行業(yè)相關(guān)的知識可以關(guān)注創(chuàng)新互聯(lián)網(wǎng)站,小編將為大家輸出更多高質(zhì)量的實用文章!