解决 hadoop 2.x 配置 yarn 运行任务 Running job 卡住

错误信息： 21/06/24 18:56:40 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 21/06/24 18:56:41 INFO client.RMProxy: Connecting to ResourceManager at /192.168.100.20:8032 21/06/24 18:56:42 INFO input.FileInputFormat: Total input files to process : 1 21/06/24 18:56:42 INFO mapreduce.JobSubmitter: number of splits:1 21/06/24 18:56:43 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1624586163461_0001 21/06/24 18:56:43 INFO conf.Configuration: resource-types.xml not found 21/06/24 18:56:43 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. 21/06/24 18:56:43 INFO resource.ResourceUtils: Adding resource type - name = memory-mb, units = Mi, type = COUNTABLE 21/06/24 18:56:43 INFO resource.ResourceUtils: Adding resource type - name = vcores, units = , type = COUNTABLE 21/06/24 18:56:43 INFO impl.YarnClientImpl: Submitted application application_1624586163461_0001 21/06/24 18:56:43 INFO mapreduce.Job: The url to track the job: http://192.168.100.20:8088/proxy/application_1624586163461_0001/ 21/06/24 18:56:43 INFO mapreduce.Job: Running job: job_1624586163461_0001

分析原因：因为yarn-site.xml配置文件中yarn.resourcemanager.hostname属性配置错误

解决方法一：如果yarn.resourcemanager.hostname属性值写成IP地址，仍然卡住，建议使用hostname

修改hostname

vi /etc/hosts

192.168.100.10 hadoop10

重启使hosts生效

reboot

修改yarn-site.xml配置文件

vi yarn-site.xml

<!-- Reducer 获取数据的方式 -->
<property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
</property>
<!-- 指定yarn的ResourceManager的地址 -->
<property>
    <name>yarn.resourcemanager.hostname</name>
    <value>hadoop10</value>
</property>

解决方法二：不使用yarn，删除mapred-site.xml中的yarn配置，不推荐，治标不治本 vi mapred-site.xml

<!-- 删除指定运行在YARN上 -->
<!--
<property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
</property>
-->