欢迎投稿

今日深度:

hadoop远程调试,

hadoop远程调试,





1、修改etc/hadoop/yarn.sh,增加以下内容
export YARN_NODEMANAGER_OPTS="-Xdebug -Xrunjdwp:transport=dt_socket,address=8788,server=y,suspend=y”
export YARN_RESOUCEMANAGER_OPTS="-Xdebug -Xrunjdwp:transport=dt_socket,address=8788,server=y,suspend=y”
还可以在hadoop-env.sh, mapreduce-env.sh中设置其它选项


2、启动hadoop,其中start-yarn.sh时,会出现以下日志:
localhost: Listening for transport dt_socket at address: 8788

3、启动调试 run-debug configuration,填入ip 与port

458624.png


4、在集群中执行一个job
hadoop jar hadoop-mapreduce-examples-2.3.0.jar wordcount /input /output

www.htsjk.Com true http://www.htsjk.com/Hadoop/41825.html NewsArticle hadoop远程调试, 1、修改etc/hadoop/yarn.sh,增加以下内容 export YARN_NODEMANAGER_OPTS="-Xdebug -Xrunjdwp:transport=dt_socket,address=8788,server=y,suspend=y” export YARN_RESOUCEMANAGER_OPTS="-Xdebug -Xrunjdwp:transport=dt_s...
相关文章
    暂无相关文章
评论暂时关闭