你好,游客 登录 注册 发布搜索
背景:
阅读新闻

Hadoop进程占CPU 800%

[日期:2014-04-02] 来源:Linux  作者: [字体: ]

  一、现象

  Hadoop进程CPU占800%

  二、查问题

  1、TOP

Hadoop

  z 高亮

  H 显示线程

  <> 翻页

  2、Jstatack

Hadoop

  sudo -u admin jstack 97932 | less

  2014-03-20 21:45:45

  Full thread dump OpenJDK (Taobao) 64-Bit Server VM (20.0-b12-internal mixed mode):

  "Attach Listener" daemon prio=10 tid=0x00007f6640a15800 nid=0xf350 waiting on condition [0x0000000000000000]

  java.lang.Thread.State: RUNNABLE

  "Thread-218" prio=10 tid=0x00007f663c909800 nid=0x1813b runnable [0x0000000042ffd000]

  java.lang.Thread.State: RUNNABLE

  at java.util.HashMap.getEntry(HashMap.java:347)

  at java.util.HashMap.containsKey(HashMap.java:335)

  at java.util.HashSet.contains(HashSet.java:184)

  at org.apache.hadoop.hive.ql.QueryPlan.updateCountersInQueryPlan(QueryPlan.java:306)

  at org.apache.hadoop.hive.ql.QueryPlan.getQueryPlan(QueryPlan.java:421)

  at org.apache.hadoop.hive.ql.QueryPlan.toString(QueryPlan.java:593)

  at org.apache.hadoop.hive.ql.history.HiveHistory.logPlanProgress(HiveHistory.java:510)

  at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:168)

  at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)

  at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)

  "Thread-217" prio=10 tid=0x00007f663d75b800 nid=0x1813a runnable [0x0000000043b08000]

  java.lang.Thread.State: RUNNABLE

  at java.util.HashMap.getEntry(HashMap.java:347)

  at java.util.HashMap.containsKey(HashMap.java:335)

  at java.util.HashSet.contains(HashSet.java:184)

  at org.apache.hadoop.hive.ql.QueryPlan.updateCountersInQueryPlan(QueryPlan.java:306)

  at org.apache.hadoop.hive.ql.QueryPlan.getQueryPlan(QueryPlan.java:421)

  at org.apache.hadoop.hive.ql.QueryPlan.toString(QueryPlan.java:593)

  at org.apache.hadoop.hive.ql.history.HiveHistory.logPlanProgress(HiveHistory.java:510)

  at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:168)

  at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)

  at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)

  "Thread-152" prio=10 tid=0x00007f663cc68000 nid=0x180f7 runnable [0x0000000040904000]

  java.lang.Thread.State: RUNNABLE

  at java.util.HashMap.getEntry(HashMap.java:347)

  at java.util.HashMap.containsKey(HashMap.java:335)

  at java.util.HashSet.contains(HashSet.java:184)

  at org.apache.hadoop.hive.ql.QueryPlan.updateCountersInQueryPlan(QueryPlan.java:306)

  at org.apache.hadoop.hive.ql.QueryPlan.getQueryPlan(QueryPlan.java:421)

  at org.apache.hadoop.hive.ql.QueryPlan.toString(QueryPlan.java:593)

  at org.apache.hadoop.hive.ql.history.HiveHistory.logPlanProgress(HiveHistory.java:510)

  3、进程名

  ps aux | grep 97932

  [www.linuxidc.com @linux ~]$ ps aux | grep 97932

  56506 68038 0.0 0.0 65304 836 pts/0 S+ 21:55 0:00 grep 97932

  admin 97932 326696 0.6 767276 315552 ? Sl Jan14 21868789:28 /home/yunti/java-current/bin/java -Xmx256m -Dhadoop.log.dir=/home/yunti/hadoop-current/bin/../logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/yunti/hadoop-current/bin/.. -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Dhadoop.root.logger.appender=console -Dhadoop.root.logger.level=info -Djava.library.path=/home/yunti/hadoop-current/bin/../lib/native/Linux-amd64-64 -classpath /home/yunti/hadoop-current/bin/../conf:/home/yunti/java-current/lib/tools.jar:/home/yunti/hadoop-current/bin/..:/home/yunti/hadoop-current/bin/../hadoop-*-core.jar:/home/yunti/hadoop-current/bin/..

  三、结论

  hive执行的时候死循环了

收藏 推荐 打印 | 录入:Cstor | 阅读:
相关新闻       Hadoop 
本文评论   查看全部评论 (0)
表情: 表情 姓名: 字数
点评:
       
评论声明
  • 尊重网上道德,遵守中华人民共和国的各项有关法律法规
  • 承担一切因您的行为而直接或间接导致的民事或刑事法律责任
  • 本站管理人员有权保留或删除其管辖留言中的任意内容
  • 本站有权在网站内转载或引用您的评论
  • 参与本评论即表明您已经阅读并接受上述条款