Thursday 15 March 2012

hadoop - Storm-YARN : Application container fails to launch -



hadoop - Storm-YARN : Application container fails to launch -

i running storm (trident) topology reads avro kafka & writes records in hbase. topology running expected in localcluster mode, while using stormsubmitter i'm facing below issues.

in distributed hadoop mode i'm getting below error [1] while launching yarn application. in hadoop (local mode, 1 box only) yarn spawnning nimbus server , storm-ui. there no supervisor(s) running run spout/bolts in topology. guess reason might insufficient memory (4g run topology + hbase, hdfs, kafka, zookeeper etc...).

can help me out in understanding reason of container failure? there no errors/info nowadays in application logs.

[1] yarn container fails launch below error on running. storm-yarn launch /homext/storm-yarn.yml --queue default -appname storm-yarn-demo --stormzip /tmp/storm-0.9.zip

application application_1415038356032_0304 failed 2 times due container appattempt_1415038356032_0304_000002 exited exitcode: 127 due to: exception container-launch: org.apache.hadoop.util.shell$exitcodeexception: org.apache.hadoop.util.shell$exitcodeexception: @ org.apache.hadoop.util.shell.runcommand(shell.java:505) @ org.apache.hadoop.util.shell.run(shell.java:418) @ org.apache.hadoop.util.shell$shellcommandexecutor.execute(shell.java:650) @ org.apache.hadoop.yarn.server.nodemanager.defaultcontainerexecutor.launchcontainer(defaultcontainerexecutor.java:195) @ org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.containerlaunch.call(containerlaunch.java:283) @ org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.containerlaunch.call(containerlaunch.java:79) @ java.util.concurrent.futuretask.run(futuretask.java:262) @ java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor.java:1145) @ java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor.java:615) @ java.lang.thread.run(thread.java:745) container exited non-zero exit code 127 .failing attempt.. failing application.

this log insufficient diagnose. says container failed launch. should container output. check ${yarn.nodemanager.log-dirs} on nodes, there application folder (application_1415038356032_0304) , in there there container folder each effort (...1415038356032_0304_000002) containing stderr, stdout , syslog of attempt. read , you'll identify problem.

if these don't exist, in ${yarn.nodemanager.local-dirs} you'll find container launch script (i thinks called container-launch.sh) app/container attempt. in actual command launch container. seek run shell prompt , see get.

hadoop apache-storm yarn

No comments:

Post a Comment