Monday 15 July 2013

logging - Hadoop log files missing -



logging - Hadoop log files missing -

coming older version of hadoop, looking user log files (log.index, stderr, stdout, syslog) in hadoop 2.2.0. first looked web interface, there nil running @ port 50030. looked hadoop_home_dir/logs, did not see userlogs dir, nor jobnumber. nex location looked temp dir (/tmp), , found folders looked it:

$ find . -name "job_local1643076800_0001" ./hadoop-tom/mapred/staging/tom1643076800/.staging/job_local1643076800_0001 ./hadoop-tom/mapred/local/localrunner/tom/jobcache/job_local1643076800_0001 ./hadoop-tom/mapred/local/localrunner/tom/job_local1643076800_0001

in here found directories in format expected: attempt_local1643076800_0001_m_000000_0 empty.

i set "export hadoop_log_dir=/path", not fill either. missing here? or went wrong when build hadoop source?

thanks in advance!

default mapreduce framework in hadoop 2.2.0 yarn. 50030 port jobtracker webui, in yarn instead of jobtracker uses resource manager webui accessible @ 8088.

in case job beingness executed localrunner, means either client side, yarn not configured or yarn services down. validate configurations.

hadoop logging

No comments:

Post a Comment