Skip to content

Instantly share code, notes, and snippets.

@miguno

miguno/gist:1587990

Created January 10, 2012 09:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save miguno/1587990 to your computer and use it in GitHub Desktop.
Save miguno/1587990 to your computer and use it in GitHub Desktop.
Download ZIP
Anuj
Raw
gistfile1.txt
lrmraxm:hadoop-0.20.2-cdh3u2 anuj.maurice$ bin/hadoop jar contrib/streaming/hadoop-streaming-0.20.2-cdh3u2.jar -file /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/mapper.py -mapper mapper.py -file /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/reducer.py -reducer reducer.py -input /oos.txt -output /oos_new
packageJobJar: [/Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/mapper.py, /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/python/reducer.py, /tmp/hadoop-anuj.maurice/hadoop-unjar2426556812178658809/] [] /var/folders/Yu/YuXibLtIHOuWcHsjWu8zM-Ccvdo/-Tmp-/streamjob4679204253733026415.jar tmpDir=null
12/01/04 12:02:02 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
12/01/04 12:02:02 WARN snappy.LoadSnappy: Snappy native library not loaded
12/01/04 12:02:02 INFO mapred.FileInputFormat: Total input paths to process : 1
12/01/04 12:02:03 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-anuj.maurice/mapred/local]
12/01/04 12:02:03 INFO streaming.StreamJob: Running job: job_201201041122_0004
12/01/04 12:02:03 INFO streaming.StreamJob: To kill this job, run:
12/01/04 12:02:03 INFO streaming.StreamJob: /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/bin/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201201041122_0004
12/01/04 12:02:03 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201201041122_0004
12/01/04 12:02:04 INFO streaming.StreamJob: map 0% reduce 0%
12/01/04 12:02:14 INFO streaming.StreamJob: map 100% reduce 0%
12/01/04 12:02:22 INFO streaming.StreamJob: map 100% reduce 33%
12/01/04 12:02:26 INFO streaming.StreamJob: map 100% reduce 0%
12/01/04 12:02:34 INFO streaming.StreamJob: map 100% reduce 17%
12/01/04 12:02:38 INFO streaming.StreamJob: map 100% reduce 0%
12/01/04 12:02:46 INFO streaming.StreamJob: map 100% reduce 17%
12/01/04 12:02:50 INFO streaming.StreamJob: map 100% reduce 0%
12/01/04 12:02:58 INFO streaming.StreamJob: map 100% reduce 33%
12/01/04 12:03:02 INFO streaming.StreamJob: map 100% reduce 0%
12/01/04 12:03:04 INFO streaming.StreamJob: map 100% reduce 100%
12/01/04 12:03:04 INFO streaming.StreamJob: To kill this job, run:
12/01/04 12:03:04 INFO streaming.StreamJob: /Users/anuj.maurice/Downloads/hadoop-0.20.2-cdh3u2/bin/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201201041122_0004
12/01/04 12:03:04 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201201041122_0004
12/01/04 12:03:04 ERROR streaming.StreamJob: Job not successful. Error: NA
12/01/04 12:03:04 INFO streaming.StreamJob: killJob…
Streaming Command Failed!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment