Hadoop使用python做mr

232 阅读1分钟

hadoop命令

hadoop jar /opt/apps/ecm/service/hadoop/2.8.5-1.4.0/package/hadoop-2.8.5-1.4.0/share/hadoop/tools/lib/hadoop-streaming-2.8.5.jar -file map.py -mapper "python map.py" -file reduce.py -reducer "python reduce.py" -input input/test.txt -output output-first