博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
hadoop jar wc.jar com.map.red.job.WordCountJob
阅读量:4595 次
发布时间:2019-06-09

本文共 4969 字,大约阅读时间需要 16 分钟。

[root@bigdataspark ~]# hadoop jar wc.jar com.map.red.job.WordCountJob
16/05/22 19:20:24 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
16/05/22 19:20:24 WARN mapreduce.JobSubmitter: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
16/05/22 19:20:24 INFO input.FileInputFormat: Total input paths to process : 1
16/05/22 19:20:25 INFO mapreduce.JobSubmitter: number of splits:1
16/05/22 19:20:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1464397668280_0004
16/05/22 19:20:26 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
16/05/22 19:20:26 INFO impl.YarnClientImpl: Submitted application application_1464397668280_0004
16/05/22 19:20:26 INFO mapreduce.Job: The url to track the job: http://bigdatastorm:8088/proxy/application_1464397668280_0004/
16/05/22 19:20:26 INFO mapreduce.Job: Running job: job_1464397668280_0004
16/05/22 19:20:49 INFO mapreduce.Job: Job job_1464397668280_0004 running in uber mode : false
16/05/22 19:20:49 INFO mapreduce.Job:  map 0% reduce 0%
16/05/22 19:21:12 INFO mapreduce.Job:  map 100% reduce 0%
16/05/22 19:21:12 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_0, Status : FAILED
Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
    at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
    ... 8 more
16/05/22 19:21:13 INFO mapreduce.Job:  map 0% reduce 0%
16/05/22 19:21:23 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_1, Status : FAILED
Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
    at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
    ... 8 more
16/05/22 19:21:34 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_2, Status : FAILED
Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
    at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
    ... 8 more
16/05/22 19:21:45 INFO mapreduce.Job:  map 100% reduce 0%
16/05/22 19:21:46 INFO mapreduce.Job:  map 100% reduce 100%
16/05/22 19:21:48 INFO mapreduce.Job: Job job_1464397668280_0004 failed with state FAILED due to: Task failed task_1464397668280_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

转载于:https://www.cnblogs.com/TendToBigData/p/10501449.html

你可能感兴趣的文章
Java性能总结四(转)
查看>>
net 程序员面试宝典
查看>>
2019年机器学习:追踪人工智能发展之路
查看>>
2.Android新版开发教程&笔记—Activity间的数据传递
查看>>
经典的电工电路图(转载的)
查看>>
Nginx详解三:Nginx基础篇之yum安装
查看>>
DataGuard 单实例到RAC搭建
查看>>
ASP.NET Zero--4.不使用谷歌字体,提升加载速度
查看>>
【心路历程】(NOIP 203)&(HNOI 355)
查看>>
css自问自答(一)
查看>>
3.通过js代码设置css样式
查看>>
测试工程师面试
查看>>
读书笔记:JavaScript编程全解
查看>>
大小端格式
查看>>
阅读书籍电技术
查看>>
互联网时代的报纸收费与读者细分
查看>>
mysql优化
查看>>
vs2012中怎样设为起始页,怎样取消
查看>>
CSS3中的box-shadow
查看>>
Java常用函数式接口--Supplier接口使用案例
查看>>