16/06/20 11:05:56 INFO BlockManagerMasterEndpoint: Registering block manager localhost:53253 with 1140.4 MB RAM, BlockManagerId(driver, localhost, 53253)
16/06/20 11:05:56 INFO BlockManagerMaster: Registered BlockManager
16/06/20 11:05:57 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 156.2 KB, free 156.2 KB)
16/06/20 11:05:57 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 14.1 KB, free 170.3 KB)
16/06/20 11:05:57 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on localhost:53253 (size: 14.1 KB, free: 1140.4 MB)
16/06/20 11:05:57 INFO SparkContext: Created broadcast 0 from textFile at WC.scala:15
Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.()V from class org.apache.hadoop.mapred.FileInputFormat
at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:312)
at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:199)
at org.apache.spark.rdd.RDDanonfun$partitions$2.apply(RDD.scala:239)
at org.apache.spark.rdd.RDDanonfun2.apply(RDD.scala:237)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.rdd.RDD.partitions(RDD.scala:237)
at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDDanonfun$partitions$2.apply(RDD.scala:239)
at org.apache.spark.rdd.RDDanonfun2.apply(RDD.scala:237)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.rdd.RDD.partitions(RDD.scala:237)
at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDDanonfun$partitions$2.apply(RDD.scala:239)
at org.apache.spark.rdd.RDDanonfun2.apply(RDD.scala:237)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.rdd.RDD.partitions(RDD.scala:237)
at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDDanonfun$partitions$2.apply(RDD.scala:239)
at org.apache.spark.rdd.RDDanonfun2.apply(RDD.scala:237)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.rdd.RDD.partitions(RDD.scala:237)
at org.apache.spark.Partitioner.defaultPartitioner(Partitioner.scala:65)
at org.apache.spark.rdd.PairRDDFunctions$$anonfunreduceByKey3.apply(PairRDDFunctions.scala:331)
at org.apache.spark.rdd.PairRDDFunctions$$anonfunreduceByKey.withScope(RDDOperationScope.scala:150)
at org.apache.spark.rdd.RDDOperationScope.main(WC.scala:16)
at cn.itcast.spark.WC.main(WC.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140)
16/06/20 11:05:58 INFO SparkContext: Invoking stop() from shutdown hook
16/06/20 11:05:58 INFO SparkUI: Stopped Spark web UI at http://192.168.2.109:4040
16/06/20 11:05:58 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/06/20 11:05:58 INFO MemoryStore: MemoryStore cleared
16/06/20 11:05:58 INFO BlockManager: BlockManager stopped
16/06/20 11:05:58 INFO BlockManagerMaster: BlockManagerMaster stopped
16/06/20 11:05:58 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/06/20 11:05:58 INFO SparkContext: Successfully stopped SparkContext
16/06/20 11:05:58 INFO ShutdownHookManager: Shutdown hook called
16/06/20 11:05:58 INFO ShutdownHookManager: Deleting directory /private/var/folders/z_/thb8h2gd4hqdcz9z5r9xzl140000gn/T/spark-81bc4c8a-5f7f-45c0-97ab-a82b88619ee5
Process finished with exit code 1
===================================================================================================================================
我的pom.xml几个重要的包得版本如下：
1.7 1.7 UTF-8 2.10.6 1.6.1 2.5.2做了几个测试，其他版本不变，hadoop.version 为 2.4.0，2.4.1，2.5.2，2.6.1，2.6.4 都会报上面的错误，不知道是不是hadoop的bug，有人说将hadoop的源码重新编译一下就行，但我没试。
解决办法：
把hadoop version改成2.2.0就可以了，测了一下2.7.2也可以，所以估计是hadoop的一个坑，2.7.2就修复了。其他版本没试
网上学习资料一大堆，但如果学到的知识不成体系，遇到问题时只是浅尝辄止，不再深入研究，那么很难做到真正的技术提升。
一个人可以走的很快，但一群人才能走的更远！不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人，都欢迎加入我们的的圈子（技术交流、学习资源、职场吐槽、大厂内推、面试辅导），让我们一起学习成长！
