在进行spark编译时报如下错误,请问是什么原因?

来源:3-2 -Spark源码编译

慕粉2038411182

2017-07-04

[INFO] Spark Project Parent POM ........................... SUCCESS [  2.551 s]

[INFO] Spark Project Tags ................................. SUCCESS [  3.138 s]

[INFO] Spark Project Sketch ............................... SUCCESS [  4.158 s]

[INFO] Spark Project Networking ........................... SUCCESS [  7.052 s]

[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  4.341 s]

[INFO] Spark Project Unsafe ............................... SUCCESS [  6.827 s]

[INFO] Spark Project Launcher ............................. FAILURE [  0.020 s]

[INFO] Spark Project Core ................................. SKIPPED

[INFO] Spark Project ML Local Library ..................... SKIPPED

[INFO] Spark Project GraphX ............................... SKIPPED

[INFO] Spark Project Streaming ............................ SKIPPED

[INFO] Spark Project Catalyst ............................. SKIPPED

[INFO] Spark Project SQL .................................. SKIPPED

[INFO] Spark Project ML Library ........................... SKIPPED

[INFO] Spark Project Tools ................................ SKIPPED

[INFO] Spark Project Hive ................................. SKIPPED

[INFO] Spark Project REPL ................................. SKIPPED

[INFO] Spark Project YARN Shuffle Service ................. SKIPPED

[INFO] Spark Project YARN ................................. SKIPPED

[INFO] Spark Project Hive Thrift Server ................... SKIPPED

[INFO] Spark Project Assembly ............................. SKIPPED

[INFO] Spark Project External Flume Sink .................. SKIPPED

[INFO] Spark Project External Flume ....................... SKIPPED

[INFO] Spark Project External Flume Assembly .............. SKIPPED

[INFO] Spark Integration for Kafka 0.8 .................... SKIPPED

[INFO] Spark Project Examples ............................. SKIPPED

[INFO] Spark Project External Kafka Assembly .............. SKIPPED

[INFO] Spark Integration for Kafka 0.10 ................... SKIPPED

[INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED

[INFO] Kafka 0.10 Source for Structured Streaming ......... SKIPPED

[INFO] ------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 28.710 s

[INFO] Finished at: 2017-07-05T03:50:58+08:00

[INFO] Final Memory: 44M/247M

[INFO] ------------------------------------------------------------------------

[ERROR] Failed to execute goal on project spark-launcher_2.11: Could not resolve dependencies for project org.apache.spark:spark-launcher_2.11:jar:2.1.1: Failure to find org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.0 in https://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]

[ERROR] 

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR] 

[ERROR] For more information about the errors and possible solutions, please read the following articles:

[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

[ERROR] 

[ERROR] After correcting the problems, you can resume the build with the command

[ERROR]   mvn <goals> -rf :spark-launcher_2.11


写回答

1回答

音策

2017-07-04

同学,: Could not resolve dependencies for project org.apache.spark:spark-launcher_2.11:jar:2.1.1: Failure to find org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.0 in https://repo1.maven.org/maven2 这个提示很明白了,关于spark编译不成功怎么解决,看下置顶的帖子 http://coding.imooc.com/learn/questiondetail/qid/15308,老师也有一篇手记供参考

0
2
慕粉2038411182
非常感谢!
2017-07-04
共2条回复

以慕课网日志分析为例 进入大数据Spark SQL的世界

快速转型大数据:Hadoop,Hive,SparkSQL步步为赢

1644 学习 · 1129 问题

查看课程