spark2.3.0编译出错

来源:2-7 -Spark源码编译及部署

RhythmEVO

2018-09-04

Failed to execute goal on project spark-launcher_2.11: Could not resolve dependencies for project org.apache.spark:spark-launcher_2.11:jar:2.3.0: Failure to find org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.0 in https://repo.maven.apache.org/maven2 was cached in the local repository

在maven源找不到这个jar包,我换过aliyun mirror也是这个问题。

写回答

2回答

Michael_PK

2018-09-04

你去本地仓库把提醒的这个包的带有update名字的文件删了

1
5
Michael_PK
回复
RhythmEVO
肯定要加的呢,视频都强调多次
2018-09-04
共5条回复

roy4j

2020-02-18

修改 spark2.3.0/pom.xml

<!-- <id>central</id>

       This should be at top, it makes maven try the central repo first and then others and hence faster dep resolution

        <name>Maven Repository</name>

        <url>https://repo.maven.apache.org/maven2</url> -->

     <id>cloudera</id>

     <name>cloudera repository</name>

      <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>


1
0

Python3实战Spark大数据分析及调度

使用Python3对Spark应用程序进行开发调优,掌握Azkaban任务调度

1046 学习 · 434 问题

查看课程