老师您好!我在编译spark源码时执行报错,怎么处理?

来源:3-2 -Spark源码编译

陈素素

2019-03-26

错误内容如下:
[hadoop@hadoop001 spark-2.1.0]$ ./build/mvn -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver -Dhadoop.version=2.6.0-cdh5.7.0 -DskipTests clean package
exec: curl --progress-bar -L https://downloads.typesafe.com/zinc/0.3.9/zinc-0.3.9.tgz
curl: (6) Couldn’t resolve host ‘downloads.typesafe.com

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
exec: curl --progress-bar -L https://downloads.typesafe.com/scala/2.11.8/scala-2.11.8.tgz
curl: (6) Couldn’t resolve host ‘downloads.typesafe.com

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
./build/mvn: line 119: cd: /home/hadoop/source/spark-2.1.0/build/scala-2.11.8/bin/…/lib: No such file or directory
./build/mvn: line 120: cd: /home/hadoop/source/spark-2.1.0/build/scala-2.11.8/bin/…/lib: No such file or directory
./build/mvn: line 143: /home/hadoop/source/spark-2.1.0/build/zinc-0.3.9/bin/zinc: No such file or directory
./build/mvn: line 149: /home/hadoop/source/spark-2.1.0/build/zinc-0.3.9/bin/zinc: No such file or directory
Using mvn from path: /home/hadoop/app/apache-maven-3.3.9/bin/mvn
[INFO] Scanning for projects…
Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.11:2.1.0: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): repo1.maven.org: Name or service not known and ‘parent.relativePath’ points at wrong local POM @ line 22, column 11
@
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR] The project org.apache.spark:spark-parent_2.11:2.1.0 (/home/hadoop/source/spark-2.1.0/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for org.apache.spark:spark-parent_2.11:2.1.0: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): repo1.maven.org: Name or service not known and ‘parent.relativePath’ points at wrong local POM @ line 22, column 11: Unknown host repo1.maven.org: Name or service not known -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException
[hadoop@hadoop001 spark-2.1.0]$

写回答

1回答

Michael_PK

2019-03-26

网络不行,都连不上仓库,换个好的网络

0
5
Michael_PK
回复
陈素素
win是只需要maven就行
2019-04-06
共5条回复

以慕课网日志分析为例 进入大数据Spark SQL的世界

快速转型大数据:Hadoop,Hive,SparkSQL步步为赢

1644 学习 · 1129 问题

查看课程