spark编译没有成功

来源：3-2 -Spark源码编译

一丢丢的小罪恶

2018-11-04

在dev目录下运行命令：
./make-distribution.sh --name 2.6.0-cdh5.7.0 --tgz -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver -Dhadoop.version=2.6.0-cdh5.7.0

显示结果为：
[xxx@hadoop01 dev]$ ./make-distribution.sh --name 2.6.0-cdh5.7.0 --tgz -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver -Dhadoop.version=2.6.0-cdh5.7.0
+++ dirname ./make-distribution.sh
++ cd ./…
++ pwd

SPARK_HOME=/home/xxx/app/spark-2.1.0
DISTDIR=/home/xxx/app/spark-2.1.0/dist
MAKE_TGZ=false
MAKE_PIP=false
MAKE_R=false
NAME=none
MVN=/home/xxx/app/spark-2.1.0/build/mvn
(( 8 ))
case $1 in
NAME=2.6.0-cdh5.7.0
shift
shift
(( 6 ))
case $1 in
MAKE_TGZ=true
shift
(( 5 ))
case $1 in
break
‘[’ -z /home/xxx/app/jdk1.8.0_131 ‘]’
‘[’ -z /home/xxx/app/jdk1.8.0_131 ‘]’
++ command -v git
‘[’ ‘]’
++ command -v /home/xxx/app/spark-2.1.0/build/mvn
‘[’ ‘!’ /home/xxx/app/spark-2.1.0/build/mvn ‘]’
++ tail -n 1
++ grep -v INFO
++ /home/xxx/app/spark-2.1.0/build/mvn help:evaluate -Dexpression=project.version -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver -Dhadoop.version=2.6.0-cdh5.7.0
VERSION=

随后查询：sudo find / -name 'spark-2.1.0-bin-2.6.0-cdh5.7.0.tgz’
没有结果

所以这样是失败了么？老师有处理的建议么

写回答

2回答

Michael_PK

2018-11-04

贴出来看看

Michael_PK

2018-11-04

有报错信息不

一丢丢的小罪恶

Michael_PK

两个命令都运行了，但是报了同样的错： [ERROR] Failed to execute goal on project spark-launcher_2.11: Could not resolve dependencies for project org.apache.spark:spark-launcher_2.11:jar:2.1.0: Failure to find org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.0 in https://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced

2018-11-06

共9条回复

以慕课网日志分析为例进入大数据Spark SQL的世界

快速转型大数据：Hadoop，Hive，SparkSQL步步为赢

1644 学习 · 1129 问题

查看课程

相似问题

spark编译

回答 2

请问老师，spark编译的时候，出现如下错误是为什么？

回答 2

编译成功了，但是包名有问题

回答 1

spark源码编译错误

回答 1

spark-SQL启动失败

回答 2

打开慕课网App查看更多内容