./dev/make-distribution.sh 特别慢

来源：3-2 -Spark源码编译

zzLai

2019-01-31

使用 $ ./build/mvn -Pyarn -Phive -Phive-thriftserver -Phadoop-2.6 -Dhadoop.version=2.6.0-cdh5.7.0 -DskipTests clean package 命令编译时只需要16～20分钟就能完成编译

使用 $ ./dev/make-distribution.sh --name 2.6.0-cdh5.7.0 --tgz -Pyarn -Phive -Phive-thriftserver -Phadoop-2.6 -Dhadoop.version=2.6.0-cdh5.7.0 花了5小时还是停留在这个位置

[INFO] Dependency-reduced POM written at: /home/hadoop/download/spark-2.4.0/mllib-local/dependency-reduced-pom.xml
[INFO] 
[INFO] --- maven-source-plugin:3.0.1:jar-no-fork (create-source-jar) @ spark-mllib-local_2.11 ---
[INFO] Building jar: /home/hadoop/download/spark-2.4.0/mllib-local/target/spark-mllib-local_2.11-2.4.0-sources.jar
[INFO] 
[INFO] --- maven-source-plugin:3.0.1:test-jar-no-fork (create-source-jar) @ spark-mllib-local_2.11 ---
[INFO] Building jar: /home/hadoop/download/spark-2.4.0/mllib-local/target/spark-mllib-local_2.11-2.4.0-test-sources.jar

vm是4核4G内存，在这一步hadoop被开启了而且cpu占用率在300%浮动一直持续。
想知道这个是不是正常情况？

写回答

1回答