spark 2.3.0

来源:3-2 -Spark源码编译

慕运维7479159

2018-04-16

老师,使用spark2.3.0报这个错请问是什么原因,网上资料几乎没有

"C:\Program Files\Java\jdk1.8.0_151\bin\java" "-javaagent:C:\Program Files\JetBrains\IntelliJ IDEA 2017.3\lib\idea_rt.jar=4307:C:\Program Files\JetBrains\IntelliJ IDEA 2017.3\bin" -Dfile.encoding=UTF-8 -classpath "C:\Program Files\Java\jdk1.8.0_151\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\deploy.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\access-bridge-64.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\cldrdata.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\dnsns.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\jaccess.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\jfxrt.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\localedata.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\nashorn.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\sunec.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\sunjce_provider.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\sunmscapi.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\sunpkcs11.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\ext\zipfs.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\javaws.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\jce.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\jfr.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\jfxswt.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\management-agent.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\plugin.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\resources.jar;C:\Program Files\Java\jdk1.8.0_151\jre\lib\rt.jar;E:\Scala\IdeaProjects\spark_streaming\Spark\target\classes;C:\Users\5838\.m2\repository\org\scala-lang\scala-library\2.11.8\scala-library-2.11.8.jar;C:\Users\5838\.m2\repository\org\mongodb\casbah-core_2.11\3.1.1\casbah-core_2.11-3.1.1.jar;C:\Users\5838\.m2\repository\org\mongodb\casbah-commons_2.11\3.1.1\casbah-commons_2.11-3.1.1.jar;C:\Users\5838\.m2\repository\com\github\nscala-time\nscala-time_2.11\1.0.0\nscala-time_2.11-1.0.0.jar;C:\Users\5838\.m2\repository\org\joda\joda-convert\1.2\joda-convert-1.2.jar;C:\Users\5838\.m2\repository\org\slf4j\slf4j-api\1.6.0\slf4j-api-1.6.0.jar;C:\Users\5838\.m2\repository\org\mongodb\casbah-query_2.11\3.1.1\casbah-query_2.11-3.1.1.jar;C:\Users\5838\.m2\repository\org\apache\spark\spark-mllib_2.11\2.3.0\spark-mllib_2.11-2.3.0.jar;C:\Users\5838\.m2\repository\org\scala-lang\modules\scala-parser-combinators_2.11\1.0.4\scala-parser-combinators_2.11-1.0.4.jar;C:\Users\5838\.m2\repository\org\apache\spark\spark-core_2.11\2.3.0\spark-core_2.11-2.3.0.jar;C:\Users\5838\.m2\repository\org\apache\avro\avro\1.7.7\avro-1.7.7.jar;C:\Users\5838\.m2\repository\com\thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;C:\Users\5838\.m2\repository\org\apache\avro\avro-mapred\1.7.7\avro-mapred-1.7.7-hadoop2.jar;C:\Users\5838\.m2\repository\org\apache\avro\avro-ipc\1.7.7\avro-ipc-1.7.7.jar;C:\Users\5838\.m2\repository\org\apache\avro\avro-ipc\1.7.7\avro-ipc-1.7.7-

写回答

1回答

Michael_PK

2018-04-16

你这信息里没看到错误信息呢。请描述清楚干什么事情出现了什么错,然后贴出错误信息。否则没法回答

0
3
慕运维7479159
回复
Michael_PK
好的,老师,问题已经解决,是少了一个包
2018-04-17
共3条回复

以慕课网日志分析为例 进入大数据Spark SQL的世界

快速转型大数据:Hadoop,Hive,SparkSQL步步为赢

1644 学习 · 1129 问题

查看课程