spark submit 报错ClassNotFoundException: batch.immoclogapp
来源:5-4 shell封装Spark作业提交脚本

weixin_慕妹8043461
2020-06-10
pk哥你好,遇到找不到class的问题:
具体报错如下:
20/06/10 13:00:30 WARN deploy.SparkSubmitKaTeX parse error: $ within math moderunMain(SparkSubmit.scala:810)
at org.apache.spark.deploy.SparkSubmit.doRunMain1(SparkSubmit.scala:167)atorg.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)atorg.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)atorg.apache.spark.deploy.SparkSubmit1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit1(SparkSubmit.scala:167)atorg.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)atorg.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)atorg.apache.spark.deploy.SparkSubmit$anon2.doSubmit(SparkSubmit.scala:924)atorg.apache.spark.deploy.SparkSubmit2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit2.doSubmit(SparkSubmit.scala:924)atorg.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
20/06/10 13:00:30 INFO util.ShutdownHookManager: Shutdown hook called
20/06/10 13:00:30 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-daaf33a4-42e0-447c-b084-4d0e2e924850
做出的尝试:
在虚拟机解压jar文件,在batch文件夹下中能够找到相对应的class,截图如下:
还尝试了在pom文件中 指定main class为 batch.immoclogapp 类似操作。最后还是失败,确实非常头疼,找不到相应解决办法。
麻烦PK哥了
1回答
-
Michael_PK
2020-06-10
这个问题从这真看不出什么情况,找不到类我记得呢要么脚本中的class写错,要么就是jar里面没这个类。你不用解压开,直接vi你的jar就能看到里面是否有与你写的class完整对应上的类名
00
相似问题