spark submit 报错ClassNotFoundException: batch.immoclogapp

来源:5-4 shell封装Spark作业提交脚本

weixin_慕妹8043461

2020-06-10

pk哥你好,遇到找不到class的问题:
具体报错如下:
20/06/10 13:00:30 WARN deploy.SparkSubmitKaTeX parse error: $ within math moderunMain(SparkSubmit.scala:810)
at org.apache.spark.deploy.SparkSubmit.doRunMain1(SparkSubmit.scala:167)atorg.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)atorg.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)atorg.apache.spark.deploy.SparkSubmit1(SparkSubmit.scala:167) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit1(SparkSubmit.scala:167)atorg.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)atorg.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)atorg.apache.spark.deploy.SparkSubmit$anon2.doSubmit(SparkSubmit.scala:924)atorg.apache.spark.deploy.SparkSubmit2.doSubmit(SparkSubmit.scala:924) at org.apache.spark.deploy.SparkSubmit2.doSubmit(SparkSubmit.scala:924)atorg.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
20/06/10 13:00:30 INFO util.ShutdownHookManager: Shutdown hook called
20/06/10 13:00:30 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-daaf33a4-42e0-447c-b084-4d0e2e924850

做出的尝试:
在虚拟机解压jar文件,在batch文件夹下中能够找到相对应的class,截图如下:
图片描述

还尝试了在pom文件中 指定main class为 batch.immoclogapp 类似操作。最后还是失败,确实非常头疼,找不到相应解决办法。
麻烦PK哥了

写回答

1回答

Michael_PK

2020-06-10

这个问题从这真看不出什么情况,找不到类我记得呢要么脚本中的class写错,要么就是jar里面没这个类。你不用解压开,直接vi你的jar就能看到里面是否有与你写的class完整对应上的类名

0
0

Spark进阶 大数据离线与实时项目实战

大数据生态圈实用框架(Spark/Hbase/Redis/Hadoop)整合应用及调优

700 学习 · 190 问题

查看课程