老师您好,我在运行TFIDFApplication的时候,老是出现以下问题,连接不上spark
来源:4-5 使用Spark实现中文分词+TF-IDF

weixin_慕后端6419094
2022-11-28
22/11/28 23:08:22 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://172.16.196.131:7077...
22/11/28 23:08:42 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://172.16.196.131:7077...
22/11/28 23:09:02 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://172.16.196.131:7077...
22/11/28 23:09:22 ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.
...
java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:515)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2486)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:930)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:921)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:921)
at config.ImoccSparkConf$.<init>(ImoccSparkConf.scala:34)
at config.ImoccSparkConf$.<clinit>(ImoccSparkConf.scala)
at TFIDFApplication$.main(TFIDFApplication.scala:21)
at TFIDFApplication.main(TFIDFApplication.scala)
22/11/28 23:09:23 INFO SparkContext: SparkContext already stopped.
22/11/28 23:09:23 INFO SparkContext: Successfully stopped SparkContext
Exception in thread "main" java.lang.ExceptionInInitializerError
at TFIDFApplication$.main(TFIDFApplication.scala:21)
at TFIDFApplication.main(TFIDFApplication.scala)
然后就失败,想问下大概会是什么情况导致的?
谢谢老师!
写回答
1回答
-
小简同学
2024-09-24
同学你好,错误显示是参数错误,但从你的日志信息判断不出是哪里出现问题00
相似问题