老师您好,我在运行TFIDFApplication的时候,老是出现以下问题,连接不上spark

来源:4-5 使用Spark实现中文分词+TF-IDF

weixin_慕后端6419094

2022-11-28

22/11/28 23:08:22 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://172.16.196.131:7077...
22/11/28 23:08:42 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://172.16.196.131:7077...
22/11/28 23:09:02 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://172.16.196.131:7077...
22/11/28 23:09:22 ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.
...

java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
	at scala.Predef$.require(Predef.scala:224)
	at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:515)
	at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2486)
	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:930)
	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:921)
	at scala.Option.getOrElse(Option.scala:121)
	at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:921)
	at config.ImoccSparkConf$.<init>(ImoccSparkConf.scala:34)
	at config.ImoccSparkConf$.<clinit>(ImoccSparkConf.scala)
	at TFIDFApplication$.main(TFIDFApplication.scala:21)
	at TFIDFApplication.main(TFIDFApplication.scala)
22/11/28 23:09:23 INFO SparkContext: SparkContext already stopped.
22/11/28 23:09:23 INFO SparkContext: Successfully stopped SparkContext
Exception in thread "main" java.lang.ExceptionInInitializerError
	at TFIDFApplication$.main(TFIDFApplication.scala:21)
	at TFIDFApplication.main(TFIDFApplication.scala)

然后就失败,想问下大概会是什么情况导致的?
谢谢老师!

写回答

1回答

小简同学

2024-09-24

同学你好,错误显示是参数错误,但从你的日志信息判断不出是哪里出现问题
0
0

Spark+ES+ClickHouse 构建DMP用户画像

大数据主流技术,数据挖掘核心算法,用户画像完整知识轻松掌握

306 学习 · 219 问题

查看课程