本地测试,sss接收kafka数据,导入tidb,连续跑两天后,数据库连接失败。
来源:8-16 ForeachSink到MySQL

酱汁怪兽
2022-06-24
描述:
flume实时监控云主机的新增日志
kafka接收flume的实时数据
SSS是在本地运行的,运行两天后,flume和kafka还在正常运行。IDEA的SSS突然报错了。连接失败。即scala停止运行了。
问题:
数据库是需要额外设置什么吗?
报错:
22/06/24 16:43:27 ERROR Executor: Exception in task 0.0 in stage 16137.0 (TID 16137)
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
Caused by: java.net.ConnectException: Connection refused: connect
at java.net.DualStackPlainSocketImpl.connect0(Native Method)
22/06/24 16:43:27 WARN TaskSetManager: Lost task 0.0 in stage 16137.0 (TID 16137, LAPTOP-IDKAAD44, executor driver): com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
22/06/24 16:43:27 ERROR TaskSetManager: Task 0 in stage 16137.0 failed 1 times; aborting job
22/06/24 16:43:27 ERROR WriteToDataSourceV2Exec: Data source write support org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@26067213 is aborting.
22/06/24 16:43:27 ERROR WriteToDataSourceV2Exec: Data source write support org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@26067213 aborted.
22/06/24 16:43:27 ERROR MicroBatchExecution: Query [id = 1ddfccdb-d4ed-4622-8a44-ff217a3cd5c1, runId = c58ba5c3-c2d4-4bdb-b2c5-36cab49d6349] terminated with error
org.apache.spark.SparkException: Writing job aborted.
at org.apache.spark.sql.execution.datasources.v2.V2TableWriteExec.writeWithV2(WriteToDataSourceV2Exec.scala:413)
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 16137.0 failed 1 times, most recent failure: Lost task 0.0 in stage 16137.0 (TID 16137, LAPTOP-IDKAAD44, executor driver): com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
写回答
1回答
-
Michael_PK
2022-06-27
mysql连接问题,可以参考这个:https://blog.csdn.net/weixin_47200837/article/details/115838687
00
相似问题