5.1.47版本的jdbc添加不成功

来源:6-17 实战之统计结果写入数据库(非常重要)

酱汁怪兽

2022-03-16

描述:
在C:\Users\jieqiong\IdeaProjects\spark-log4j\log-ss\pom.xml中,添加5.1.47的jdbc,报错。
图片描述

尝试方式一:
(1)手动将mysql-connector-java-5.1.47.jar,放入C:\Users\jieqiong.m2\repository\mysql\mysql-connector-java\5.1.47目录中。
(2)在主pom.xml中添加5.1.47的依赖。
结果:子pom.xml的依赖,依然无法添加成功。object ForeachRDDNetworkWordCount运行报错是:找不到jdbc

22/03/16 10:23:20 ERROR Executor: Exception in task 0.0 in stage 2.0 (TID 1)
java.sql.SQLException: No suitable driver found for jdbc:mysql:192.168.131.66:3306/jieqiong
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at com.imooc.bigdata.ss.MySQLUtils.getConnection(MySQLUtils.scala:11)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount.getConnection(MySQLUtils.scala:11) at com.imooc.bigdata.ss.ForeachRDDNetworkWordCount.getConnection(MySQLUtils.scala:11)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount.anonfunanonfunanonfunmain5(ForeachRDDNetworkWordCount.scala:141)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount5(ForeachRDDNetworkWordCount.scala:141) at com.imooc.bigdata.ss.ForeachRDDNetworkWordCount5(ForeachRDDNetworkWordCount.scala:141)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount.anonfunanonfunanonfunmain555adapted(ForeachRDDNetworkWordCount.scala:137)
at org.apache.spark.rdd.RDD.anonfunanonfunanonfunforeachPartition2(RDD.scala:994)atorg.apache.spark.rdd.RDD.2(RDD.scala:994) at org.apache.spark.rdd.RDD.2(RDD.scala:994)atorg.apache.spark.rdd.RDD.anonfun$foreachPartition222adapted(RDD.scala:994)
at org.apache.spark.SparkContext.anonfunanonfunanonfunrunJob5(SparkContext.scala:2133)atorg.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)atorg.apache.spark.scheduler.Task.run(Task.scala:127)atorg.apache.spark.executor.Executor5(SparkContext.scala:2133) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor5(SparkContext.scala:2133)atorg.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)atorg.apache.spark.scheduler.Task.run(Task.scala:127)atorg.apache.spark.executor.ExecutorTaskRunner.anonfunanonfunanonfunrun3(Executor.scala:444)atorg.apache.spark.util.Utils3(Executor.scala:444) at org.apache.spark.util.Utils3(Executor.scala:444)atorg.apache.spark.util.Utils.tryWithSafeFinally(Utils.scala:1377)
at org.apache.spark.executor.ExecutorTaskRunner.run(Executor.scala:447)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)atjava.util.concurrent.ThreadPoolExecutorTaskRunner.run(Executor.scala:447) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutorTaskRunner.run(Executor.scala:447)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)atjava.util.concurrent.ThreadPoolExecutorWorker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

22/03/16 10:23:20 WARN TaskSetManager: Lost task 0.0 in stage 2.0 (TID 1, LAPTOP-IDKAAD44, executor driver): java.sql.SQLException: No suitable driver found for jdbc:mysql:192.168.131.66:3306/jieqiong
at java.sql.DriverManager.getConnection(DriverManager.java:689)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at com.imooc.bigdata.ss.MySQLUtils.getConnection(MySQLUtils.scala:11)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount.getConnection(MySQLUtils.scala:11) at com.imooc.bigdata.ss.ForeachRDDNetworkWordCount.getConnection(MySQLUtils.scala:11)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount.anonfunanonfunanonfunmain5(ForeachRDDNetworkWordCount.scala:141)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount5(ForeachRDDNetworkWordCount.scala:141) at com.imooc.bigdata.ss.ForeachRDDNetworkWordCount5(ForeachRDDNetworkWordCount.scala:141)atcom.imooc.bigdata.ss.ForeachRDDNetworkWordCount.anonfunanonfunanonfunmain555adapted(ForeachRDDNetworkWordCount.scala:137)
at org.apache.spark.rdd.RDD.anonfunanonfunanonfunforeachPartition2(RDD.scala:994)atorg.apache.spark.rdd.RDD.2(RDD.scala:994) at org.apache.spark.rdd.RDD.2(RDD.scala:994)atorg.apache.spark.rdd.RDD.anonfun$foreachPartition222adapted(RDD.scala:994)
at org.apache.spark.SparkContext.anonfunanonfunanonfunrunJob5(SparkContext.scala:2133)atorg.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)atorg.apache.spark.scheduler.Task.run(Task.scala:127)atorg.apache.spark.executor.Executor5(SparkContext.scala:2133) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor5(SparkContext.scala:2133)atorg.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)atorg.apache.spark.scheduler.Task.run(Task.scala:127)atorg.apache.spark.executor.ExecutorTaskRunner.anonfunanonfunanonfunrun3(Executor.scala:444)atorg.apache.spark.util.Utils3(Executor.scala:444) at org.apache.spark.util.Utils3(Executor.scala:444)atorg.apache.spark.util.Utils.tryWithSafeFinally(Utils.scala:1377)
at org.apache.spark.executor.ExecutorTaskRunner.run(Executor.scala:447)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)atjava.util.concurrent.ThreadPoolExecutorTaskRunner.run(Executor.scala:447) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutorTaskRunner.run(Executor.scala:447)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)atjava.util.concurrent.ThreadPoolExecutorWorker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

写回答

1回答

Michael_PK

2022-03-18

pom.xml都抛红了,肯定没法使用。依赖包必须要能下载到maven本地仓库才可以的。

只有两个建议:

1)好的网络

2)你去网络上下载mysql的驱动包,然后使用mvn install的方式,将这个驱动包安装到本地maven仓库就行了

0
0

Spark3实时处理-Streaming+StructuredStreaming实战

实战Spark3实时处理,掌握两套企业级处理方案

340 学习 · 238 问题

查看课程