java.lang.NoSuchMethodError:

来源：4-11 功能开发之解析日志成DataFrame并为DataFrame添加字段信息

小马驹子

2022-01-03

我是按照老师说的方式，把maven的spark-sql的jar替换，但是一运行就报这个错，
麻烦老师看一下，谢谢
22/01/03 00:50:24 INFO WholeTextFileRDD: Input split: Paths:/E:/newspace/spark_project/src/data/test-access.log:0+2715
22/01/03 00:50:24 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
java.lang.NoSuchMethodError: com.imooc.bigdata.utils.ip.IPUtils.getInstance()Lcom/imooc/bigdata/utils/ip/IPUtils;
at com.imooc.bigdata.spark.pk.CustomDatasourceRelation $KaTeX parse error: $ within math mode$ anonfun $3 . a p p l y (C u s t o m D a t a s o u r c e R e l a t i o n . s c a l a : 107) a t c o m . i m o o c . b i g d a t a . s p a r k . p k . C u s t o m D a t a s o u r c e R e l a t i o n$ $anonfun $2$ $anonfun $3 . a p p l y (C u s t o m D a t a s o u r c e R e l a t i o n . s c a l a : 101) a t s c a l a . c o l l e c t i o n . T r a v e r s a b l e L i k e$ $a n o n f u n$ map $1 . a p p l y (T r a v e r s a b l e L i k e . s c a l a : 234) a t s c a l a . c o l l e c t i o n . T r a v e r s a b l e L i k e$ $a n o n f u n$ map $1 . a p p l y (T r a v e r s a b l e L i k e . s c a l a : 234) a t s c a l a . c o l l e c t i o n . I n d e x e d S e q O p t i m i z e d$ class.foreach(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps $o f R e f . f o r e a c h (A r r a y O p s . s c a l a : 186) a t s c a l a . c o l l e c t i o n . T r a v e r s a b l e L i k e$ class.map(TraversableLike.scala:234)
at scala.collection.mutable.ArrayOps $o f R e f . m a p (A r r a y O p s . s c a l a : 186) a t c o m . i m o o c . b i g d a t a . s p a r k . p k . C u s t o m D a t a s o u r c e R e l a t i o n$ $anonfun $2 . a p p l y (C u s t o m D a t a s o u r c e R e l a t i o n . s c a l a : 101) a t c o m . i m o o c . b i g d a t a . s p a r k . p k . C u s t o m D a t a s o u r c e R e l a t i o n$ $anonfun $2 . a p p l y (C u s t o m D a t a s o u r c e R e l a t i o n . s c a l a : 99) a t s c a l a . c o l l e c t i o n . I t e r a t o r$ $anon $11 . n e x t (I t e r a t o r . s c a l a : 410) a t s c a l a . c o l l e c t i o n . I t e r a t o r$ $anon $12 . n e x t C u r (I t e r a t o r . s c a l a : 435) a t s c a l a . c o l l e c t i o n . I t e r a t o r$ $anon $12 . h a s N e x t (I t e r a t o r . s c a l a : 441) a t s c a l a . c o l l e c t i o n . I t e r a t o r$ $anon $11 . h a s N e x t (I t e r a t o r . s c a l a : 409) a t o r g . a p a c h e . s p a r k . s q l . c a t a l y s t . e x p r e s s i o n s . G e n e r a t e d C l a s s$ GeneratedIteratorForCodegenStage1.processNext(Unknown Source)
at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)