tmp.createOrReplaceTempView("tmp")

tmp.foreachPartition(part => {
 part.foreach(info => {
   //选择比这个大的批次
   val Batch = info.getAs[String]("Batch")
   val tmp = spark.sql("select * from tmp")

   blacksRDD.toString()
   
 })
})

老师 有时候需要在 块中执行 sql 语句 而系统总是报 

Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 2 in stage 9.0 failed 1 times, most recent failure: Lost task 2.0 in stage 9.0 (TID 9, localhost, executor driver): java.lang.NullPointerException

这个错,

好像此时的 spark.sql 已经是 null 状态了, 怎样才能实现内部的sql语句功能