是不是版本对不上,会导致 spark 读取 hive 表报错

来源:6-2 Spark对接Hive的原理及实操

pain7

2020-08-02

scala> spark.sql("select * from test_db.player");
20/07/15 06:06:10 ERROR metastore.ObjectStore: Version information found in metastore differs 1.1.0-cdh5.15.1 from expected schema version 1.2.0. Schema verififcation is disabled hive.metastore.schema.verification so setting version.
20/07/15 06:06:11 WARN metastore.ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
res0: org.apache.spark.sql.DataFrame = [id: int, name: string]
写回答

1回答

Michael_PK

2020-08-02

继续往下操作,能出结果的不,我看你df的schema都打印出来了

0
2
Michael_PK
回复
pain7
嗯嗯,后续不影响使用就没啥
2020-08-02
共2条回复

SparkSQL入门 整合Kudu实现广告业务数据分析

大数据工程师干货课程 带你从入门到实战掌握SparkSQL

540 学习 · 192 问题

查看课程