Spark 数据落地kudu报错

来源:8-11 需求二功能实现

zhangyulei

2019-12-01

ERROR Executor: Exception in task 2.0 in stage 1.0 (TID 4)
java.lang.IllegalArgumentException: cannot import authentication data from a different user: old='', new='Administrator'
	at org.apache.kudu.client.SecurityContext.checkUserMatches(SecurityContext.java:293)
	at org.apache.kudu.client.SecurityContext.importAuthenticationCredentials(SecurityContext.java:310)
	at org.apache.kudu.client.AsyncKuduClient.importAuthenticationCredentials(AsyncKuduClient.java:827)
	at org.apache.kudu.spark.kudu.KuduContext.asyncClient$lzycompute(KuduContext.scala:104)
	at org.apache.kudu.spark.kudu.KuduContext.asyncClient(KuduContext.scala:101)
	at org.apache.kudu.spark.kudu.KuduContext.syncClient$lzycompute(KuduContext.scala:99)
	at org.apache.kudu.spark.kudu.KuduContext.syncClient(KuduContext.scala:99)
	at org.apache.kudu.spark.kudu.KuduContext.org$apache$kudu$spark$kudu$KuduContext$$writePartitionRows(KuduContext.scala:308)
	at org.apache.kudu.spark.kudu.KuduContext$$anonfun$writeRows$1.apply(KuduContext.scala:290)
	at org.apache.kudu.spark.kudu.KuduContext$$anonfun$writeRows$1.apply(KuduContext.scala:289)
	at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:935)
	at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:935)
	at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2101)
	at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2101)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
	at org.apache.spark.scheduler.Task.run(Task.scala:121)
	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 3)
java.lang.IllegalArgumentException: cannot import authentication data from a different user: old='', new='Administrator'
	at org.apache.kudu.client.SecurityContext.checkUserMatches(SecurityContext.java:293)

不晓得这玩意还有用户的吗?

写回答

3回答

Michael_PK

2019-12-01

你可以查阅下,如何使用kudu不需要使用权限验证。PS:只要参数配置下,然后重启就行

0
2
慕标2366677
回复
zhangyulei
请问解决了吗,我加上配置参数还是这样。
2020-05-25
共2条回复

雷精

2019-12-09

修改 master.gflagfile

加上

--rpc_authentication=disabled
--rpc_encryption=disabled
--trusted_subnets=0.0.0.0/0

重启服务

1
0

Michael_PK

2019-12-01

你是win用户,你的用户名是admin。。。,不符合要求呢,需要构建Linux机器的用户名

0
0

SparkSQL入门 整合Kudu实现广告业务数据分析

大数据工程师干货课程 带你从入门到实战掌握SparkSQL

535 学习 · 192 问题

查看课程