请问环境搭建问题

来源:6-5 【实操手册】环境搭建文档 ( 完善版 )

慕仔2266098

2020-04-17

我按照老师的配置安装后,在hive命令行执行了delete from test;正常select可以。
报错如下
0: jdbc:hive2://> delete from test;
20/04/17 20:32:03 [HiveServer2-Background-Pool: Thread-33]: WARN ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = root_20200417203201_0e0e97f1-0300-46c7-9bd9-7f2430743176
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 2
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=
In order to set a constant number of reducers:
set mapreduce.job.reduces=
WARN : Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
20/04/17 20:32:05 [HiveServer2-Background-Pool: Thread-33]: WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
Starting Job = job_1587126446090_0001, Tracking URL = http://levi:8099/proxy/application_1587126446090_0001/
Kill Command = /thirdparties/lawliet/hadoop-3.2.0/bin/mapred job -kill job_1587126446090_0001
Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
20/04/17 20:32:12 [HiveServer2-Background-Pool: Thread-33]: WARN mapreduce.Counters: Group org.apache.hadoop.mapred.TaskCounterisdeprecated.Useorg.apache.hadoop.mapreduce.TaskCounterinstead2020−04−1720:32:12,349Stage−1map=020/04/1720:32:12[HiveServer2−Background−Pool:Thread−33]:WARNmapreduce.Counters:Grouporg.apache.hadoop.mapred.TaskCounter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead 2020-04-17 20:32:12,349 Stage-1 map = 0%, reduce = 0% 20/04/17 20:32:12 [HiveServer2-Background-Pool: Thread-33]: WARN mapreduce.Counters: Group org.apache.hadoop.mapred.TaskCounterisdeprecated.Useorg.apache.hadoop.mapreduce.TaskCounterinstead2020041720:32:12,349Stage1map=020/04/1720:32:12[HiveServer2BackgroundPool:Thread33]:WARNmapreduce.Counters:Grouporg.apache.hadoop.mapred.TaskCounter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
Ended Job = job_1587126446090_0001 with errors
20/04/17 20:32:12 [HiveServer2-Background-Pool: Thread-33]: ERROR exec.Task: Ended Job = job_1587126446090_0001 with errors
Error during job, obtaining debugging information…
20/04/17 20:32:12 [Thread-27]: ERROR exec.Task: Error during job, obtaining debugging information…
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
20/04/17 20:32:12 [HiveServer2-Background-Pool: Thread-33]: ERROR ql.Driver: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
20/04/17 20:32:12 [HiveServer2-Background-Pool: Thread-33]: WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
20/04/17 20:32:12 [HiveServer2-Background-Pool: Thread-33]: ERROR operation.Operation: Error running hive query:
org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:335) ~[hive-service-3.1.2.jar:3.1.2]
at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:226) ~[hive-service-3.1.2.jar:3.1.2]
at org.apache.hive.service.cli.operation.SQLOperation.access700(SQLOperation.java:87) [hive−service−3.1.2.jar:3.1.2]atorg.apache.hive.service.cli.operation.SQLOperation700(SQLOperation.java:87) ~[hive-service-3.1.2.jar:3.1.2] at org.apache.hive.service.cli.operation.SQLOperation700(SQLOperation.java:87) [hiveservice3.1.2.jar:3.1.2]atorg.apache.hive.service.cli.operation.SQLOperationBackgroundWork1.run(SQLOperation.java:316)[hive−service−3.1.2.jar:3.1.2]atjava.security.AccessController.doPrivileged(NativeMethod)[?:1.8.0121]atjavax.security.auth.Subject.doAs(Subject.java:422)[?:1.8.0121]atorg.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)[hadoop−common−3.2.0.jar:?]atorg.apache.hive.service.cli.operation.SQLOperation1.run(SQLOperation.java:316) [hive-service-3.1.2.jar:3.1.2] at java.security.AccessController.doPrivileged(Native Method) [?:1.8.0_121] at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_121] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) [hadoop-common-3.2.0.jar:?] at org.apache.hive.service.cli.operation.SQLOperation1.run(SQLOperation.java:316)[hiveservice3.1.2.jar:3.1.2]atjava.security.AccessController.doPrivileged(NativeMethod)[?:1.8.0121]atjavax.security.auth.Subject.doAs(Subject.java:422)[?:1.8.0121]atorg.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)[hadoopcommon3.2.0.jar:?]atorg.apache.hive.service.cli.operation.SQLOperationBackgroundWork.run(SQLOperation.java:329) [hive-service-3.1.2.jar:3.1.2]
at java.util.concurrent.ExecutorsRunnableAdapter.call(Executors.java:511)[?:1.8.0121]atjava.util.concurrent.FutureTask.run(FutureTask.java:266)[?:1.8.0121]atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[?:1.8.0121]atjava.util.concurrent.ThreadPoolExecutorRunnableAdapter.call(Executors.java:511) [?:1.8.0_121] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_121] at java.util.concurrent.ThreadPoolExecutorRunnableAdapter.call(Executors.java:511)[?:1.8.0121]atjava.util.concurrent.FutureTask.run(FutureTask.java:266)[?:1.8.0121]atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[?:1.8.0121]atjava.util.concurrent.ThreadPoolExecutorWorker.run(ThreadPoolExecutor.java:617) [?:1.8.0_121]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121]
ERROR : Ended Job = job_1587126446090_0001 with errors
ERROR : FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask (state=08S01,code=2)

写回答

1回答

小简同学

2020-04-17

同学你好

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

这句话表示了你的错误是来自mr,但这只是表面的

你查看下hadoop的日志,包括namenode,datanode等,是否有报错的信息


0
0

Spark2.x+协同过滤算法,开发企业级个性化推荐系统

一门既讲算法原理又有完整的推荐系统架构的全能课

330 学习 · 91 问题

查看课程