hive执行sql卡住了

来源:1-24 -Hive环境搭建

starkpan

2018-10-31

hive安装成功,加载hello.txt文件很快,但是执行语句
hive> select word, count(1) from hive_wordcount lateral view explode(split(context,’\t’)) wc as word group by word;
开始执行:
Query ID = hadoop_20181031221313_42a99fce-5e62-4d88-a0de-ded7ac2cbb07
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=
In order to set a constant number of reducers:
set mapreduce.job.reduces=
卡住不动了。

虚拟机virtualbox配置为4核,内存设置为8G。运行mysql,hadoop,hive三个软件。内存和cpu占用率不高,不应该跑不动呐。

写回答

2回答

Michael_PK

2018-11-01

你yarn启了吗

0
3
Michael_PK
回复
starkpan
哈哈哈,经历了一次,以后就知道了
2018-11-01
共3条回复

Michael_PK

2018-10-31

去yarn界面上看下,作业是running还是accept

0
1
starkpan
报错了,链接到0.0.0.0:8032被拒绝。用start-hdf.sh启动的hadoop,看不到job。明天用yarn试试。
2018-10-31
共1条回复

以慕课网日志分析为例 进入大数据Spark SQL的世界

快速转型大数据:Hadoop,Hive,SparkSQL步步为赢

1644 学习 · 1129 问题

查看课程