虚拟机网络连接方式 用修改吗?

来源:3-8 HDFS伪分布式环境搭建

慕先生8683855

2018-02-12

老师好,我装好虚拟机,打开hadoop000 后,ifconfig 提示ip 地址为127.0.0.1

把网络连接方式改为 NAT后,网络地址修改成 192.168.139.128

但是启动start-dfs.sh 时候 报错

hadoop000: ssh: connect to host hadoop000 port 22: Connection refused

烦请有空解答下


写回答

2回答

慕先生8683855

提问者

2018-02-12

查看 /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-datanode-hadoop000.log

日志

2018-02-12 17:50:39,993 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hadoop/app/tmp/dfs/data/in_use.lock acquired by nodename 5840@hadoop000

2018-02-12 17:50:39,996 WARN org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: Incompatible clusterIDs in /home/hadoop/app/tmp/dfs/data: namenode clusterID = CID-7f6506dc-a88d-4e3f-b8d1-5bc7f0e7ef7e; datanode clusterID = CID-a00a7911-de1c-43c4-83ce-d29cc681a7ee

2018-02-12 17:50:39,997 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to hadoop000/192.168.139.128:8020. Exiting. 

java.io.IOException: All specified directories are failed to load.

at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:478)

at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1394)

at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1355)

at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:317)

at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:228)

at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:829)

at java.lang.Thread.run(Thread.java:745)

2018-02-12 17:50:40,000 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to hadoop000/192.168.139.128:8020

2018-02-12 17:50:40,101 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool <registering> (Datanode Uuid unassigned)

2018-02-12 17:50:42,121 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode

2018-02-12 17:50:42,125 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 0

2018-02-12 17:50:42,128 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG: 

/************************************************************

SHUTDOWN_MSG: Shutting down DataNode at hadoop000/192.168.139.128


0
0

慕先生8683855

提问者

2018-02-12

然后 我修改sudo vi etc/hosts中 修改了 hostname和Ip地址映射

可以启动起来了,但是jps 又没有datanode 进程,只有namenode 进程

[hadoop@hadoop000 sbin]$ ./start-dfs.sh 

18/02/12 17:35:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Starting namenodes on [hadoop000]

hadoop000: Warning: Permanently added the RSA host key for IP address '192.168.139.128' to the list of known hosts.

hadoop000: starting namenode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-namenode-hadoop000.out

hadoop000: starting datanode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-datanode-hadoop000.out

Starting secondary namenodes [0.0.0.0]

0.0.0.0: secondarynamenode running as process 3332. Stop it first.

18/02/12 17:35:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

[hadoop@hadoop000 sbin]$ jps

4038 Jps

3332 SecondaryNameNode

3671 NameNode


0
0

10小时入门大数据

【毕设】大数据零基础入门必备,轻松掌握Hadoop开发核心技能

1456 学习 · 656 问题

查看课程