虚拟机网络连接方式 用修改吗?
来源:3-8 HDFS伪分布式环境搭建

慕先生8683855
2018-02-12
老师好,我装好虚拟机,打开hadoop000 后,ifconfig 提示ip 地址为127.0.0.1
把网络连接方式改为 NAT后,网络地址修改成 192.168.139.128
但是启动start-dfs.sh 时候 报错
hadoop000: ssh: connect to host hadoop000 port 22: Connection refused
烦请有空解答下
2回答
-
慕先生8683855
提问者
2018-02-12
查看 /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-datanode-hadoop000.log
日志
2018-02-12 17:50:39,993 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hadoop/app/tmp/dfs/data/in_use.lock acquired by nodename 5840@hadoop000
2018-02-12 17:50:39,996 WARN org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException: Incompatible clusterIDs in /home/hadoop/app/tmp/dfs/data: namenode clusterID = CID-7f6506dc-a88d-4e3f-b8d1-5bc7f0e7ef7e; datanode clusterID = CID-a00a7911-de1c-43c4-83ce-d29cc681a7ee
2018-02-12 17:50:39,997 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to hadoop000/192.168.139.128:8020. Exiting.
java.io.IOException: All specified directories are failed to load.
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:478)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1394)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1355)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:317)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:228)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:829)
at java.lang.Thread.run(Thread.java:745)
2018-02-12 17:50:40,000 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to hadoop000/192.168.139.128:8020
2018-02-12 17:50:40,101 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool <registering> (Datanode Uuid unassigned)
2018-02-12 17:50:42,121 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
2018-02-12 17:50:42,125 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 0
2018-02-12 17:50:42,128 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at hadoop000/192.168.139.128
00 -
慕先生8683855
提问者
2018-02-12
然后 我修改sudo vi etc/hosts中 修改了 hostname和Ip地址映射
可以启动起来了,但是jps 又没有datanode 进程,只有namenode 进程
[hadoop@hadoop000 sbin]$ ./start-dfs.sh
18/02/12 17:35:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [hadoop000]
hadoop000: Warning: Permanently added the RSA host key for IP address '192.168.139.128' to the list of known hosts.
hadoop000: starting namenode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-namenode-hadoop000.out
hadoop000: starting datanode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-datanode-hadoop000.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: secondarynamenode running as process 3332. Stop it first.
18/02/12 17:35:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[hadoop@hadoop000 sbin]$ jps
4038 Jps
3332 SecondaryNameNode
3671 NameNode
00
相似问题