namenode起不来 报错信息补全
来源:2-4 -Hadoop环境搭建
Jokky
2020-04-22
2020-04-22 13:11:34,159 INFO org.apache.hadoop.hdfs.server.common.Util: Assuming 'file' scheme for path /home/hdfs/dfs/name in configuration.
2020-04-22 13:11:34,159 INFO org.apache.hadoop.hdfs.server.common.Util: Assuming 'file' scheme for path /home/hdfs/dfs/name in configuration.
2020-04-22 13:11:34,160 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories!
2020-04-22 13:11:34,160 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one namespace edits storage directory (dfs.namenode.edits.dir) configured. Beware of data loss due to lack of redundant storage directories!
2020-04-22 13:11:34,165 INFO org.apache.hadoop.hdfs.server.common.Util: Assuming 'file' scheme for path /home/hdfs/dfs/name in configuration.
2020-04-22 13:11:34,165 INFO org.apache.hadoop.hdfs.server.common.Util: Assuming 'file' scheme for path /home/hdfs/dfs/name in configuration.
2020-04-22 13:11:34,198 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Edit logging is async:true
2020-04-22 13:11:34,208 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: KeyProvider: null
2020-04-22 13:11:34,209 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsLock is fair: true
2020-04-22 13:11:34,209 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Detailed lock hold time metrics enabled: false
2020-04-22 13:11:34,246 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner = root (auth:SIMPLE)
2020-04-22 13:11:34,246 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup = supergroup
2020-04-22 13:11:34,246 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled = true
2020-04-22 13:11:34,246 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: HA Enabled: false
2020-04-22 13:11:34,265 INFO org.apache.hadoop.hdfs.server.common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling
2020-04-22 13:11:34,282 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000
2020-04-22 13:11:34,282 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
2020-04-22 13:11:34,284 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2020-04-22 13:11:34,284 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: The block deletion will start around 2020 四月 22 13:11:34
2020-04-22 13:11:34,286 INFO org.apache.hadoop.util.GSet: Computing capacity for map BlocksMap
2020-04-22 13:11:34,286 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2020-04-22 13:11:34,287 INFO org.apache.hadoop.util.GSet: 2.0% max memory 889 MB = 17.8 MB
2020-04-22 13:11:34,287 INFO org.apache.hadoop.util.GSet: capacity = 2^21 = 2097152 entries
2020-04-22 13:11:34,293 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.block.access.token.enable=false
2020-04-22 13:11:34,293 WARN org.apache.hadoop.conf.Configuration: No unit for dfs.heartbeat.interval(3) assuming SECONDS
2020-04-22 13:11:34,297 WARN org.apache.hadoop.conf.Configuration: No unit for dfs.namenode.safemode.extension(30000) assuming MILLISECONDS
2020-04-22 13:11:34,297 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 30000
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: defaultReplication = 1
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplication = 512
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: minReplication = 1
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplicationStreams = 2
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: replicationRecheckInterval = 3000
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: encryptDataTransfer = false
2020-04-22 13:11:34,298 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxNumBlocksToLog = 1000
2020-04-22 13:11:34,299 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Append Enabled: true
2020-04-22 13:11:34,332 INFO org.apache.hadoop.hdfs.server.namenode.FSDirectory: GLOBAL serial map: bits=24 maxEntries=16777215
2020-04-22 13:11:34,343 INFO org.apache.hadoop.util.GSet: Computing capacity for map INodeMap
2020-04-22 13:11:34,343 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2020-04-22 13:11:34,343 INFO org.apache.hadoop.util.GSet: 1.0% max memory 889 MB = 8.9 MB
2020-04-22 13:11:34,343 INFO org.apache.hadoop.util.GSet: capacity = 2^20 = 1048576 entries
2020-04-22 13:11:34,344 INFO org.apache.hadoop.hdfs.server.namenode.FSDirectory: ACLs enabled? false
2020-04-22 13:11:34,344 INFO org.apache.hadoop.hdfs.server.namenode.FSDirectory: XAttrs enabled? true
2020-04-22 13:11:34,344 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occurring more than 10 times
2020-04-22 13:11:34,347 INFO org.apache.hadoop.hdfs.server.namenode.snapshot.SnapshotManager: Loaded config captureOpenFiles: falseskipCaptureAccessTimeOnlyChange: false
2020-04-22 13:11:34,350 INFO org.apache.hadoop.util.GSet: Computing capacity for map cachedBlocks
2020-04-22 13:11:34,350 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2020-04-22 13:11:34,350 INFO org.apache.hadoop.util.GSet: 0.25% max memory 889 MB = 2.2 MB
2020-04-22 13:11:34,351 INFO org.apache.hadoop.util.GSet: capacity = 2^18 = 262144 entries
2020-04-22 13:11:34,353 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
2020-04-22 13:11:34,353 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
2020-04-22 13:11:34,353 INFO org.apache.hadoop.hdfs.server.namenode.top.metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
2020-04-22 13:11:34,355 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache on namenode is enabled
2020-04-22 13:11:34,355 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2020-04-22 13:11:34,356 INFO org.apache.hadoop.util.GSet: Computing capacity for map NameNodeRetryCache
2020-04-22 13:11:34,356 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2020-04-22 13:11:34,356 INFO org.apache.hadoop.util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB
2020-04-22 13:11:34,356 INFO org.apache.hadoop.util.GSet: capacity = 2^15 = 32768 entries
2020-04-22 13:11:34,367 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/hdfs/dfs/name/in_use.lock acquired by nodename 10885@localhost
2020-04-22 13:11:34,382 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized segments in /home/hdfs/dfs/name/current
2020-04-22 13:11:34,382 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: No edit log streams selected.
2020-04-22 13:11:34,382 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Planning to load image: FSImageFile(file=/home/hdfs/dfs/name/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000)
2020-04-22 13:11:34,408 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode: Loading 1 INodes.
2020-04-22 13:11:34,418 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode: Successfully loaded 1 inodes
2020-04-22 13:11:34,425 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.
2020-04-22 13:11:34,425 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loaded image for txid 0 from /home/hdfs/dfs/name/current/fsimage_0000000000000000000
2020-04-22 13:11:34,429 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
2020-04-22 13:11:34,429 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 1
2020-04-22 13:11:34,512 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
2020-04-22 13:11:34,512 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading FSImage in 154 msecs
2020-04-22 13:11:34,627 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: RPC server is binding to 120.26.65.227:9000
2020-04-22 13:11:34,627 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Enable NameNode state context:false
2020-04-22 13:11:34,631 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 1000 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler
2020-04-22 13:11:34,639 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for active state
2020-04-22 13:11:34,639 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 1, 1
2020-04-22 13:11:34,640 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 7
2020-04-22 13:11:34,641 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /home/hdfs/dfs/name/current/edits_inprogress_0000000000000000001 -> /home/hdfs/dfs/name/current/edits_0000000000000000001-0000000000000000002
2020-04-22 13:11:34,657 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: FSEditLogAsync was interrupted, exiting
2020-04-22 13:11:34,677 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for active state
2020-04-22 13:11:34,677 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Stopping services started for standby state
2020-04-22 13:11:34,678 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
2020-04-22 13:11:34,779 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...
2020-04-22 13:11:34,779 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.
2020-04-22 13:11:34,779 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.
2020-04-22 13:11:34,786 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
java.net.BindException: Problem binding to [120.26.65.227:9000] java.net.BindException: 无法指定被请求的地址; For more details see: http://wiki.apache.org/hadoop/BindException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:824)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:735)
at org.apache.hadoop.ipc.Server.bind(Server.java:615)
at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:1179)
at org.apache.hadoop.ipc.Server.<init>(Server.java:2983)
at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:1003)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:425)
at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:346)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:844)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.<init>(NameNodeRpcServer.java:449)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:811)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:738)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:961)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:940)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1714)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1782)
Caused by: java.net.BindException: 无法指定被请求的地址
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.apache.hadoop.ipc.Server.bind(Server.java:598)
... 13 more
2020-04-22 13:11:34,789 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.net.BindException: Problem binding to [120.26.65.227:9000] java.net.BindException: 无法指定被请求的地址; For more details see: http://wiki.apache.org/hadoop/BindException
2020-04-22 13:11:34,790 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1
************************************************************/
写回答
2回答
-
Michael_PK
2020-04-22
详细信息整理文档QQ发我
00 -
Michael_PK
2020-04-22
你机器上是不是已经进程已经启动过了啊,然后端口被占用了
042020-04-22
相似问题