提交作业显示连接不到dfs?

来源：5-7 提交example案例到YARN上运行

慕容2873438

2019-12-10

[root@VM_0_16_centos mapreduce]# hadoop jar hadoop-mapreduce-examples-2.6.0-cdh5.15.1.jar pi 2 3
Number of Maps = 2
Samples per Map = 3
19/12/10 11:07:27 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
java.net.ConnectException: Call From localhost/127.0.0.1 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
at org.apache.hadoop.ipc.Client.call(Client.java:1508)
at org.apache.hadoop.ipc.Client.call(Client.java:1441)
at org.apache.hadoop.ipc.ProtobufRpcEngine $I n v o k e r . i n v o k e (P r o t o b u f R p c E n g i n e . j a v a : 230) a t c o m . s u n . p r o x y .$ Proxy10.getFileInfo(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:788)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:258)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)
at com.sun.proxy.$Proxy11.getFileInfo(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2168)
at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1266)
at org.apache.hadoop.hdfs.DistributedFileSystem $20 . d o C a l l (D i s t r i b u t e d F i l e S y s t e m . j a v a : 1262) a t o r g . a p a c h e . h a d o o p . f s . F i l e S y s t e m L i n k R e s o l v e r . r e s o l v e (F i l e S y s t e m L i n k R e s o l v e r . j a v a : 81) a t o r g . a p a c h e . h a d o o p . h d f s . D i s t r i b u t e d F i l e S y s t e m . g e t F i l e S t a t u s (D i s t r i b u t e d F i l e S y s t e m . j a v a : 1262) a t o r g . a p a c h e . h a d o o p . f s . F i l e S y s t e m . e x i s t s (F i l e S y s t e m . j a v a : 1418) a t o r g . a p a c h e . h a d o o p . e x a m p l e s . Q u a s i M o n t e C a r l o . e s t i m a t e P i (Q u a s i M o n t e C a r l o . j a v a : 278) a t o r g . a p a c h e . h a d o o p . e x a m p l e s . Q u a s i M o n t e C a r l o . r u n (Q u a s i M o n t e C a r l o . j a v a : 354) a t o r g . a p a c h e . h a d o o p . u t i l . T o o l R u n n e r . r u n (T o o l R u n n e r . j a v a : 70) a t o r g . a p a c h e . h a d o o p . e x a m p l e s . Q u a s i M o n t e C a r l o . m a i n (Q u a s i M o n t e C a r l o . j a v a : 363) a t s u n . r e f l e c t . N a t i v e M e t h o d A c c e s s o r I m p l . i n v o k e 0 (N a t i v e M e t h o d) a t s u n . r e f l e c t . N a t i v e M e t h o d A c c e s s o r I m p l . i n v o k e (N a t i v e M e t h o d A c c e s s o r I m p l . j a v a : 62) a t s u n . r e f l e c t . D e l e g a t i n g M e t h o d A c c e s s o r I m p l . i n v o k e (D e l e g a t i n g M e t h o d A c c e s s o r I m p l . j a v a : 43) a t j a v a . l a n g . r e f l e c t . M e t h o d . i n v o k e (M e t h o d . j a v a : 498) a t o r g . a p a c h e . h a d o o p . u t i l . P r o g r a m D r i v e r$ ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:226)
at org.apache.hadoop.util.RunJar.main(RunJar.java:141)
Caused by: java.net.ConnectException: Connection refused
执行：hadoop jar hadoop-mapreduce-examples-2.6.0-cdh5.15.1.jar pi 2 3命令的时候连接不到dfs,dfs和yarn肯定是启动的。运行这个命令后nameNode进程自己就挂掉了。这个问题我百度了一下，也找不到解决办法！

写回答

2回答

慕神6158165

2019-12-10

解决了吗？我也出现这个问题？重启了 hdfs和yarn 之后jps显示都存在但是一运行就出现这个问题了

慕神6158165

Michael_PK

我和他的有点不一样，我可以连接的但是提交任务之后就出现问题了 19/12/13 14:27:21 INFO mapreduce.Job: Running job: job_1576218412790_0001 19/12/13 14:28:16 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

2019-12-13

共2条回复