在idea本地测试的时候:ERROR SparkContext: Error initializing SparkContext.

来源:5-5 spark-shell&spark-sql的使用

魔法少女德莉傻

2018-07-25

报错是:

18/07/25 11:21:13 ERROR SparkContext: Error initializing SparkContext.

java.net.BindException: Can't assign requested address: Service 'sparkDriver' failed after 16 retries!

发生了什么???

18/07/25 11:21:13 ERROR SparkContext: Error initializing SparkContext.

java.net.BindException: Can't assign requested address: Service 'sparkDriver' failed after 16 retries!

at sun.nio.ch.Net.bind0(Native Method)

at sun.nio.ch.Net.bind(Net.java:433)

at sun.nio.ch.Net.bind(Net.java:425)

at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)

at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)

at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125)

at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:485)

at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1089)

at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:430)

at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:415)

at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:903)

at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:198)

at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:348)

at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)

at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)

at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)

at java.lang.Thread.run(Thread.java:748)

18/07/25 11:21:13 INFO SparkContext: Successfully stopped SparkContext

Exception in thread "main" java.net.BindException: Can't assign requested address: Service 'sparkDriver' failed after 16 retries!

at sun.nio.ch.Net.bind0(Native Method)

at sun.nio.ch.Net.bind(Net.java:433)

at sun.nio.ch.Net.bind(Net.java:425)

at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)

at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)

at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125)

at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:485)

at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1089)

at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:430)

at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:415)

at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:903)

at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:198)

at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:348)

at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)

at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)

at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)

at java.lang.Thread.run(Thread.java:748)


写回答

1回答

Michael_PK

2018-07-25

你jps下是不是很多spark submit啊。。。。

0
4
Michael_PK
回复
魔法少女德莉傻
你怎么运行的?肯定有这个进程在,而且是16个
2018-07-25
共4条回复

以慕课网日志分析为例 进入大数据Spark SQL的世界

快速转型大数据:Hadoop,Hive,SparkSQL步步为赢

1644 学习 · 1129 问题

查看课程