spark-submit 报错

来源:4-13 -算子综合案例实战一词频统计

爬行的蜗牛2019

2020-02-29

老师,你好,遇到的错误:
文件目录没有问题,不知道是什么问题。
[root@spark:bin]$ ./spark-submit --master local[2] --name wordcount /data/spark/script/wordcount.py file:///data/spark/sparktd/hello.txt
20/02/29 00:06:47 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
python3.6: can’t open file ‘/data/spark/script/wordcount.py’: [Errno 2] No such file or directory
log4j:WARN No appenders could be found for logger (org.apache.spark.util.ShutdownHookManager).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark’s default log4j profile: org/apache/spark/log4j-defaults.properties

写回答

1回答

Michael_PK

2020-02-29

python3.6: can’t open file ‘/data/spark/script/wordcount.py’: [Errno 2] No such file or directory
确认这么文件存在吗

0
4
Michael_PK
回复
爬行的蜗牛2019
还是要细心,遇到找不到文件的,一定要拷贝出来ls看看
2020-03-01
共4条回复

Python3实战Spark大数据分析及调度

使用Python3对Spark应用程序进行开发调优,掌握Azkaban任务调度

1046 学习 · 434 问题

查看课程