spark-submit 报错
来源:4-13 -算子综合案例实战一词频统计
爬行的蜗牛2019
2020-02-29
老师,你好,遇到的错误:
文件目录没有问题,不知道是什么问题。
[root@spark:bin]$ ./spark-submit --master local[2] --name wordcount /data/spark/script/wordcount.py file:///data/spark/sparktd/hello.txt
20/02/29 00:06:47 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
python3.6: can’t open file ‘/data/spark/script/wordcount.py’: [Errno 2] No such file or directory
log4j:WARN No appenders could be found for logger (org.apache.spark.util.ShutdownHookManager).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark’s default log4j profile: org/apache/spark/log4j-defaults.properties
1回答
-
Michael_PK
2020-02-29
python3.6: can’t open file ‘/data/spark/script/wordcount.py’: [Errno 2] No such file or directory
确认这么文件存在吗042020-03-01
相似问题