jar包找不到

来源:9-7 Flink on YARN第一种模式实操

小小de

2019-11-13

Error: A JNI error has occurred, please check your installation and try again
Exception in thread “main” java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
at java.lang.Class.getMethod0(Class.java:3018)
at java.lang.Class.getMethod(Class.java:1784)
at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
… 7 more

老师,请问HADOOP_CLASSPATH配置在哪里呀?我配置了好像没用。我配置在config.sh文件下,配置内容是:
export HADOOP_CLASSPATH=$HADOOP_HOME/share/hadoop/common/*
export HADOOP_CLASSPATH=$HADOOP_HOME/share/hadoop/yarn/*

写回答

4回答

yuyuda

2019-11-23

把下面环境变量配置好,就解决了:

#set hadoop env

#export HADOOP_HOME=/root/hadoop

#export HADOOP_HOME=/root/hadoop-2.9.2

export HADOOP_HOME=/root/hadoop-2.8.0

export PATH=$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH

export HADOOP_MAPRED_HOME=$HADOOP_HOME

export HADOOP_COMMON_HOME=$HADOOP_HOME

export HADOOP_HDFS_HOME=$HADOOP_HOME

export YARN_HOME=$HADOOP_HOME

export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop

export YARN_CONF_DIR=$HADOOP_HOME/etc/hadoop

export HADOOP_CLASSPATH=$HADOOP_COMMON_HOME/lib:$HADOOP_HOME/share/hadoop/yarn/*:$HADOOP_HOME/share/hadoop/common/*:$HADOOP_HOME/share/hadoop/mepreduce/*:$HADOOP_HOME/share/hadoop/hdfs/*:$HADOOP_HOME/share/tools/*:$HADOOP_HOME/share/hadoop/httpfs/*:$HADOOP_HOME/share/hadoop/kms/*:$HADOOP_HOME/share/hadoop/common/lib/*


1
1
Michael_PK
对的,需要环境变量。
2019-11-23
共1条回复

qq_随我_0

2020-09-22

老哥,你最后解决了吗?

0
1
Michael_PK
参考上面小伙伴的解决方案,加入环境变量
2020-09-22
共1条回复

Michael_PK

2019-11-14

参考:https://ci.apache.org/projects/flink/flink-docs-release-1.9/flinkDev/building.html

Dependency Shading部分

应该是少了hadoop相关的shade包

0
0

Michael_PK

2019-11-14

你的flink是自己编译的吗

0
1
yuyuda
我是自己编译的,已经换了无数不同版本,也报上边的错误。
2019-11-23
共1条回复

新一代大数据计算引擎 Flink从入门到实战

入行或转型大数据新姿势,多语言系统化讲解,极速入门Flink

969 学习 · 296 问题

查看课程