bin/flink run -s 在命令行中运行Savepoint不生效

来源:16-12 SavePoint

慕田峪0177977

2020-09-17

我使用bin/flink run -s命令在命令行中进行断点恢复,但是个数统计、断点恢复等功能好像都不能用,输入命令如下:

bin/flink run -m yarn-cluster -c com.imooc.flink.state.CheckpointApp -s /home/hadoop/IdeaProjects/imooc-workspace/imooc-flink-train/state/3161d74f5a166fa3909e2b3bf1fa4ff2 /home/hadoop/IdeaProjects/imooc-workspace/imooc-flink-train/target/flink-train-1.0.jar


SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/home/hadoop/app/flink-1.10.0/lib/slf4j-log4j12-1.7.15.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/home/hadoop/app/hadoop-2.6.0-cdh5.15.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

2020-09-17 20:08:04,553 INFO  org.apache.flink.yarn.cli.FlinkYarnSessionCli                 - Found Yarn properties file under /tmp/.yarn-properties-hadoop.

2020-09-17 20:08:04,553 INFO  org.apache.flink.yarn.cli.FlinkYarnSessionCli                 - Found Yarn properties file under /tmp/.yarn-properties-hadoop.

2020-09-17 20:08:04,891 WARN  org.apache.flink.yarn.cli.FlinkYarnSessionCli                 - The configuration directory ('/home/hadoop/app/flink-1.10.0/conf') already contains a LOG4J config file.If you want to use logback, then please delete or rename the log configuration file.

2020-09-17 20:08:04,891 WARN  org.apache.flink.yarn.cli.FlinkYarnSessionCli                 - The configuration directory ('/home/hadoop/app/flink-1.10.0/conf') already contains a LOG4J config file.If you want to use logback, then please delete or rename the log configuration file.

2020-09-17 20:08:07,547 INFO  org.apache.hadoop.yarn.client.RMProxy                         - Connecting to ResourceManager at hadoop000/192.168.1.116:8032

2020-09-17 20:08:07,726 INFO  org.apache.flink.yarn.YarnClusterDescriptor                   - No path for the flink jar passed. Using the location of class org.apache.flink.yarn.YarnClusterDescriptor to locate the jar

2020-09-17 20:08:07,942 INFO  org.apache.flink.yarn.YarnClusterDescriptor                   - Cluster specification: ClusterSpecification{masterMemoryMB=1024, taskManagerMemoryMB=1568, slotsPerTaskManager=1}

2020-09-17 20:08:14,786 INFO  org.apache.flink.yarn.YarnClusterDescriptor                   - Submitting application master application_1600341643199_0007

2020-09-17 20:08:14,842 INFO  org.apache.hadoop.yarn.client.api.impl.YarnClientImpl         - Submitted application application_1600341643199_0007

2020-09-17 20:08:14,843 INFO  org.apache.flink.yarn.YarnClusterDescriptor                   - Waiting for the cluster to be allocated

2020-09-17 20:08:14,845 INFO  org.apache.flink.yarn.YarnClusterDescriptor                   - Deploying cluster, current state ACCEPTED


写回答

1回答

Michael_PK

2020-09-17

要恢复的前提是,你以前的数据都chk了,要在可靠的statebackend存储了的才行

0
2
Michael_PK
回复
慕田峪0177977
要为了累计OK,前提也是一样的,要backend,不然没用
2020-09-17
共2条回复

新一代大数据计算引擎 Flink从入门到实战

入行或转型大数据新姿势,多语言系统化讲解,极速入门Flink

969 学习 · 296 问题

查看课程