SSSApp提交spark-submit在yarn运行时Resetting offset问题
来源：9-8 打包到服务器运行
夜愿小夜
2022-01-14
老师，我提交spark-submit运行后，看到日志这样显示
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Seeking to LATEST offset of partition access-topic-prod-0
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Resetting offset for partition access-topic-prod-0 to offset 133079.
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Seeking to LATEST offset of partition access-topic-prod-0
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Resetting offset for partition access-topic-prod-0 to offset 133079.
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Seeking to LATEST offset of partition access-topic-prod-0
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Resetting offset for partition access-topic-prod-0 to offset 133079.
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Seeking to LATEST offset of partition access-topic-prod-0
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Resetting offset for partition access-topic-prod-0 to offset 133079.
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Seeking to LATEST offset of partition access-topic-prod-0
22/01/14 11:09:41 INFO internals.SubscriptionState: [Consumer clientId=consumer-spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0-1, groupId=spark-kafka-source-f1e3a0f1-c7cb-498a-aac0-0e173529602e-1691655236-driver-0] Resetting offset for partition access-topic-prod-0 to offset 133079.
写回答
1回答
-
夜愿小夜
提问者
2022-01-14
后来发现是正常日志输出，程序运行正确！
022022-01-16
相似问题