实战

回到首页 个人中心 反馈问题 注册登录
下载APP
首页 课程 实战 体系课 手记 专栏 慕课教程

关于kafka集群isr经常只剩一个的问题

来源：1-1 导学

mahsiaoko

2021-11-03

老师您好，我创建的kafka集群有两个broker，就是下图的16和8；在运行时，我发现这两个节点中，所有的partition的leader节点只有一个，如下图；
图片描述
而且，其中一个节点经常性的掉线，如下图；
图片描述

这个时候，消费者会经常报如下的错误：

[11:03 19:55:41.466] [WARN] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Offset commit failed on partition DNS-BEA-DNSC2R-LOG-6 at offset 51661: The request timed out.
[11:03 19:55:41.467] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: error response REQUEST_TIMED_OUT.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:41.569] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:41.570] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:41.570] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: coordinator unavailable.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:41.673] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:46.681] [WARN] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Offset commit failed on partition DNS-BEA-DNSC2R-LOG-6 at offset 51661: The request timed out.
[11:03 19:55:46.682] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: error response REQUEST_TIMED_OUT.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:46.785] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:46.786] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:46.786] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: coordinator unavailable.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:46.889] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)

其中159.226.16.116:29097对应的就是节点16。被这个问题困扰很久了，希望老师能指明一个解决问题的方向。

目前集群使用的kafka版本是 kafka_2.13-3.0.0 ，总共设置了3个controller和两个broker，都是运行在kvm虚拟机中，其中broker机器的配置是，500G磁盘，64G内存，8核cpu。

谢谢！

1.目前已经排除网络等问题；
2.因为此处节点是8和16，所以我认为leader节点应该既包括8，也包括16，我这边发现只有16是leader节点；
3.在报错的时候，错误日志如下：

[00:30:54:104] [ERROR] - org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1188) - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Offset commit failed on partition DNS-BEA-DNSC2R-LOG-6 at offset 9913151: The coordinator is not aware of this member.
[00:30:54:104] [ERROR] - com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:112) - 提交offset失败: 
org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records.
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1260) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1161) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1184) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1159) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:206) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:169) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:129) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:602) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:412) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:297) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:236) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:215) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:1003) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1491) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1439) ~[kafka-clients-3.0.0.jar!/:?]
	at com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:107) [classes!/:0.0.1-SNAPSHOT]
	at com.iscas.consumer.application.KafkaConsumerApplication.run(KafkaConsumerApplication.java:85) [classes!/:0.0.1-SNAPSHOT]
	at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:782) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:772) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1343) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1332) [spring-boot-2.5.5.jar!/:2.5.5]
	at com.iscas.consumer.ConsumerApplication.main(ConsumerApplication.java:13) [classes!/:0.0.1-SNAPSHOT]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:108) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:58) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:88) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
[16:50:06:799] [ERROR] - com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:114) - 提交超时: 
org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {DNS-BEA-DNSR2A-LOG-1=OffsetAndMetadata{offset=10856520, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-5=OffsetAndMetadata{offset=10884298, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-2=OffsetAndMetadata{offset=10857454, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-9=OffsetAndMetadata{offset=10862269, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-2=OffsetAndMetadata{offset=10866053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-1=OffsetAndMetadata{offset=10864331, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-7=OffsetAndMetadata{offset=10883777, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-5=OffsetAndMetadata{offset=10884329, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-1=OffsetAndMetadata{offset=10869069, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-6=OffsetAndMetadata{offset=10841883, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-9=OffsetAndMetadata{offset=10867495, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-2=OffsetAndMetadata{offset=10876075, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-6=OffsetAndMetadata{offset=10863863, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-2=OffsetAndMetadata{offset=10880983, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-6=OffsetAndMetadata{offset=10889363, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-6=OffsetAndMetadata{offset=10860143, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-2=OffsetAndMetadata{offset=10883515, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-1=OffsetAndMetadata{offset=10858111, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-6=OffsetAndMetadata{offset=10863199, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-2=OffsetAndMetadata{offset=10844604, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-9=OffsetAndMetadata{offset=10855417, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-6=OffsetAndMetadata{offset=10881226, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-6=OffsetAndMetadata{offset=10861467, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-5=OffsetAndMetadata{offset=10869441, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-2=OffsetAndMetadata{offset=10879292, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-1=OffsetAndMetadata{offset=10869283, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-5=OffsetAndMetadata{offset=10873270, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-3=OffsetAndMetadata{offset=10848590, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-3=OffsetAndMetadata{offset=10867922, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-7=OffsetAndMetadata{offset=10858354, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-7=OffsetAndMetadata{offset=10886267, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-7=OffsetAndMetadata{offset=10871525, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-7=OffsetAndMetadata{offset=10873600, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-0=OffsetAndMetadata{offset=10851168, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-3=OffsetAndMetadata{offset=10895303, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-0=OffsetAndMetadata{offset=10882191, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-8=OffsetAndMetadata{offset=10855342, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-9=OffsetAndMetadata{offset=10877034, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-3=OffsetAndMetadata{offset=10864047, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-4=OffsetAndMetadata{offset=10857215, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-3=OffsetAndMetadata{offset=10869806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-0=OffsetAndMetadata{offset=10893502, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-7=OffsetAndMetadata{offset=10863704, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-4=OffsetAndMetadata{offset=10868957, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-0=OffsetAndMetadata{offset=10888053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-8=OffsetAndMetadata{offset=10882698, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-4=OffsetAndMetadata{offset=10878119, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-4=OffsetAndMetadata{offset=10865505, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-4=OffsetAndMetadata{offset=10879273, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-8=OffsetAndMetadata{offset=10881371, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-8=OffsetAndMetadata{offset=10868559, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-0=OffsetAndMetadata{offset=10885418, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-8=OffsetAndMetadata{offset=10860320, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-1=OffsetAndMetadata{offset=10854007, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-7=OffsetAndMetadata{offset=10845713, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-8=OffsetAndMetadata{offset=10885806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-0=OffsetAndMetadata{offset=10839159, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-0=OffsetAndMetadata{offset=10873894, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-3=OffsetAndMetadata{offset=10840694, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-4=OffsetAndMetadata{offset=10879088, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-4=OffsetAndMetadata{offset=10881639, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-8=OffsetAndMetadata{offset=10858490, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-1=OffsetAndMetadata{offset=10850021, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-3=OffsetAndMetadata{offset=10866042, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-5=OffsetAndMetadata{offset=10882422, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-9=OffsetAndMetadata{offset=10870796, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-5=OffsetAndMetadata{offset=10862959, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-9=OffsetAndMetadata{offset=10871214, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-5=OffsetAndMetadata{offset=10871016, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-9=OffsetAndMetadata{offset=10880800, leaderEpoch=null, metadata=''}}
[16:51:34:763] [ERROR] - com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:114) - 提交超时: 
org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {DNS-BEA-DNSR2A-LOG-1=OffsetAndMetadata{offset=10856520, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-5=OffsetAndMetadata{offset=10884298, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-2=OffsetAndMetadata{offset=10857454, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-9=OffsetAndMetadata{offset=10862269, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-2=OffsetAndMetadata{offset=10866053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-1=OffsetAndMetadata{offset=10864331, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-7=OffsetAndMetadata{offset=10883777, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-5=OffsetAndMetadata{offset=10884329, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-1=OffsetAndMetadata{offset=10869069, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-6=OffsetAndMetadata{offset=10841883, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-9=OffsetAndMetadata{offset=10867495, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-2=OffsetAndMetadata{offset=10876075, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-6=OffsetAndMetadata{offset=10863863, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-2=OffsetAndMetadata{offset=10880983, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-6=OffsetAndMetadata{offset=10889363, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-6=OffsetAndMetadata{offset=10860143, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-2=OffsetAndMetadata{offset=10883515, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-1=OffsetAndMetadata{offset=10858111, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-6=OffsetAndMetadata{offset=10863199, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-2=OffsetAndMetadata{offset=10844604, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-9=OffsetAndMetadata{offset=10855417, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-6=OffsetAndMetadata{offset=10885696, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-6=OffsetAndMetadata{offset=10861467, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-5=OffsetAndMetadata{offset=10869441, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-2=OffsetAndMetadata{offset=10879292, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-1=OffsetAndMetadata{offset=10874203, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-5=OffsetAndMetadata{offset=10873270, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-3=OffsetAndMetadata{offset=10848590, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-3=OffsetAndMetadata{offset=10867922, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-7=OffsetAndMetadata{offset=10858354, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-7=OffsetAndMetadata{offset=10886267, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-7=OffsetAndMetadata{offset=10871525, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-7=OffsetAndMetadata{offset=10873600, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-0=OffsetAndMetadata{offset=10851168, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-3=OffsetAndMetadata{offset=10895303, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-0=OffsetAndMetadata{offset=10882191, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-8=OffsetAndMetadata{offset=10855342, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-9=OffsetAndMetadata{offset=10877034, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-3=OffsetAndMetadata{offset=10864047, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-4=OffsetAndMetadata{offset=10857215, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-3=OffsetAndMetadata{offset=10869806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-0=OffsetAndMetadata{offset=10893502, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-7=OffsetAndMetadata{offset=10863704, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-4=OffsetAndMetadata{offset=10868957, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-0=OffsetAndMetadata{offset=10888053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-8=OffsetAndMetadata{offset=10882698, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-4=OffsetAndMetadata{offset=10878119, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-4=OffsetAndMetadata{offset=10865505, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-4=OffsetAndMetadata{offset=10879273, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-8=OffsetAndMetadata{offset=10881371, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-8=OffsetAndMetadata{offset=10868559, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-0=OffsetAndMetadata{offset=10885418, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-8=OffsetAndMetadata{offset=10861265, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-1=OffsetAndMetadata{offset=10854007, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-7=OffsetAndMetadata{offset=10845713, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-8=OffsetAndMetadata{offset=10885806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-0=OffsetAndMetadata{offset=10839159, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-0=OffsetAndMetadata{offset=10873894, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-3=OffsetAndMetadata{offset=10840694, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-4=OffsetAndMetadata{offset=10879088, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-4=OffsetAndMetadata{offset=10881639, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-8=OffsetAndMetadata{offset=10858490, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-1=OffsetAndMetadata{offset=10850021, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-3=OffsetAndMetadata{offset=10866186, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-5=OffsetAndMetadata{offset=10882422, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-9=OffsetAndMetadata{offset=10870796, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-5=OffsetAndMetadata{offset=10862959, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-9=OffsetAndMetadata{offset=10871214, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-5=OffsetAndMetadata{offset=10871016, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-9=OffsetAndMetadata{offset=10880800, leaderEpoch=null, metadata=''}}
写回答

1回答

Allen

2021-11-04

看你截图， 你的ISR是两个节点。leader节点一个是正常的，这个存疑的点我有点没get到。

至于你说的节点经常掉线最好有错误日志， 光给我配置不好判断呢。 有排除过防火墙或者网络问题么

0
4
Allen
回复
mahsiaoko
leader都是同一个节点的原因有很多，有可能是因为broker掉线以后进行了重新选举，之后就没换过。 至于你说broker经常掉线， 可以dump一下内存快照，看是不是系统资源耗尽导致的
2021-11-10
共4条回复

Kafka多维度系统精讲，从入门到实战开发

系统讲解Kafka，实战结合，让你成为使用Kafka的高手

889 学习 · 237 问题

查看课程

相似问题

关于维护isr的疑问

回答 2

关于kafka集群和zookeeper集群

回答 2

关于SpringBoot集成Kafka的应用

回答 1

kafka集群部署，kafka地址怎么填

回答 1

关于kafka出站速率的问题

回答 1

打开慕课网App查看更多内容