kafka集群同步partition报错
来源:10-5 Kafka副本集-2

水桶一号
2021-12-17
老师,按照您的操作,部署了两个kafka节点分别启动都没有问题,当在客户端执行adminAPI创建了topic后,第一个kafka服务窗口报如下错误,而且是每个几秒钟就出一次,查了好多是在是找不出原因来
/**
* 创建Topic
*/
public static void createTopic() {
// 获取客户端实例
AdminClient adminClient = adminClient();
// 副本因子(个数)
Short rs = 2;
NewTopic newTopic = new NewTopic("jytopic", 2, rs);
CreateTopicsResult topics = adminClient.createTopics(Arrays.asList(newTopic));
log.info("topics:[{}]", topics);
adminClient.close();
}
[2021-12-17 11:39:48,281] INFO [Partition jytopic-0 broker=0] ISR updated to [0] and zkVersion updated to [1] (kafka.cluster.Partition)
[2021-12-17 11:40:05,289] INFO [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 1: {}. (org.apache.kafka.clients.FetchSessionHandler)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:103)
at kafka.server.ReplicaFetcherThread.fetchFromLeader(ReplicaFetcherThread.scala:196)
at kafka.server.AbstractFetcherThread.kafka$server$AbstractFetcherThread$$processFetchRequest(AbstractFetcherThread.scala:286)
at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:133)
at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:132)
at scala.Option.foreach(Option.scala:257)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:132)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:114)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
[2021-12-17 11:40:05,290] WARN [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=0, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={jytopic-1=(fetchOffset=0, logStartOffset=0, maxBytes=1048576, currentLeaderEpoch=Optional[0])}, isolationLevel=READ_UNCOMMITTED, toForget=, metadata=(sessionId=INVALID, epoch=INITIAL), rackId=) (kafka.server.ReplicaFetcherThread)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:103)
at kafka.server.ReplicaFetcherThread.fetchFromLeader(ReplicaFetcherThread.scala:196)
at kafka.server.AbstractFetcherThread.kafka$server$AbstractFetcherThread$$processFetchRequest(AbstractFetcherThread.scala:286)
at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:133)
at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:132)
at scala.Option.foreach(Option.scala:257)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:132)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:114)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
写回答
1回答
-
水桶一号
提问者
2021-12-17
问题原因找到了,是因为与服务器忘了把9093加到安全组里面,导致网络不通,之前加过9002,学这章集群的时候把这茬给忘了
012021-12-18
相似问题