kafka集群同步partition报错

来源:10-5 Kafka副本集-2

水桶一号

2021-12-17

老师,按照您的操作,部署了两个kafka节点分别启动都没有问题,当在客户端执行adminAPI创建了topic后,第一个kafka服务窗口报如下错误,而且是每个几秒钟就出一次,查了好多是在是找不出原因来

/**
 * 创建Topic
 */
public static void createTopic() {
    // 获取客户端实例
    AdminClient adminClient = adminClient();

    // 副本因子(个数)
    Short rs = 2;

    NewTopic newTopic = new NewTopic("jytopic", 2, rs);
    CreateTopicsResult topics = adminClient.createTopics(Arrays.asList(newTopic));
    log.info("topics:[{}]", topics);

    adminClient.close();
}
[2021-12-17 11:39:48,281] INFO [Partition jytopic-0 broker=0] ISR updated to [0] and zkVersion updated to [1] (kafka.cluster.Partition)
[2021-12-17 11:40:05,289] INFO [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error sending fetch request (sessionId=INVALID, epoch=INITIAL) to node 1: {}. (org.apache.kafka.clients.FetchSessionHandler)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
	at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:103)
	at kafka.server.ReplicaFetcherThread.fetchFromLeader(ReplicaFetcherThread.scala:196)
	at kafka.server.AbstractFetcherThread.kafka$server$AbstractFetcherThread$$processFetchRequest(AbstractFetcherThread.scala:286)
	at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:133)
	at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:132)
	at scala.Option.foreach(Option.scala:257)
	at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:132)
	at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:114)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
[2021-12-17 11:40:05,290] WARN [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=0, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={jytopic-1=(fetchOffset=0, logStartOffset=0, maxBytes=1048576, currentLeaderEpoch=Optional[0])}, isolationLevel=READ_UNCOMMITTED, toForget=, metadata=(sessionId=INVALID, epoch=INITIAL), rackId=) (kafka.server.ReplicaFetcherThread)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
	at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:103)
	at kafka.server.ReplicaFetcherThread.fetchFromLeader(ReplicaFetcherThread.scala:196)
	at kafka.server.AbstractFetcherThread.kafka$server$AbstractFetcherThread$$processFetchRequest(AbstractFetcherThread.scala:286)
	at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:133)
	at kafka.server.AbstractFetcherThread$$anonfun$maybeFetch$1.apply(AbstractFetcherThread.scala:132)
	at scala.Option.foreach(Option.scala:257)
	at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:132)
	at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:114)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)
写回答

1回答

水桶一号

提问者

2021-12-17

问题原因找到了,是因为与服务器忘了把9093加到安全组里面,导致网络不通,之前加过9002,学这章集群的时候把这茬给忘了

0
1
Allen
哈哈, 这样是不是会记录的深刻一些,加油
2021-12-18
共1条回复

Kafka多维度系统精讲,从入门到实战开发

系统讲解Kafka,实战结合,让你成为使用Kafka的高手

896 学习 · 237 问题

查看课程