kafka出现WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataR
最新推荐文章于 2023-01-07 17:01:05 发布
sxjlinux
于 2020-04-27 16:26:53 发布
10139
1、当kafka接收数据时会出现如下警告:
2020-04-27 12:27:39,258 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:39,420 (PollableSourceRunner-KafkaSource-s1) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:39,922 (PollableSourceRunner-KafkaSource-s1) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:40,623 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:40,825 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:41,026 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:41,228 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:41,429 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:41,631 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:41,833 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:42,034 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:42,235 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
2020-04-27 12:27:42,437 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(NetworkClient.java:961)] [Consumer clientId=consumer-1, groupId=flume] 7 partitions have leader brokers without a matching listener, including [history_topic_20200420-0, history_topic_20200420-5, history_topic_20200420-8, history_topic_20200420-2, history_topic_20200420-9, history_topic_20200420-6, history_topic_20200420-3]
如下图所示:
2、出现此问题是kafka的server.properties没有配置listeners = PLAINTEXT://your.host.name:9092。在配置集群的时候,必须设置,不然以后的操作会报找不到leader的错误 ,集群中的每个节点都必须配置,如下图所示:
3、然后重启kafka即可。
kafka出现WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataR
1、当kafka接收数据时会出现如下警告:2020-04-27 12:27:39,258 (kafka-coordinator-heartbeat-thread | flume) [WARN - org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleCompletedMetadataResponse(Netwo...
WARN org.apache.kafka.clients.NetworkClient - Bootstrap broker 127.0.0.1:9092 disconnected
[Consumer clientId=consumer-1, groupId=test] Connection to node -1 could not be established. Broker may not be available.
WARN 10176 --- [ad | producer-1] org.apache.kafka.clients.NetworkClie...
赠送jar包:
kafka-
clients-2.4.1.jar;
赠送原API文档:
kafka-
clients-2.4.1-javadoc.jar;
赠送源代码:
kafka-
clients-2.4.1-sources.jar;
赠送Maven依赖信息文件:
kafka-
clients-2.4.1.pom;
包含翻译后的API文档:
kafka-
clients-2.4.1-javadoc-API文档-中文(简体)版.zip;
Maven坐标:
org.
apache.
kafka:
kafka-
clients:2.4.1;
标签:
apache、
kafka、
clients、中文文档、jar包、java;
使用方法:解压翻译后的API文档,用浏览器打开“index.html”文件,即可纵览文档内容。
人性化翻译,文档中的代码和结构保持不变,注释和说明精准翻译,请放心使用。
同事反馈我们的三节点
kafka集群当其中一台服务器宕机后,业务受到影响,无法生产与消费消息。程序报错:
WARN [Consumer
clientId=consumer-1, groupId=console-consumer-55928] 1 partitions have leader brokers without a matching listener, including [baidd-0] (
org.
apache.
kafka.
clients
.NetworkClient)
详细报错信息如下:
[root@kafka1 bin]# ./kafka-console-producer.sh -broker-list kafka1:9092,kafka2:9092,kafka3:9092 -topic test
[2019-04-24 08:52:56,252] WARN Bootstrap broker kafka2:9092 disconnected (org.apa...
2020-08-19 22:55:56.089 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 483 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.205 WARN.
已编译
Kafka-Manager-1.3.3.22
linux下直接解压解压
kafka-manager-1.3.3.22.zip到/opt/module目录
[root@hadoop102 module]$ unzip
kafka-manager-1.3.3.22.zip
4)进入到/opt/module/
kafka-manager-1.3.3.22/conf目录,在application.conf文件中修改
kafka-manager.zkhosts
[root@hadoop102 conf]$ vim application.conf
修改zookeeper地址为:
kafka-manager.zkhosts="hadoop102:2181,hadoop103:2181,hadoop104:2181"
5)启动
KafkaManager
[root@hadoop102
kafka-manager-1.3.3.22]$ nohup bin/
kafka-manager -Dhttp.port=7456 >/opt/module/
kafka-manager-1.3.3.22/start.log 2>&1 &
6)在浏览器中打开
备注:指定端口号看启动过程中 "-Dhttp.port=7456" 端口可以自己设置
http://hadoop102:7456
Kafka 2.xx所有版本下载的百度网盘链接。包括:
kafka_2.11-2.0.0.tgz, kafka_2.11-2.0.1.tgz, kafka_2.11-2.1.0.tgz, kafka_2.11-2.1.1.tgz, kafka_2.11-2.2.0.tgz, kafka_2.11-2.2.1.tgz, kafka_2.11-2.2.2.tgz, kafka_2.11-2.3.0.tgz, kafka_2.11-2.3.1.tgz, kafka_2.11-2.4.0.tgz, kafka_2.11-2.4.1.tgz, kafka_2.12-2.0.0.tgz, kafka_2.12-2.0.1.tgz, kafka_2.12-2.1.0.tgz, kafka_2.12-2.1.1.tgz, kafka_2.12-2.2.0.tgz, kafka_2.12-2.2.1.tgz, kafka_2.12-2.2.2.tgz, kafka_2.12-2.3.0.tgz, kafka_2.12-2.3.1.tgz, kafka_2.12-2.4.0.tgz, kafka_2.12-2.4.1.tgz, kafka_2.12-2.5.0.tgz, kafka_2.13-2.4.0.tgz, kafka_2.13-2.4.1.tgz, kafka_2.13-2.5.0.tgz
赠送jar包:kafka-clients-0.10.0.1.jar;
赠送原API文档:kafka-clients-0.10.0.1-javadoc.jar;
赠送源代码:kafka-clients-0.10.0.1-sources.jar;
包含翻译后的API文档:kafka-clients-0.10.0.1-javadoc-API文档-中文(简体)-英语-对照版.zip
对应Maven信息:groupId:org.apache.kafka,artifactId:kafka-clients,version:0.10.0.1
使用方法:解压翻译后的API文档,用浏览器打开“index.html”文件,即可纵览文档内容。
人性化翻译,文档中的代码和结构保持不变,注释和说明精准翻译,请放心使用。
双语对照,边学技术、边学英语。
2.创建topic test (分区3 副本3)
kafka-topics.sh --create --topic 'test' --zookeeper 'hadoop01:2181,hadoop02:2181,hadoop03:2181' --partitions 3 --replication-factor 3
3.1 生产者生产数据
kafka-console-p
m0_50559824:
mac系统使用idea+sbt运行spark程序
请叫我哈士奇:
CentOS7编译安装thrift工具
周周充满了缺点:
vue中设置当一个model关闭时将model中的组件销毁方法
四次元的lucly:
设置CListCtrl某一行背景颜色
Alexanderrr: