org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metad
最新推荐文章于 2023-06-02 16:31:12 发布
Monica&Anthony
最新推荐文章于 2023-06-02 16:31:12 发布
2020-08-19 22:55:56.089 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 483 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.205 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 484 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.328 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 485 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.434 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 486 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.552 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 487 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.663 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 488 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.782 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 489 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.891 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 490 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:56.998 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 491 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.106 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 492 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.213 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 493 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.320 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 494 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.427 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 495 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.535 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 496 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.640 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 497 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.745 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 498 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.852 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 499 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:57.956 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 500 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:58.064 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 501 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:58.172 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 502 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:58.278 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 503 : {abc_001=LEADER_NOT_AVAILABLE}
2020-08-19 22:55:58.385 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 504 : {abc_001=LEADER_NOT_AVAILABLE}
修改kafka集群 的 client.id，完后发送消息出现这个问题，解决办法是 登录zookeeper集群,删除brokers
org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metad
2020-08-19 22:55:56.089 WARN [-,,,] 35672 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metadata with correlation id 483 : {abc_001=LEADER_NOT_AVAILABLE}2020-08-19 22:55:56.205 WARN.
在使用 canal 和
kafka
处理数据同步时canal日志提示如下异常：
java
.lang.RuntimeException:
java
.util.concurrent.ExecutionException:
org
.
apache
.
kafka
.common.
error
s.Re
cor
dTooLargeException: The request included a message larger than the max message size the server will accept
原因是消息过大无法处理
第一步：修改 canal/conf/canal.
pro
perties配置
docker run -d --name zookeeper -p 2181:2181 -v /etc/localtime:/etc/localtime -v /root/docker/zookeeper/data/:/data/ zookeeper
kafka
：
docker run -d --name
kafka
-server \
-p 909...
kafka
发送数据报错：
Error
connect
ing
to node xxxxx:9092 (
id
: 1 rack: null)
java
.net
.UnknownHostExceptio
注意版本，不同的版本情况不一样。我以 2 .7 为例
首先配置：config/server.
pro
perties
advertised.listeners: 把注释去掉，在PLAINTEXT://后面放入你的公网ip
如：PLAINTEXT://192.168.0.1：9092
如下异常：
[2021-01-21 10:59:28,658] WARN [
Pro
ducer
client
Id
=console-
pro
ducer
] Connection to
今天在使用
Kafka
生产数据时出现一个错误，具体报错如下
2021-12-29 18:17:50,662] WARN [
Pro
ducer
client
Id
=console-
pro
ducer
]
Error
while
fetch
ing
metadata
with
cor
re
latio
n
id
3 : {first=LEADER_NOT_AVAILABLE} (
org
.
apache
.
kafka
.
client
s
.Net
work
Client
)
这边提供几种思路来解决
第一种：很有可能是网络防火墙的问题，关闭或者
2018-11-10 17:03:06,060] WARN [
Pro
ducer
client
Id
=
pro
ducer
-1] Connection to node -1 could not be established. Broker may not be available. (
org
.
apache
.
kafka
.
client
s
.Net
work
Client
)
[2018-11-10 17:03:06,...
同事在一次spark程序中，通过spark在
kafka
中的topic中写入数据发生报错，错误日志如下:
2021-01-25 19:58:11,794 INFO utils.AppInfoParser:
Kafka
version : 2.0.0-cdh6.1.1
2021-01-25 19:58:11,794 INFO utils.AppInfoParser:
Kafka
commit
Id
: null
2021-01-25 19:58:11,984 INFO codegen.CodeGener
Failed to update
metadata
after 60000 ms
com.alibaba.fastsql.sql.parser.ParserException: syntax
error
,
error
in : 'cur ;
UNKNOWN_TOPIC_OR_PARTITION
INVAL
ID
_TOPIC_EXCE
赠送jar包：
kafka
-
client
s-2.0.0.jar；
赠送原API文档：
kafka
-
client
s-2.0.0-
java
doc.jar；
赠送源代码：
kafka
-
client
s-2.0.0-sources.jar；
赠送Maven依赖信息文件：
kafka
-
client
s-2.0.0.pom；
包含翻译后的API文档：
kafka
-
client
s-2.0.0-
java
doc-API文档-中文(简体)-英语-对照版.zip；
Maven坐标：
org
.
apache
.
kafka
:
kafka
-
client
s:2.0.0；
标签：
apache
、
kafka
、
client
s、中英对照文档、jar包、
java
；
使用方法：解压翻译后的API文档，用浏览器打开“index.html”文件，即可纵览文档内容。
人性化翻译，文档中的代码和结构保持不变，注释和说明精准翻译，请放心使用。
双语对照，边学技术、边学英语。
WARN
org
.
apache
.
kafka
.
client
s
.Net
work
Client
- Bootstrap broker 127.0.0.1:9092 disconnected
1.问题描述
2020-11-10 14:46:50.919 WARN 25567 --- [ad |
pro
ducer
-1]
org
.
apache
.
kafka
.
client
s
.Net
work
Client
: [
Pro
ducer
client
Id
=
pro
ducer
-1]
Error
while
fetch
ing
metadata
with
cor
re
latio
n
id
9 : {sync_service=LEADER_NOT_AVAILABLE}
2020-11-10 14:46:51.035 WA
org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metad
Monica&Anthony:
org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Error while fetching metad
一条小咸鱼儿:
VUE实现文件下载；zip文件也可以下载，干货
Monica&Anthony:
查看kafka的topic数据
ZERO_9966:
数据库锁表原因及解决思路
Monica&Anthony:
