Error while executing topic command : replication factor: 3 larger than available brokers: 1
问题描述
bash-4.4# ./kafka-topics.sh --zookeeper 192.168.124.28:2181/kafka --create --topic topic-demo --replication-factor 3 --partitions 4
Error while executing topic command : replication factor: 3 larger than available brokers: 1
[2021-05-27 15:16:09,430] ERROR org.apache.kafka.common.errors.InvalidReplicationFactorException: replication factor: 3 larger than available brokers: 1
(kafka.admin.TopicCommand$)
分析
根据错误信息，可知要创建的topic副本数为3，而brokers为1，表示kafka没有获取到zookeeper中的存储brokers信息。
broker-listrver is not a recognized option
问题描述
bash-4.4# ./kafka-console-producer.sh --broker-listrver localhost:9092 --topic sun
broker-listrver is not a recognized option
解决方案
./kafka-console-producer.sh --broker-list localhost:9092 --topic sun
Broker may not be available
问题描述
./kafka-console-producer.sh --broker-list localhost:9092 --topic sun
[2021-03-31 00:31:29,559] WARN [Producer clientId=console-producer] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
[2021-03-31 00:31:29,654] WARN [Producer clientId=console-producer] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
ZooKeeper audit is disabled
1、基础环境
docker pull zookeeper:3.6
2、问题描述
2021-04-17 14:41:54,783 [myid:1] - INFO [main:ZKAuditProvider@42] - ZooKeeper audit is disabled.
3、网上查询原因
zookeeper新版本启动的过程中，zookeeper新增的审核日志是默认关闭，所以控制台输出ZooKeeper audit is disabled
4、本人解决方案
将镜像版本降低到3.4重新启动容器，启动后zookeeper服务正常运行
docker pull zookeeper:3.4
thompshon@thompshondeMacBook-Pro ~ % docker run -d --name zookeeper -p 2181:2181 -v /etc/localtime:/etc/localtime zookeeper:3.4
Syntax error: "(" unexpected (expecting "fi")
1、基础环境
zookeeper:3.4
2、问题描述
root@9ce28a0fe383:/zookeeper-3.4.14/bin# sh zkServer.sh status
zkServer.sh: 81: /zookeeper-3.4.14/bin/zkEnv.sh: Syntax error: "(" unexpected (expecting "fi")
3、解决方案
root@9ce28a0fe383:/zookeeper-3.4.14/bin# cd /bin
root@9ce28a0fe383:/bin# ls -l /bin/sh
lrwxrwxrwx 1 root root 4 Apr 8 08:00 /bin/sh -> dash
root@9ce28a0fe383:/bin# ln -sf bash /bin/sh
root@9ce28a0fe383:/bin# ls -al /bin/sh
lrwxrwxrwx 1 root root 4 Apr 18 12:04 /bin/sh -> bash
4、重启服务验证
root@9ce28a0fe383:/zookeeper-3.4.14/bin# sh zkServer.sh restart /conf/zoo.cfg
root@9ce28a0fe383:/zookeeper-3.4.14/bin# sh zkCli.sh -server 127.0.0.1:2181
Connecting to 127.0.0.1:2181
2021-04-18 04:07:56,680 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf, built on 03/06/2019 16:18 GMT
2021-04-18 04:07:56,688 [myid:] - INFO [main:Environment@100] - Client environment:host.name=9ce28a0fe383
2021-04-18 04:07:56,689 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.8.0_282
2021-04-18 04:07:56,700 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2021-04-18 04:07:56,701 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/usr/local/openjdk-8
2021-04-18 04:07:56,701 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/zookeeper-3.4.14/bin/../zookeeper-server/target/classes:/zookeeper-3.4.14/bin/../build/classes:/zookeeper-3.4.14/bin/../zookeeper-server/target/lib/*.jar:/zookeeper-3.4.14/bin/../build/lib/*.jar:/zookeeper-3.4.14/bin/../lib/slf4j-log4j12-1.7.25.jar:/zookeeper-3.4.14/bin/../lib/slf4j-api-1.7.25.jar:/zookeeper-3.4.14/bin/../lib/netty-3.10.6.Final.jar:/zookeeper-3.4.14/bin/../lib/log4j-1.2.17.jar:/zookeeper-3.4.14/bin/../lib/jline-0.9.94.jar:/zookeeper-3.4.14/bin/../lib/audience-annotations-0.5.0.jar:/zookeeper-3.4.14/bin/../zookeeper-3.4.14.jar:/zookeeper-3.4.14/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf:
2021-04-18 04:07:56,702 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2021-04-18 04:07:56,702 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2021-04-18 04:07:56,703 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA>
2021-04-18 04:07:56,703 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux
2021-04-18 04:07:56,704 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=amd64
2021-04-18 04:07:56,704 [myid:] - INFO [main:Environment@100] - Client environment:os.version=4.19.121-linuxkit
2021-04-18 04:07:56,705 [myid:] - INFO [main:Environment@100] - Client environment:user.name=root
2021-04-18 04:07:56,705 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/root
2021-04-18 04:07:56,706 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/zookeeper-3.4.14/bin
2021-04-18 04:07:56,710 [myid:] - INFO [main:ZooKeeper@442] - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@5ce65a89
Welcome to ZooKeeper!
2021-04-18 04:07:56,762 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1025] - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2021-04-18 04:07:56,872 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@879] - Socket connection established to localhost/127.0.0.1:2181, initiating session
[zk: 127.0.0.1:2181(CONNECTING) 0] 2021-04-18 04:07:56,947 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1299] - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x10002845bf60000, negotiated timeout = 30000
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
