之前在k8s集群中部署了zk集群 juejin.cn/post/729714…
机器规划
172.31.7.101 master01 k8s-master1.magedu.net es-node1 kibna01
172.31.7.102 master02 k8s-master2.magedu.net es-node2
172.31.7.103 master03 k8s-master3.magedu.net es-node3
172.31.7.104 harbor01 k8s-harbor1.magedu.net harbor.linuxarchitect.io harbor.linuxarchitect.io
172.31.7.105 harbor02 k8s-harbor2.magedu.net
172.31.7.111 node01 k8s-node1.magedu.net
172.31.7.112 node02 k8s-node2.magedu.net
172.31.7.113 node03 k8s-node3.magedu.net
master01 master02 master03 部署kafka集群
安装jdk
apt install openjdk-8-jre-headless
安装kafka
https://archive.apache.org/dist/kafka/3.2.1/kafka_2.13-3.2.1.tgz
scp kafka_2.13-3.2.1.tgz master02:/apps/
scp kafka_2.13-3.2.1.tgz master03:/apps/
cd /apps;
tar -xf kafka_2.13-3.2.1.tgz
cd /apps/kafka_2.13-3.2.1
mkdir -p /data/kafka-logs
master01节点的配置 vim /apps/kafka_2.13-3.2.1/config/server.properties
broker.id=101
advertised.listeners=PLAINTEXT://172.31.7.101:9092
log.dirs=/data/kafka-logs
zookeeper.connect=172.31.7.101:32181,172.31.7.102:32182,172.31.7.103:32183
master02节点的配置 vim /apps/kafka_2.13-3.2.1/config/server.properties
broker.id=102
advertised.listeners=PLAINTEXT://172.31.7.102:9092
log.dirs=/data/kafka-logs
zookeeper.connect=172.31.7.101:32181,172.31.7.102:32182,172.31.7.103:32183
master03节点的配置 vim /apps/kafka_2.13-3.2.1/config/server.properties
broker.id=103
advertised.listeners=PLAINTEXT://172.31.7.103:9092
log.dirs=/data/kafka-logs
zookeeper.connect=172.31.7.101:32181,172.31.7.102:32182,172.31.7.103:32183
/apps/kafka_2.13-3.2.1/bin/kafka-server-start.sh -daemon /apps/kafka_2.13-3.2.1/config/server.properties
日志在/apps/kafka_2.13-3.2.1/logs
cd /apps/kafka_2.13-3.2.1;
./bin/kafka-topics.sh --create --topic quickstart-events --bootstrap-server localhost:9092
./bin/kafka-topics.sh --describe --topic quickstart-events --bootstrap-server localhost:9092
