Linux部署Kafka集群
准备
可参考链接 www.cnblogs.com/chenwolong/… blog.csdn.net/weixin_4140… 准备三台虚拟机,IP地址分别为:
192.168.217.151
192.168.217.152
192.168.217.153
下载Jdk,Zookeeper和Kafka压缩包
下载地址:
https://kafka.apache.org/downloads
我下载的是3.0版本因为2.8版本之后自带zookeeper所以不用单独下载
讲kafka传入到三台liunx服务器,放在 /root/software/ 文件夹下
4、解压压缩包
tar -xzvf kafka_2.12-3.0.0.tgz
5、重命名解压缩生成的文件夹名称
mv kafka_2.12-3.0.0 kafka
6、在kafka文件夹中新建logs 目录备用
[root@localhost software]# cd kafka
[root@localhost kafka]# mkdir logs
7、进入kafka 子文件夹config中,修改 server.properties 配置文件
[root@localhost kafka]# cd config
[root@localhost config]# ls
connect-console-sink.properties connect-file-sink.properties connect-mirror-maker.properties kraft server.properties zookeeper.properties
connect-console-source.properties connect-file-source.properties connect-standalone.properties log4j.properties tools-log4j.properties
connect-distributed.properties connect-log4j.properties consumer.properties producer.properties trogdor.conf
[root@localhost config]# vim server.properties
192.168.217.151
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://192.168.217.151:9092
log.dirs=/usr/local/kafka/kafka/log
# topic 在当前broker上的分片个数,与broker保持一致
num.partitions=3
# 设置zookeeper集群地址与端口如下:
zookeeper.connect=192.168.217.151:2181,192.168.217.152:2181,192.168.217.153:2181
192.1682.17.152
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://192.168.217.152:9092
log.dirs=/usr/local/kafka/kafka/log
# topic 在当前broker上的分片个数,与broker保持一致
num.partitions=3
# 设置zookeeper集群地址与端口如下:
zookeeper.connect=192.168.217.151:2181,192.168.217.152:2181,192.168.217.153:2181
192.168.217.153
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://192.168.217.153:9092
log.dirs=/usr/local/kafka/kafka/log
# topic 在当前broker上的分片个数,与broker保持一致
num.partitions=3
# 设置zookeeper集群地址与端口如下:
zookeeper.connect=192.168.217.151:2181,192.168.217.152:2181,192.168.217.153:2181
配置HOSTS文件
192.168.217.151 kafka1 # 工作节点1
192.168.217.152 kafka2 # 工作节点2
192.168.217.153 kafka3 # 工作节点3
EOF