Linux部署Kafka集群

89 阅读1分钟

Linux部署Kafka集群

准备

可参考链接 www.cnblogs.com/chenwolong/… blog.csdn.net/weixin_4140… 准备三台虚拟机,IP地址分别为:

192.168.217.151

192.168.217.152

192.168.217.153

下载Jdk,Zookeeper和Kafka压缩包

下载地址:

https://kafka.apache.org/downloads

我下载的是3.0版本因为2.8版本之后自带zookeeper所以不用单独下载

image.png

讲kafka传入到三台liunx服务器,放在 /root/software/ 文件夹下

image.png

 4、解压压缩包

tar -xzvf kafka_2.12-3.0.0.tgz

5、重命名解压缩生成的文件夹名称

mv kafka_2.12-3.0.0 kafka

6、在kafka文件夹中新建logs 目录备用 

[root@localhost software]# cd kafka

[root@localhost kafka]# mkdir logs

7、进入kafka 子文件夹config中,修改 server.properties 配置文件

复制代码

[root@localhost kafka]# cd config
[root@localhost config]# ls
connect-console-sink.properties    connect-file-sink.properties    connect-mirror-maker.properties  kraft                server.properties       zookeeper.properties
connect-console-source.properties  connect-file-source.properties  connect-standalone.properties    log4j.properties     tools-log4j.properties
connect-distributed.properties     connect-log4j.properties        consumer.properties              producer.properties  trogdor.conf
[root@localhost config]# vim server.properties

192.168.217.151


listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://192.168.217.151:9092

log.dirs=/usr/local/kafka/kafka/log

# topic 在当前broker上的分片个数,与broker保持一致
num.partitions=3

# 设置zookeeper集群地址与端口如下:
zookeeper.connect=192.168.217.151:2181,192.168.217.152:2181,192.168.217.153:2181

192.1682.17.152


listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://192.168.217.152:9092

log.dirs=/usr/local/kafka/kafka/log

# topic 在当前broker上的分片个数,与broker保持一致
num.partitions=3

# 设置zookeeper集群地址与端口如下:
zookeeper.connect=192.168.217.151:2181,192.168.217.152:2181,192.168.217.153:2181

192.168.217.153


listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://192.168.217.153:9092

log.dirs=/usr/local/kafka/kafka/log

# topic 在当前broker上的分片个数,与broker保持一致
num.partitions=3

# 设置zookeeper集群地址与端口如下:
zookeeper.connect=192.168.217.151:2181,192.168.217.152:2181,192.168.217.153:2181
配置HOSTS文件
192.168.217.151 kafka1 # 工作节点1
192.168.217.152 kafka2 # 工作节点2
192.168.217.153 kafka3 # 工作节点3
EOF