【碎碎念】CentOS 7.6 -- Kafka集群安装

开启掘金成长之旅！这是我参与「掘金日新计划 · 12 月更文挑战」的第5天，点击查看活动详情

前言

下载安装包

Kafka安装包可以直接去官网下载，也可以通过如下链接进行下载

下载kafka的tar包：

kafka.apache.org/downloads

• 或者如下：

wget https://downloads.apache.org/kafka/3.3.1/kafka_2.13-3.3.1.tgz

• 下载之后的压缩包如下：

kafka_2.13-3.3.1.tgz

• 解压缩文件夹：

mv kafka_2.13-3.3.1.tgz /root
cd /root
tar -xzf kafka_2.13-3.3.1.tgz
cd kafka_2.13-3.3.1/

首先启动zookeeper

./zookeeper-server-start.sh ../config/zookeeper.properties &

• 确保服务正常运行

netstat -ntlp | grep 2181

查看服务端口是否正常启动

发现端口正常运行。

配置节点1

broker.id=0
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/tmp/kafka-logs
num.partitions=1
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.retention.hours=168
log.retention.check.interval.ms=300000
zookeeper.connect=172.28.160.76:2181,172.28.160.77:2181,172.28.160.78:2181
zookeeper.connection.timeout.ms=18000
group.initial.rebalance.delay.ms=0
host.name=172.28.160.76

配置节点2

broker.id=1
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/tmp/kafka-logs
num.partitions=1
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.retention.hours=168
log.retention.check.interval.ms=300000
zookeeper.connect=172.28.160.76:2181,172.28.160.77:2181,172.28.160.78:2181
zookeeper.connection.timeout.ms=18000
group.initial.rebalance.delay.ms=0
host.name=172.28.160.77

配置节点3

broker.id=2
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
log.dirs=/tmp/kafka-logs
num.partitions=1
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.retention.hours=168
log.retention.check.interval.ms=300000
zookeeper.connect=172.28.160.76:2181,172.28.160.77:2181,172.28.160.78:2181
zookeeper.connection.timeout.ms=18000
group.initial.rebalance.delay.ms=0
host.name=172.28.160.78

启动Kakfa服务

cd bin
./kafka-server-start.sh ../config/server.properties &

启动成功，没有报错，kakfa集群部署完毕