1.1 基础环境准备
所有节点执行
yum install -y java-11-openjdk echo "vm.swappiness = 1" >> /etc/sysctl.conf mkdir -p /data/kafka/logs
1.2 Zookeeper集群部署
在3台ZK节点配置zoo.cfg:
tickTime=2000 dataDir=/data/zookeeper clientPort=2181 initLimit=10 syncLimit=5 server.1=10.0.1.11:2888:3888 server.2=10.0.2.12:2888:3888 server.3=10.0.3.13:2888:3888
1.3 Kafka集群配置
关键配置参数优化:
server.properties
broker.id=1 listeners=PLAINTEXT://:9092 advertised.listeners=PLAINTEXT://${公网IP}:9092 log.dirs=/data/kafka/logs zookeeper.connect=10.0.1.11:2181,10.0.2.12:2181,10.0.3.13:2181 num.network.threads=8 num.io.threads=16 socket.send.buffer.bytes=102400 socket.receive.buffer.bytes=102400 socket.request.max.bytes=104857600