腾讯云国际站:CVM的Kafka集群部署实战

34 阅读1分钟

1.1 基础环境准备

所有节点执行

yum install -y java-11-openjdk echo "vm.swappiness = 1" >> /etc/sysctl.conf mkdir -p /data/kafka/logs

1.2 Zookeeper集群部署

在3台ZK节点配置zoo.cfg:

tickTime=2000 dataDir=/data/zookeeper clientPort=2181 initLimit=10 syncLimit=5 server.1=10.0.1.11:2888:3888 server.2=10.0.2.12:2888:3888 server.3=10.0.3.13:2888:3888

1.3 Kafka集群配置

关键配置参数优化:

server.properties

broker.id=1 listeners=PLAINTEXT://:9092 advertised.listeners=PLAINTEXT://${公网IP}:9092 log.dirs=/data/kafka/logs zookeeper.connect=10.0.1.11:2181,10.0.2.12:2181,10.0.3.13:2181 num.network.threads=8 num.io.threads=16 socket.send.buffer.bytes=102400 socket.receive.buffer.bytes=102400 socket.request.max.bytes=104857600