1. 安装kafka Monitor
- 上传jar包KafkaOffsetMonitor-assembly-0.4.6.jar到集群
- 在/opt/software/下创建kafka-offset-console文件夹
- 将上传的jar包放入刚创建的目录下
- 在/opt/software/kafka-offset-console目录下创建启动脚本start.sh,内容如下:
#!/bin/bash
java -cp KafkaOffsetMonitor-assembly-0.4.6-SNAPSHOT.jar \
com.quantifind.kafka.offsetapp.OffsetGetterWeb \
--offsetStorage kafka \
--kafkaBrokers mayi102:9092,mayi103:9092,mayi101:9092 \
--kafkaSecurityProtocol PLAINTEXT \
--zk mayi102:2181,mayi103:2181,mayi101:2181 \
--port 8086 \
--refresh 10.seconds \
--retain 2.days \
--dbName offsetapp_kafka &
- 在/opt/module/kafka-offset-console目录下创建mobile-logs文件夹
mkdir /opt/software/kafka-offset-console/mobile-logs
- 启动KafkaMonitor
sh start.sh
7.查看进程,启动之前
[mayi@mayi101 ~]$ sh alljps.sh
-----------mayi101----------------
4307 Kafka
13318 Jps
3932 QuorumPeerMain
8572 NameNode
9117 NodeManager
8686 DataNode
9006 ResourceManager
-----------mayi102----------------
3409 QuorumPeerMain
4036 DataNode
4262 NodeManager
3783 Kafka
4153 SecondaryNameNode
8271 Jps
-----------mayi103----------------
6384 Jps
3431 QuorumPeerMain
4089 DataNode
5307 Kafka
4237 NodeManager
启动之后
[mayi@mayi101 ~]$ sh alljps.sh
-----------mayi101----------------
4307 Kafka
3932 QuorumPeerMain
8572 NameNode
13340 OffsetGetterWeb
13356 Jps
9117 NodeManager
8686 DataNode
9006 ResourceManager
-----------mayi102----------------
3409 QuorumPeerMain
4036 DataNode
4262 NodeManager
8294 Jps
3783 Kafka
4153 SecondaryNameNode
-----------mayi103----------------
3431 QuorumPeerMain
6407 Jps
4089 DataNode
5307 Kafka
4237 NodeManager
- 登录weui查看
http://mayi101:8086
成功后效果:
2. 安装kafka Manager
- 上传压缩包kafka-manager-1.3.3.15.zip到集群
- 解压到/opt/software
- 修改配置文件conf/application.conf
kafka-manager.zkhosts="kafka-manager-zookeeper:2181"
修改为:
kafka-manager.zkhosts="mayi101:2181,mayi102:2181,mayi103:2181"
- 启动kafka-manager
bin/kafka-manager
#有冲突的时候,可以指定端口开启
bin/kafka-manager -Dconfig.file=/opt/software/kafka-manager-1.3.3.15/conf/application.conf -Dhttp.port=9090
- 登录mayi101:9090页面查看详细信息