kafka监控插件安装

413 阅读1分钟

1. 安装kafka Monitor

  1. 上传jar包KafkaOffsetMonitor-assembly-0.4.6.jar到集群
  2. 在/opt/software/下创建kafka-offset-console文件夹
  3. 将上传的jar包放入刚创建的目录下
  4. 在/opt/software/kafka-offset-console目录下创建启动脚本start.sh,内容如下:
#!/bin/bash
java -cp KafkaOffsetMonitor-assembly-0.4.6-SNAPSHOT.jar \
com.quantifind.kafka.offsetapp.OffsetGetterWeb \
--offsetStorage kafka \
--kafkaBrokers mayi102:9092,mayi103:9092,mayi101:9092 \
--kafkaSecurityProtocol PLAINTEXT \
--zk mayi102:2181,mayi103:2181,mayi101:2181 \
--port 8086 \
--refresh 10.seconds \
--retain 2.days \
--dbName offsetapp_kafka &
  1. 在/opt/module/kafka-offset-console目录下创建mobile-logs文件夹
mkdir /opt/software/kafka-offset-console/mobile-logs
  1. 启动KafkaMonitor
sh start.sh

7.查看进程,启动之前

[mayi@mayi101 ~]$ sh alljps.sh 
-----------mayi101----------------
4307 Kafka
13318 Jps
3932 QuorumPeerMain
8572 NameNode
9117 NodeManager
8686 DataNode
9006 ResourceManager
-----------mayi102----------------
3409 QuorumPeerMain
4036 DataNode
4262 NodeManager
3783 Kafka
4153 SecondaryNameNode
8271 Jps
-----------mayi103----------------
6384 Jps
3431 QuorumPeerMain
4089 DataNode
5307 Kafka
4237 NodeManager

启动之后

[mayi@mayi101 ~]$ sh alljps.sh 
-----------mayi101----------------
4307 Kafka
3932 QuorumPeerMain
8572 NameNode
13340 OffsetGetterWeb
13356 Jps
9117 NodeManager
8686 DataNode
9006 ResourceManager
-----------mayi102----------------
3409 QuorumPeerMain
4036 DataNode
4262 NodeManager
8294 Jps
3783 Kafka
4153 SecondaryNameNode
-----------mayi103----------------
3431 QuorumPeerMain
6407 Jps
4089 DataNode
5307 Kafka
4237 NodeManager
  1. 登录weui查看
http://mayi101:8086

成功后效果:

2. 安装kafka Manager

  1. 上传压缩包kafka-manager-1.3.3.15.zip到集群
  2. 解压到/opt/software
  3. 修改配置文件conf/application.conf
 kafka-manager.zkhosts="kafka-manager-zookeeper:2181"
 修改为:
 kafka-manager.zkhosts="mayi101:2181,mayi102:2181,mayi103:2181"
  1. 启动kafka-manager
  bin/kafka-manager
  
  #有冲突的时候,可以指定端口开启
 bin/kafka-manager -Dconfig.file=/opt/software/kafka-manager-1.3.3.15/conf/application.conf -Dhttp.port=9090
  1. 登录mayi101:9090页面查看详细信息