这是我参与8月更文挑战的第13天，活动详情查看：8月更文挑战
安装rocketMq
安装namesrv
拉取镜像
docker pull rocketmqinc/rocketmq
启动容器 首先创建目录用于存放日志文件等 /usr/local/mq/data/namesrv/logs
/usr/local/mq/data/namesrv/store
启动容器:
docker run -d -p 9876:9876 -v /usr/local/mq/data/namesrv/logs:/root/logs -v /usr/local/mq/data/namesrv/store:/root/store --name rmqnamesrv -e "MAX_POSSIBLE_HEAP=100000000" 09bbc30a03b6 sh mqnamesrv
安装broker
创建配置文件
在/usr/local/mq/conf中创建broker.conf
brokerClusterName=DefaultCluster
brokerName = broker-a
brokerId = 0
deleteWhen = 04
fileReservedTime = 48
brokerRole = ASYNC_MASTER
flushDiskType = ASYNC_FLUSH
brokerIP1=外网地址，如果是阿里云服务器则是公网地址
启动容器
docker run -d -p 10911:10911 -p 10909:10909 -v /usr/local/mq/data/broker/logs:/root/logs -v /usr/local/mq/data/broker/store:/root/store -v /usr/local/mq/conf/broker.conf:/opt/rocketmq-4.4.0/conf/broker.conf --name rmqbroker --link rmqnamesrv:namesrv -e "NAMESRV_ADDR=namesrv:9876" -e "MAX_POSSIBLE_HEAP=200000000" 09bbc30a03b6 sh mqbroker -c /opt/rocketmq-4.4.0/conf/broker.conf
安装rocket-console
拉取镜像
docker pull styletang/rocketmq-console-ng
运行镜像
docker run -e "JAVA_OPTS=-Drocketmq.namesrv.addr=namesrv:9876 -Dcom.rocketmq.sendMessageWithVIPChannel=false" -p 8080:8080 -t 7df83bb6e638
暴露端口:9876、8080
使用compose一键安装并启动配置
安装docker-compose插件 安装:
curl -L https://get.daocloud.io/docker/compose/releases/download/1.25.0/docker-compose-`uname -s`-`uname -m` > /usr/local/bin/docker-compose
验证:
sudo chmod +x /usr/local/bin/docker-compose
docker-compose --version
创建compose文件与配置文件
mkdir /usr/local/docker/rocketmq
cd /usr/local/docker/rocketmq
vim docker-compose.yml
docker-compose.yml文件内容为
version: '3.5'
services:
rmqnamesrv:
image: foxiswho/rocketmq:server
container_name: rmqnamesrv
ports:
- 9876:9876
volumes:
- ./data/logs:/opt/logs
- ./data/store:/opt/store
networks:
rmq:
aliases:
- rmqnamesrv
rmqbroker:
image: foxiswho/rocketmq:broker
container_name: rmqbroker
ports:
- 10909:10909
- 10911:10911
volumes:
- ./data/logs:/opt/logs
- ./data/store:/opt/store
- ./data/brokerconf/broker.conf:/etc/rocketmq/broker.conf
environment:
NAMESRV_ADDR: "rmqnamesrv:9876"
JAVA_OPTS: " -Duser.home=/opt"
JAVA_OPT_EXT: "-server -Xms128m -Xmx128m -Xmn128m"
command: mqbroker -c /etc/rocketmq/broker.conf
depends_on:
- rmqnamesrv
networks:
rmq:
aliases:
- rmqbroker
rmqconsole:
image: styletang/rocketmq-console-ng
container_name: rmqconsole
ports:
- 8080:8080
environment:
JAVA_OPTS: "-Drocketmq.namesrv.addr=rmqnamesrv:9876 -Dcom.rocketmq.sendMessageWithVIPChannel=false"
depends_on:
- rmqnamesrv
networks:
rmq:
aliases:
- rmqconsole
networks:
rmq:
name: rmq
driver: bridge
创建配置文件
mkdir data/brokerconf
cd data/brokerconf
vim broker.conf
broker.conf文件内容为: 注意修改其中的ip地址(公网ip)
# 所属集群名字
brokerClusterName=DefaultCluster
# broker 名字，注意此处不同的配置文件填写的不一样，如果在 broker-a.properties 使用: broker-a,
# 在 broker-b.properties 使用: broker-b
brokerName=broker-a
# 0 表示 Master，> 0 表示 Slave
brokerId=0
# nameServer地址，分号分割
# namesrvAddr=rocketmq-nameserver1:9876;rocketmq-nameserver2:9876
# 启动IP,如果 docker 报 com.alibaba.rocketmq.remoting.exception.RemotingConnectException: connect to <192.168.0.120:10909> failed
# 解决方式1 加上一句 producer.setVipChannelEnabled(false);，解决方式2 brokerIP1 设置宿主机IP，不要使用docker 内部IP
brokerIP1=192.168.0.253（你自己宿主机的IP，请参考自己）
# 在发送消息时，自动创建服务器不存在的topic，默认创建的队列数
defaultTopicQueueNums=4
# 是否允许 Broker 自动创建 Topic，建议线下开启，线上关闭 ！！！这里仔细看是 false，false，false
autoCreateTopicEnable=true
# 是否允许 Broker 自动创建订阅组，建议线下开启，线上关闭
autoCreateSubscriptionGroup=true
# Broker 对外服务的监听端口
listenPort=10911
# 删除文件时间点，默认凌晨4点
deleteWhen=04
# 文件保留时间，默认48小时
fileReservedTime=120
# commitLog 每个文件的大小默认1G
mapedFileSizeCommitLog=1073741824
# ConsumeQueue 每个文件默认存 30W 条，根据业务情况调整
mapedFileSizeConsumeQueue=300000
# destroyMapedFileIntervalForcibly=120000
# redeleteHangedFileInterval=120000
# 检测物理文件磁盘空间
diskMaxUsedSpaceRatio=88
# 存储路径
# storePathRootDir=/home/ztztdata/rocketmq-all-4.1.0-incubating/store
# commitLog 存储路径
# storePathCommitLog=/home/ztztdata/rocketmq-all-4.1.0-incubating/store/commitlog
# 消费队列存储
# storePathConsumeQueue=/home/ztztdata/rocketmq-all-4.1.0-incubating/store/consumequeue
# 消息索引存储路径
# storePathIndex=/home/ztztdata/rocketmq-all-4.1.0-incubating/store/index
# checkpoint 文件存储路径
# storeCheckpoint=/home/ztztdata/rocketmq-all-4.1.0-incubating/store/checkpoint
# abort 文件存储路径
# abortFile=/home/ztztdata/rocketmq-all-4.1.0-incubating/store/abort
# 限制的消息大小
maxMessageSize=65536
# flushCommitLogLeastPages=4
# flushConsumeQueueLeastPages=2
# flushCommitLogThoroughInterval=10000
# flushConsumeQueueThoroughInterval=60000
# Broker 的角色
# - ASYNC_MASTER 异步复制Master
# - SYNC_MASTER 同步双写Master
# - SLAVE
brokerRole=ASYNC_MASTER
# 刷盘方式
# - ASYNC_FLUSH 异步刷盘
# - SYNC_FLUSH 同步刷盘
flushDiskType=ASYNC_FLUSH
# 发消息线程池数量
# sendMessageThreadPoolNums=128
# 拉消息线程池数量
# pullMessageThreadPoolNums=128
执行docker-compose
docker-compose up -d
Java程序验证rocketMq安装成功
SpringBoot+rocketMq整合测试
创建项目
增加依赖
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
</dependency>
<dependency>
<groupId>org.apache.rocketmq</groupId>
<artifactId>rocketmq-spring-boot-starter</artifactId>
<version>2.1.0</version>
</dependency>
配置文件
rocketmq.name_server= 39.106.167.82:9876
rocketmq.producer.group= test_group
创建生产者
package cn.coderymy.demoproject.mq;
/**
* @ClassName Producer
* @Desc TODO
* @Author YangMingYu
* @Date 2021/7/9 10:21 上午
* @Version 1.0
**/
@Component
public class RocketmqProducer {
@Autowired
private RocketMQTemplate rocketMQTemplate;
public void sendMessage(String topic, String message) {
rocketMQTemplate.asyncSend(topic, message, new SendCallback() {
@Override
public void onSuccess(SendResult sendResult) {
System.out.println("topic:" + topic + ",生产者推送成功。推送报文:[" + message + "]");
}
@Override
public void onException(Throwable throwable) {
System.out.println("topic:" + topic + ",生产者推送失败。推送报文:[" + message + "]");
}
});
}
}
创建消费者
package cn.coderymy.demoproject.mq;
import java.util.List;
/**
* @ClassName RocketMqComsumer
* @Desc TODO
* @Author YangMingYu
* @Date 2021/7/9 10:22 上午
* @Version 1.0
**/
@Component
@RocketMQMessageListener(
topic = "test_topic",
consumerGroup = "test_group",
messageModel = MessageModel.CLUSTERING,
nameServer = "${rocketmq.name_server}"
)
public class RocketMqComsumer implements RocketMQListener<String>, RocketMQPushConsumerLifecycleListener {
@Override
public void onMessage(String message) {
System.out.println("队列" + "test_topic" + "获取到的数据为" + message);
}
@Override
public void prepareStart(DefaultMQPushConsumer defaultMQPushConsumer) {
defaultMQPushConsumer.registerMessageListener(new MessageListenerConcurrently() {
@Override
public ConsumeConcurrentlyStatus consumeMessage(List<MessageExt> list, ConsumeConcurrentlyContext consumeConcurrentlyContext) {
try {
for (MessageExt msg : list) {
String msgbody = new String(msg.getBody(), "utf-8");
onMessage(msgbody);
System.out.println("【消费消息】 次数：" + msg.getReconsumeTimes() + ", ext ：" + msgbody);
}
} catch (Exception e) {
e.printStackTrace();
if (list.get(0).getReconsumeTimes() == 4) {
//记录日志
return ConsumeConcurrentlyStatus.CONSUME_SUCCESS;// 成功
} else {
return ConsumeConcurrentlyStatus.RECONSUME_LATER;// 重试
}
}
return ConsumeConcurrentlyStatus.CONSUME_SUCCESS;// 成功
}
});
}
}
创建生产动作接口
package cn.coderymy.demoproject.controller;
/**
* @ClassName MqController
* @Desc TODO
* @Author YangMingYu
* @Date 2021/7/9 10:29 上午
* @Version 1.0
**/
@RequestMapping(value = "mq")
@RestController
public class MqController {
@Autowired
private RocketmqProducer rocketmqProducer;
@RequestMapping(value = "producer")
public void sendMsg() {
rocketmqProducer.sendMessage("test_topic", "我爱吃蛋炒饭");
}
}
测试验证
启动项目,调用接口即可验证结果
- 生产者生产成功
- 消费者消费成功
备注:
学习引用至两位大佬:
欢迎原站学习
