rocketmq应用层: streaming

43 阅读1分钟

概览

rocketmq-streaming 是reocketmq接入流计算生态的重要一环,相比于主流的Flink流计算框架,用户可以基于rocketmq开箱即用,足以应付一些简单的场景了。

concepts

StreamBuilder

StreamBuilder builder = new StreamBuilder("wordCount"); StreamBuilder.pipeline1.pipeline2

TopologyBuilder

TopologyBuilder topologyBuilder = builder.build();

RocketMQStream

Properties properties = new Properties();
properties.put(MixAll.NAMESRV_ADDR_PROPERTY, "127.0.0.1:9876");
RocketMQStream rocketMQStream = new RocketMQStream(topologyBuilder, properties);
rocketMQStream.start();

GraphNode

实现流处理SDK和框架,API设计上非常类似于MapReduce,通过一下几个步骤定义流处理:

  • map: k-v 分片
  • reduce: logic

rsqldb

主要是一个rest服务,通过sql-parser解析用户的sql,转换为streaming,相当于对streaming使用方式的简化。

参考

# RocketMQ Streams Overview