概览
rocketmq-streaming 是reocketmq接入流计算生态的重要一环,相比于主流的Flink流计算框架,用户可以基于rocketmq开箱即用,足以应付一些简单的场景了。
concepts
StreamBuilder
StreamBuilder builder = new StreamBuilder("wordCount"); StreamBuilder.pipeline1.pipeline2
TopologyBuilder
TopologyBuilder topologyBuilder = builder.build();
RocketMQStream
Properties properties = new Properties();
properties.put(MixAll.NAMESRV_ADDR_PROPERTY, "127.0.0.1:9876");
RocketMQStream rocketMQStream = new RocketMQStream(topologyBuilder, properties);
rocketMQStream.start();
GraphNode
实现流处理SDK和框架,API设计上非常类似于MapReduce,通过一下几个步骤定义流处理:
- map: k-v 分片
- reduce: logic
rsqldb
主要是一个rest服务,通过sql-parser解析用户的sql,转换为streaming,相当于对streaming使用方式的简化。