关键字：
KFS， Tungsten Replicator
Tungsten Replicator概述
Tungsten Replicator™ is a replication engine supporting a variety of different extractor and applier modules. Data can be extracted from MySQL, Amazon RDS MySQL, Amazon Aurora and Google Cloud SQL, and applied to a variety of transactional stores, NoSQL stores and datawarehouse stores.
During replication, Tungsten Replicator assigns data a unique global transaction ID, and enables flexible statement and/or row-based replication of data. This enables data to be exchanged between different databases and different database versions. During replication, information can be filtered and modified, and deployment can be between on-premise or cloud-based databases. For performance, Tungsten Replicator™ provides support for parallel replication, and advanced topologies such as fan-in, star and multi-master, and can be used efficiently in cross-site deployments.
过滤器
Tungsten Replicator一共有5个阶段：
| 阶段 | Extractor | Applier |
|---|---|---|
| Dbms to q | Y | N |
| Q to thl | Y | N |
| Remote to thl | N | Y |
| Thl to q | N | Y |
| Q to dbms | N | Y |
| 源端数据抽取 | Y | N |
| 目标端HTL数据抽取 | N | Y |
| 数据落库 | N | Y |
| 发送THL | Y | Y |
在五个阶段的每一个阶段都可以添加过滤器，对应不同的作用
| 端 | 阶段 | 作用 | 建议过滤器 |
|---|---|---|---|
| 源 | Dbms to q | 在抽取时修改数据 | 修改原始数据的过滤器，例如表名、主键名 |
| 源端 | Q to thl | 在数据被转换为THL之前修改数据 | 过滤数据，必须在确保表或者数据不会在目标端被需要的情况下进行过滤 |
| 目标 | Remote to thl | 在从网络下载THL到磁盘之前进行过滤 | 删除模式、表，列 |
| 目标 | Thl to q | 在进入到落库阶段之前进行过滤 | 修改THL的结构，列入重新划分HTL岁票来进行并行入库 |
| 目标 | Q to dbms | 只影响写入数据库的数据 | 着重修改目标端数据库环境，例如格式、编码 |
参考资料
Tungsten Replicator 7.0 Manual
