MySQL 学习(14)—— 分布式架构 MyCAT | 8月更文挑战

152 阅读8分钟

这是我参与8月更文挑战的第13天,活动详情查看:8月更文挑战

1. MyCAT 基础架构图

MyCAT 基础架构

2. MyCAT 基本架构准备

2.1 环境准备

  • 两台虚拟机:db01、db02
  • 每台创建四个 mysql 实例:3307、3308、3309、3310

2.2 删除历史环境

pkill mysqld
rm -rf /data/330*
mv /etc/my.cnf /etc/my.cnf.bak

2.3 创建相关目录初始化数据

mkdir /data/33{07..10}/data -p
mysqld --initialize-insecure  --user=mysql --datadir=/data/3307/data --basedir=/app/mysql
mysqld --initialize-insecure  --user=mysql --datadir=/data/3308/data --basedir=/app/mysql
mysqld --initialize-insecure  --user=mysql --datadir=/data/3309/data --basedir=/app/mysql
mysqld --initialize-insecure  --user=mysql --datadir=/data/3310/data --basedir=/app/mysql

2.4 准备 db01 配置文件和启动脚本

cat >/data/3307/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3307/data
socket=/data/3307/mysql.sock
port=3307
log-error=/data/3307/mysql.log
log_bin=/data/3307/mysql-bin
binlog_format=row
skip-name-resolve
server-id=7
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3308/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3308/data
port=3308
socket=/data/3308/mysql.sock
log-error=/data/3308/mysql.log
log_bin=/data/3308/mysql-bin
binlog_format=row
skip-name-resolve
server-id=8
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3309/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3309/data
socket=/data/3309/mysql.sock
port=3309
log-error=/data/3309/mysql.log
log_bin=/data/3309/mysql-bin
binlog_format=row
skip-name-resolve
server-id=9
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3310/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3310/data
socket=/data/3310/mysql.sock
port=3310
log-error=/data/3310/mysql.log
log_bin=/data/3310/mysql-bin
binlog_format=row
skip-name-resolve
server-id=10
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/etc/systemd/system/mysqld3307.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3307/my.cnf
LimitNOFILE = 5000
EOF
cat >/etc/systemd/system/mysqld3308.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3308/my.cnf
LimitNOFILE = 5000
EOF
cat >/etc/systemd/system/mysqld3309.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3309/my.cnf
LimitNOFILE = 5000
EOF
cat >/etc/systemd/system/mysqld3310.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3310/my.cnf
LimitNOFILE = 5000
EOF

2.5 准备 db02 配置文件和启动脚本

cat >/data/3307/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3307/data
socket=/data/3307/mysql.sock
port=3307
log-error=/data/3307/mysql.log
log_bin=/data/3307/mysql-bin
binlog_format=row
skip-name-resolve
server-id=17
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3308/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3308/data
port=3308
socket=/data/3308/mysql.sock
log-error=/data/3308/mysql.log
log_bin=/data/3308/mysql-bin
binlog_format=row
skip-name-resolve
server-id=18
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3309/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3309/data
socket=/data/3309/mysql.sock
port=3309
log-error=/data/3309/mysql.log
log_bin=/data/3309/mysql-bin
binlog_format=row
skip-name-resolve
server-id=19
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3310/my.cnf<<EOF
[mysqld]
basedir=/app/mysql
datadir=/data/3310/data
socket=/data/3310/mysql.sock
port=3310
log-error=/data/3310/mysql.log
log_bin=/data/3310/mysql-bin
binlog_format=row
skip-name-resolve
server-id=20
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/etc/systemd/system/mysqld3307.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3307/my.cnf
LimitNOFILE = 5000
EOF
cat >/etc/systemd/system/mysqld3308.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3308/my.cnf
LimitNOFILE = 5000
EOF
cat >/etc/systemd/system/mysqld3309.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3309/my.cnf
LimitNOFILE = 5000
EOF
cat >/etc/systemd/system/mysqld3310.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target
[Install]
WantedBy=multi-user.target
[Service]
User=mysql
Group=mysql
ExecStart=/app/mysql/bin/mysqld --defaults-file=/data/3310/my.cnf
LimitNOFILE = 5000
EOF

2.6 修改权限,启动多实例

chown -R mysql.mysql /data/*
systemctl start mysqld3307
systemctl start mysqld3308
systemctl start mysqld3309
systemctl start mysqld3310
mysql -S /data/3307/mysql.sock -e "show variables like 'server_id'"
mysql -S /data/3308/mysql.sock -e "show variables like 'server_id'"
mysql -S /data/3309/mysql.sock -e "show variables like 'server_id'"
mysql -S /data/3310/mysql.sock -e "show variables like 'server_id'"

2.7 节点主从规划

  • 箭头指向谁谁是主库

    10.0.0.51:3307 <-----> 10.0.0.52:3307 10.0.0.51:3309 ------> 10.0.0.51:3307 10.0.0.52:3309 ------> 10.0.0.52:3307

    10.0.0.52:3308 <-----> 10.0.0.51:3308 10.0.0.52:3310 -----> 10.0.0.52:3308 10.0.0.51:3310 -----> 10.0.0.51:3308

2.8 分片规划

  • shard1:

    Master:10.0.0.51:3307 slave1:10.0.0.51:3309 Standby Master:10.0.0.52:3307 slave2:10.0.0.52:3309

  • shard2:

    Master:10.0.0.52:3308 slave1:10.0.0.52:3310 Standby Master:10.0.0.51:3308 slave2:10.0.0.51:3310

2.9 开始配置

  • shard1

    • 10.0.0.51:3307 <-----> 10.0.0.52:3307

      • db02

        • mysql -S /data/3307/mysql.sock -e "grant replication slave on *.* to repl@'10.0.0.%' identified by '123';"
        • mysql -S /data/3307/mysql.sock -e "grant all on *.* to root@'10.0.0.%' identified by '123' with grant option;"
      • db01

        • mysql -S /data/3307/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.52', MASTER_PORT=3307, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3307/mysql.sock -e "start slave;"
        • mysql -S /data/3307/mysql.sock -e "show slave status\G"
      • db02

        • mysql -S /data/3307/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.51', MASTER_PORT=3307, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3307/mysql.sock -e "start slave;"
        • mysql -S /data/3307/mysql.sock -e "show slave status\G"
    • 10.0.0.51:3309 ------> 10.0.0.51:3307

      • db01
        • mysql -S /data/3309/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.51', MASTER_PORT=3307, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3309/mysql.sock -e "start slave;"
        • mysql -S /data/3309/mysql.sock -e "show slave status\G"
    • 10.0.0.52:3309 ------> 10.0.0.52:3307

      • db02
        • mysql -S /data/3309/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.52', MASTER_PORT=3307, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3309/mysql.sock -e "start slave;"
        • mysql -S /data/3309/mysql.sock -e "show slave status\G"
  • shard2

    • 10.0.0.52:3308 <-----> 10.0.0.51:3308

      • db01

        • mysql -S /data/3308/mysql.sock -e "grant replication slave on *.* to repl@'10.0.0.%' identified by '123';"
        • mysql -S /data/3308/mysql.sock -e "grant all on *.* to root@'10.0.0.%' identified by '123' with grant option;"
      • db02

        • mysql -S /data/3308/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.51', MASTER_PORT=3308, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3308/mysql.sock -e "start slave;"
        • mysql -S /data/3308/mysql.sock -e "show slave status\G"
      • db01

        • mysql -S /data/3308/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.52', MASTER_PORT=3308, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3308/mysql.sock -e "start slave;"
        • mysql -S /data/3308/mysql.sock -e "show slave status\G"
    • 10.0.0.52:3310 -----> 10.0.0.52:3308

      • db02
        • mysql -S /data/3310/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.52', MASTER_PORT=3308, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3310/mysql.sock -e "start slave;"
        • mysql -S /data/3310/mysql.sock -e "show slave status\G"
    • 10.0.0.51:3310 -----> 10.0.0.51:3308

      • db01
        • mysql -S /data/3310/mysql.sock -e "CHANGE MASTER TO MASTER_HOST='10.0.0.51', MASTER_PORT=3308, MASTER_AUTO_POSITION=1, MASTER_USER='repl', MASTER_PASSWORD='123';"
        • mysql -S /data/3310/mysql.sock -e "start slave;"
        • mysql -S /data/3310/mysql.sock -e "show slave status\G"

2.10 检查主从状态

mysql -S /data/3307/mysql.sock -e "show slave status\G"|grep Yes
mysql -S /data/3308/mysql.sock -e "show slave status\G"|grep Yes
mysql -S /data/3309/mysql.sock -e "show slave status\G"|grep Yes
mysql -S /data/3310/mysql.sock -e "show slave status\G"|grep Yes

注:如果中间出现错误,在每个节点进行执行以下命令

mysql -S /data/3307/mysql.sock -e "stop slave; reset slave all;"
mysql -S /data/3308/mysql.sock -e "stop slave; reset slave all;"
mysql -S /data/3309/mysql.sock -e "stop slave; reset slave all;"
mysql -S /data/3310/mysql.sock -e "stop slave; reset slave all;"

2.11 MySQL 分布式架构介绍

234accaae8fc67e82646030d6480e9a9.png

  1. schema 拆分及业务分库
  2. 垂直拆分-分库分表
  3. 水平拆分-分片

2.12 企业代表产品

  • 360 Atlas-Sharding
  • Alibaba cobar
  • Mycat
  • TDDL
  • Heisenberg
  • Oceanus
  • Vitess
  • OneProxy
  • DRDS

3. 数据库分布式架构方式

3.1 垂直拆分

3.2 水平拆分

  • 范围拆分
  • 取模
  • 枚举
  • hash
  • 时间

4. MyCAT 应用

4.1 主要配置文件介绍

  • rule.xml:分片策略定义
  • schema.xml:主配置文件
  • server.xml:mycat 服务有关
  • log4j2.xml:记录日志有关
  • *.txt:分片策略使用的规则

4.2 用户创建及数据库导入

db01:
mysql -S /data/3307/mysql.sock
grant all on *.* to root@'10.0.0.%' identified by '123';
source /root/world.sql

mysql -S /data/3308/mysql.sock
grant all on *.* to root@'10.0.0.%' identified by '123';
source /root/world.sql

4.3 配置文件介绍

cd /application/mycat/conf
mv schema.xml schema.xml.bak
vim schema.xml
<?xml version="1.0"?>
<!DOCTYPE mycat:schema SYSTEM "schema.dtd">
<mycat:schema xmlns:mycat="http://io.mycat/">
<!-- mycat 逻辑库 -->
<schema name="TESTDB" checkSQLschema="false" sqlMaxLimit="100" dataNode="dn1">
</schema>
    <!-- 数据节点定义 -->
    <dataNode name="dn1" dataHost="localhost1" database= "wordpress" />
    <!-- 后端主机定义 -->
    <dataHost name="localhost1" maxCon="1000" minCon="10" balance="1"  writeType="0" dbType="mysql"  dbDriver="native" switchType="1">
        <heartbeat>select user()</heartbeat>
    <writeHost host="db1" url="10.0.0.51:3307" user="root" password="123">
            <readHost host="db2" url="10.0.0.51:3309" user="root" password="123" />
    </writeHost>
    </dataHost>
</mycat:schema>

4.4 mycat 实现 1 主 1 从读写分离

<?xml version="1.0"?>
<!DOCTYPE mycat:schema SYSTEM "schema.dtd">
<mycat:schema xmlns:mycat="http://io.mycat/">
<!-- mycat 逻辑库 -->
<schema name="TESTDB" checkSQLschema="false" sqlMaxLimit="100" dataNode="dn1">
</schema>
    <!-- 数据节点定义 -->
    <dataNode name="dn1" dataHost="localhost1" database= "wordpress" />
    <!-- 后端主机定义 -->
    <dataHost name="localhost1" maxCon="1000" minCon="10" balance="1"  writeType="0" dbType="mysql"  dbDriver="native" switchType="1">
        <heartbeat>select user()</heartbeat>
    <writeHost host="db1" url="10.0.0.51:3307" user="root" password="123">
            <readHost host="db2" url="10.0.0.51:3309" user="root" password="123" />
    </writeHost>
    </dataHost>
</mycat:schema>

4.5 MyCAT 高可用 + 读写分离

<?xml version="1.0"?>
<!DOCTYPE mycat:schema SYSTEM "schema.dtd">
<mycat:schema xmlns:mycat="http://io.mycat/">
<!-- mycat 逻辑库 -->
<schema name="TESTDB" checkSQLschema="false" sqlMaxLimit="100" dataNode="dn1">
</schema>
    <!-- 数据节点定义 -->
    <dataNode name="dn1" dataHost="localhost1" database= "wordpress" />
    <!-- 后端主机定义 -->
    <dataHost name="localhost1" maxCon="1000" minCon="10" balance="1"  writeType="0" dbType="mysql"  dbDriver="native" switchType="1">
        <heartbeat>select user()</heartbeat>
    <writeHost host="db1" url="10.0.0.51:3307" user="root" password="123">
            <readHost host="db2" url="10.0.0.51:3309" user="root" password="123" />
    </writeHost>
    <writeHost host="db3" url="10.0.0.52:3307" user="root" password="123">
            <readHost host="db4" url="10.0.0.52:3309" user="root" password="123" />
    </writeHost>
    </dataHost>
</mycat:schema>
    <writeHost host="db1" url="10.0.0.51:3307" user="root" password="123">
            <readHost host="db2" url="10.0.0.51:3309" user="root" password="123" />
    </writeHost>
    <writeHost host="db3" url="10.0.0.52:3307" user="root" password="123">
            <readHost host="db4" url="10.0.0.52:3309" user="root" password="123" />

说明:

  • 第一个 write host:10.0.0.51:3307:真正的写节点,负责写操作
  • 第二个 write host:10.0.0.52:3307:准备写节点,负责读操作,当 10.0.0.51:3307 宕掉之后,会切换为真正的写节点。
  • 如果主库宕机,从库不能再继续提供服务。

4.6 配置中属性介绍

balance 属性

负载均衡类型,目前的取值有 3 种:

  1. balance = 0;

    1. 不开启读写分离机制,所有读操作都发送到当前可用的 writeHost 上。
  2. balance = 1;

    1. 全部的 readHost 与 standby writeHost 参与 select 语句的负载均衡,简单的说,当双主双从模式(M1 -> S1,M2 -> S2,并且 M1 与 M2 互为主备),正常情况下,M2,S1,S2 都参与 select 语句的负载均衡。
  3. balance = 2;

    1. 所有读操作都随机的在 writeHost,readHost 上分发

writeType 属性

负载均衡类型,目前的取值有 2 种:

  1. writeType = 0;

    1. 所有写操作发送到配置的第一个 writeHost,第一个挂了切到还生存的第二个 writeHost,重新启动后已切换后的为主,切换记录在配置文件中:dnindex.properties
  2. writeType = 1;

    1. 所有写操作都随机的发送到配置的 writeHost,但不推荐使用

switchType 属性

  • -1:表示不自动切换
  • 1:默认值,自动切换
  • 2:基于 MySQL 主从同步的状态决定是否切换,心跳语句为:show slave status;

datahost 其他配置

<dataHost name="localhost1" maxCon="1000" minCon="10" balance="1"  writeType="0" dbType="mysql"  dbDriver="native" switchType="1">
  • maxCon="1000":最大的并发连接数
  • minCon="10" :mycat 在启动之后,会在后端节点上自动开启的连接线程
  • tempReadHostAvailable="1":这个一主一从时(1 个 writehost,1 个 readhost 时),可以开启这个参数,如果 2 个 writehost,2 个 readhost 时 <heartbeat>select user()</heartbeat> 监测心跳

5. MyCAT 高级应用——分布式解决方案

5.1 垂直分表

mv  schema.xml  schema.xml.ha
vim schema.xml

<?xml version="1.0"?>
<!DOCTYPE mycat:schema SYSTEM "schema.dtd">
<mycat:schema xmlns:mycat="http://io.mycat/">
<schema name="TESTDB" checkSQLschema="false" sqlMaxLimit="100" dataNode="sh1">
        <table name="user" dataNode="sh1"/>
        <table name="order_t" dataNode="sh2"/>
</schema>
    <dataNode name="sh1" dataHost="oldguo1" database= "taobao" />
    <dataNode name="sh2" dataHost="oldguo2" database= "taobao" />
    <dataHost name="oldguo1" maxCon="1000" minCon="10" balance="1"  writeType="0" dbType="mysql"  dbDriver="native" switchType="1">
        <heartbeat>select user()</heartbeat>
    <writeHost host="db1" url="10.0.0.51:3307" user="root" password="123">
            <readHost host="db2" url="10.0.0.51:3309" user="root" password="123" />
    </writeHost>
    <writeHost host="db3" url="10.0.0.52:3307" user="root" password="123">
            <readHost host="db4" url="10.0.0.52:3309" user="root" password="123" />
    </writeHost>
    </dataHost>
    <dataHost name="oldguo2" maxCon="1000" minCon="10" balance="1"  writeType="0" dbType="mysql"  dbDriver="native" switchType="1">
        <heartbeat>select user()</heartbeat>
    <writeHost host="db1" url="10.0.0.51:3308" user="root" password="123">
            <readHost host="db2" url="10.0.0.51:3310" user="root" password="123" />
    </writeHost>
    <writeHost host="db3" url="10.0.0.52:3308" user="root" password="123">
            <readHost host="db4" url="10.0.0.52:3310" user="root" password="123" />
    </writeHost>
    </dataHost>
</mycat:schema>

创建测试库和表:

[root@db01 conf]# mysql -S /data/3307/mysql.sock -e "create database taobao charset utf8;"
[root@db01 conf]# mysql -S /data/3308/mysql.sock -e "create database taobao charset utf8;"
[root@db01 conf]# mysql -S /data/3307/mysql.sock -e "use taobao;create table user(id int,name varchar(20))";
[root@db01 conf]# mysql -S /data/3308/mysql.sock -e "use taobao;create table order_t(id int,name varchar(20))"

重启 mycat:

mycat restart

测试功能:

mysql> insert into user(id, name) values(1,'a'),(2,'b');

5.2 分片(水平拆分)

  • 分片:对于一个大表,比如说 t3 表,进行拆分

    1. 行数非常多,800W
    2. 访问非常频繁
  • 分片的目的是:

    1. 将大数据量进行分布存储
    2. 提供均衡的访问路由
  • 分片策略:

    • 范围 range 800w 1-400w 400w01-800w
    • 取模 mod 取余数
    • 枚举
    • 哈希 hash
    • 时间 流水
  • 优点

    • 优化关联查询
    • 全局表
    • ER 分片

5.2.1 范围分片

image.png

比如说 t3 表:

  1. 行数非常多,2000w(1-1000w:sh1,1000w01-2000w:sh2)
  2. 访问非常频繁,用户访问较离散
mv schema.xml schema.xml.1
vim schema.xml
<schema name="TESTDB" checkSQLschema="false" sqlMaxLimit="100" dataNode="sh1">
        <table name="t3" dataNode="sh1,sh2" rule="auto-sharding-long" />
</schema>
    <dataNode name="sh1" dataHost="oldguo1" database= "taobao" />
    <dataNode name="sh2" dataHost="oldguo2" database= "taobao" />

vim rule.xml
<tableRule name="auto-sharding-long">
                <rule>
                        <columns>id</columns>
                        <algorithm>rang-long</algorithm>
                </rule>
<function name="rang-long"
    class="io.mycat.route.function.AutoPartitionByLong">
    <property name="mapFile">autopartition-long.txt</property>
</function>
vim autopartition-long.txt
0-10=0  ------> 大于 0 小于等于 10 存在 0 分片
10-20=1 ------> 大于 10 小于等于 20 存在 1 分片

创建测试表:

mysql -S /data/3307/mysql.sock -e "use taobao;create table t3 (id int not null primary key auto_increment,name varchar(20) not null);"


mysql -S /data/3308/mysql.sock  -e "use taobao;create table t3 (id int not null primary key auto_increment,name varchar(20) not null);"

测试: 重启mycat

mycat restart
mysql -uroot -p123456 -h 127.0.0.1 -P 8066
insert into t3(id,name) values(1,'a');
insert into t3(id,name) values(2,'b');
insert into t3(id,name) values(3,'c');
insert into t3(id,name) values(4,'d');
insert into t3(id,name) values(11,'aa');
insert into t3(id,name) values(12,'bb');
insert into t3(id,name) values(13,'cc');
insert into t3(id,name) values(14,'dd');

5.2.2 取模分片

取模分片方式:分片键(一个列)与节点数量进行取余,得到余数,将数据写入对应节点

vim schema.xml
<table name="t4" dataNode="sh1,sh2" rule="mod-long" />
vim rule.xml
<property name="count">2</property>
  • 测试环境准备

    • 创建测试表:

      • mysql -S /data/3307/mysql.sock -e "use taobao;create table t4 (id int not null primary key auto_increment,name varchar(20) not null);"
      • mysql -S /data/3308/mysql.sock -e "use taobao;create table t4 (id int not null primary key auto_increment,name varchar(20) not null);"
    • 重启 mycat

      • mycat restart
  • 测试:

    • mysql -uroot -p123456 -h10.0.0.51 -P8066
    • use TESTDB
    • insert into t4(id,name) values(1,'a');
    • insert into t4(id,name) values(2,'b');
    • insert into t4(id,name) values(3,'c');
    • insert into t4(id,name) values(4,'d');
  • 分别登录后端节点查询数据

    • mysql -S /data/3307/mysql.sock

    • use taobao

    • select * from t4;

    • mysql -S /data/3308/mysql.sock

    • use taobao

    • select * from t4;

5.2.3 枚举分片

t5 表

id name telnum
1   bj   1212
2   sh   22222
3   bj   3333
4   sh   44444
5   bj   5555

枚举分片使用 sharding-by-intfile 策略。

vim schema.xml
<table name="t5" dataNode="sh1,sh2" rule="sharding-by-intfile" />
vim rule.xml
<tableRule name="sharding-by-intfile">
<rule> <columns>name</columns>
<algorithm>hash-int</algorithm>
</rule>
</tableRule>

<function name="hash-int" class="org.opencloudb.route.function.PartitionByFileMap">
<property name="mapFile">partition-hash-int.txt</property>
  <!-- 支持字符串枚举 -->
  <property name="type">1</property>
                <property name="defaultNode">0</property>
</function>

partition-hash-int.txt 配置:

这是我参与8月更文挑战的第13天,活动详情查看:8月更文挑战

bj=0
sh=1
DEFAULT_NODE=1

columns 标识将要分片的表字段,algorithm 分片函数, 其中分片函数配置中,mapFile标识配置文件名称

  • 准备测试环境

    • mysql -S /data/3307/mysql.sock -e "use taobao;create table t5 (id int not null primary key auto_increment,name varchar(20) not null);"
    • mysql -S /data/3308/mysql.sock -e "use taobao;create table t5 (id int not null primary key auto_increment,name varchar(20) not null);"
  • 重启 MyCAT

    • mycat restart
    • mysql -uroot -p123456 -h10.0.0.51 -P8066
    • use TESTDB
    • insert into t5(id,name) values(1,'bj');
    • insert into t5(id,name) values(2,'sh');
    • insert into t5(id,name) values(3,'bj');
    • insert into t5(id,name) values(4,'sh');
    • insert into t5(id,name) values(5,'tj');