[Docker]使用Docker部署常见的中间件

968 阅读10分钟

image.png

本篇文章给大家介绍如何使用 Docker 部署在企业工作中常用的中间件服务。

Nginx

docker run -d \
    -p 80:80 --name nginx-server-conf \
    -v /opt/nginx-server-conf:/usr/share/nginx/html:ro \
    -v /opt/nginxcon/nginx.conf:/etc/nginx/nginx.conf:ro \
    nginx

设置宿主机 80 端口和容器的 80 端口映射,以及数据卷目录挂载与容器的配置文件所在目录映射。一个是 Nginx 的主页还有一个是服务器配置文件。

Tomat

docker run -d -p 8080:8080 \
    -v /opt/tomcat-server:/usr/local/tomcat/webapps/ROOT \
    tomcat:9.0

设置宿主机端口 8080 端口和容器 8080 端口映射,访问宿主机 IP 地址加上 8080 端口就可以查看 Tomcat 主页。

-v 参数设置的是 Tomcat 容器的 webapps 和宿主机的目录映射关系,在宿主机的目录下添加 war 包就可以正常访问你开发的 web app 了。

MySQL

单机部署

MySQL 长期支持版本有 5.7 和 8.0,这里演示的是 5.7。

docker run -d -p 3306:3306 \
    --name mysql \
    -v /opt/mysql/log:/var/log/mysql \
    -v /opt/mysql/data:/var/lib/mysql \
    -v /opt/mysql/conf:/etc/mysql \
    -e MYSQL_ROOT_PASSWORD=root \
    mysql:5.7

使用 docker-compose 部署:

version: '3.8'

services:
  mysql:
    image: mysql
    container_name: mysql
    ports:
      - "3306:3306"
    environment:
      MYSQL_ROOT_PASSWORD: root1234
      TZ: "Asia/Shanghai"  # 设置容器的时区为上海
    volumes:
      - mysql_data:/var/lib/mysql

volumes:
  mysql_data:

若要使用 MySQL 内置的客户端访问,输入以下命令:

docker exec -it mysql mysql -uroot -proot
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 4
Server version: 5.7.37 MySQL Community Server (GPL)

Copyright (c) 2000, 2022, Oracle and/or its affiliates.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql>

还可以通过在 docker host 上访问:

# yum -y install mariadb

# mysql -h 192.168.255.157 -uroot -proot -P 3306

Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 7
Server version: 5.7.37 MySQL Community Server (GPL)

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MySQL [(none)]> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
| sys                |
+--------------------+
4 rows in set (0.00 sec)

主从复制集群部署

部署主节点

docker run -d -p 3306:3306 \
    --name mysql-master \
    -v /opt/mysql-master/log:/var/log/mysql \
    -v /opt/mysql-master/data:/var/lib/mysql \
    -v /opt/mysql-master/conf:/etc/mysql \
    -e MYSQL_ROOT_PASSWORD=root \
    mysql:5.7

配置主节点

# vim /opt/mysql-master/conf/my.cnf
# cat /opt/mysql-master/conf/my.cnf
[client]
default-character-set=utf8

[mysql]
default-character-set=utf8

[mysqld]
init_connect='SET collation_connection = utf8_unicode_ci'
init_connect='SET NAMES utf8'
character-set-server=utf8
collation-server=utf8_unicode_ci
skip-character-set-client-handshake
skip-name-resolve

server_id=1
log-bin=mysql-bin
read-only=0
binlog-do-db=kubemsb_test

replicate-ignore-db=mysql
replicate-ignore-db=sys
replicate-ignore-db=information_schema
replicate-ignore-db=performance_schema

部署从节点

docker run -d -p 3307:3306 \
    --name mysql-slave \
    -v /opt/mysql-slave/log:/var/log/mysql \
    -v /opt/mysql-slave/data:/var/lib/mysql \
    -v /opt/mysql-slave/conf:/etc/mysql \
    -e MYSQL_ROOT_PASSWORD=root \
    --link mysql-master:mysql-master \
    mysql:5.7

配置从节点

# vim /opt/mysql-slave/conf/my.cnf
# cat /opt/mysql-slave/conf/my.cnf
[client]
default-character-set=utf8

[mysql]
default-character-set=utf8

[mysqld]
init_connect='SET collation_connection = utf8_unicode_ci'
init_connect='SET NAMES utf8'
character-set-server=utf8
collation-server=utf8_unicode_ci
skip-character-set-client-handshake
skip-name-resolve

server_id=2
log-bin=mysql-bin
read-only=1
binlog-do-db=kubemsb_test

replicate-ignore-db=mysql
replicate-ignore-db=sys
replicate-ignore-db=information_schema
replicate-ignore-db=performance_schema

集群配置

配置主节点

# mysql -h 192.168.255.157 -uroot -proot -P 3306
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.7.37 MySQL Community Server (GPL)

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MySQL [(none)]>
# 授权
MySQL [(none)]> grant replication slave on *.* to 'backup'@'%' identified by '123456';
# 重启容器,使用配置生效
# docker restart mysql-master

# 查看状态
MySQL [(none)]> show master status\G
*************************** 1. row ***************************
             File: mysql-bin.000001
         Position: 154
     Binlog_Do_DB: kubemsb_test
 Binlog_Ignore_DB:
Executed_Gtid_Set:
1 row in set (0.00 sec)

配置从节点

# docker restart mysql-slave

# mysql -h 192.168.255.157 -uroot -proot -P 3307

Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.7.37 MySQL Community Server (GPL)

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MySQL [(none)]>
MySQL [(none)]> change master to master_host='mysql-master', master_user='backup', master_password='123456', master_log_file='mysql-bin.000001', master_log_pos=154, master_port=3306;

MySQL [(none)]> start slave;

# 查看从节点状态
MySQL [(none)]> show slave status\G

Oracle

# oracle数据库连接信息
# port:49161
# sid:xe
# username:system
# password:oracle
# 49160 为ssh端口
# 49161 为sqlplus端口
# 49162 为oem端口
docker run -h oracle --name oracle -d 
    -p 49160:22 \
    -p 49161:1521 \
    -p 49162:8080 \
    oracleinanutshell/oracle-xe-11g

PostgreSQL

docker run -d \
	--name postgres \
	-e POSTGRES_PASSWORD=mysecretpassword \
	-e PGDATA=/var/lib/postgresql/data/pgdata \
	-v /custom/mount:/var/lib/postgresql/data \
	postgres:11.20-bullseye

ElasticSearch

单个部署

部署 ElasticSearch

docker pull elasticsearch:7.17.0

# 创建数据卷挂载目录
mkdir -p /opt/es/config
mkdir -p /opt/es/data

# 编写配置文件,使得可以远程访问
echo "http.host: 0.0.0.0" >> /opt/es/config/elasticsearch.yml

docker run -d --name elasticsearch \
    -p 9200:9200 \
    -p 9300:9300 \
    -e "discovery.type=single-node" \
    -e ES_JAVA_OPTS="-Xms64m -Xmx512m" \
    -v /opt/es/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
    -v /opt/es/data:/usr/share/elasticsearch/data \
    -v /opt/es/plugins:/usr/share/elasticsearch/plugins \
    elasticsearch:7.17.0

部署 Kibana

docker run -d --name kibana \
    -e ELASTICSEARCH_HOSTS=http://192.168.255.157:9200 \
    -p 5601:5601 \
    kibana:7.17.0

使用docker-compose部署

version: '3'
services:
  elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:7.17.0
    container_name: elasticsearch
    environment:
      - discovery.type=single-node
    ports:
      - "9200:9200"
      - "9300:9300"
    networks:
      - elk_network
  kibana:
    image: docker.elastic.co/kibana/kibana:7.17.0
    container_name: kibana
    environment:
      ELASTICSEARCH_HOSTS: "http://elasticsearch:9200"
    ports:
      - "5601:5601"
    networks:
      - elk_network

networks:
  elk_network:
# 启动容器
docker-compose up -d

Redis

单机部署

# 创建挂载的目录
mkdir -p /opt/redis/conf

# 创建配置文件
touch /opt/redis/conf/redis.conf

docker run -d -p 6379:6379 --name redis \
    -v /opt/redis/data:/data \
    -v /opt/redis/conf:/etc/redis \
    redis redis-server /etc/redis/redis.conf
# 使用redis-cli连接redis服务
# some-redis指的是容器名称
docker run -it --network some-network --rm redis redis-cli -h some-redis

使用 docker-compose 部署:

version: '3.8'

services:
  redis:
    image: redis:6.0
    container_name: redis6.0
    ports:
      - "6379:6379"
    volumes:
      - ./data:/data
      - ./conf:/etc/redis
    restart: unless-stopped
    # 指定配置文件并开启持久化
    command: redis-server /etc/redis/redis.conf --appendonly yes
    # 使用该参数,container内的root拥有真正的root权限。
    # 否则,container内的root只是外部的一个普通用户权限
    privileged: true 

volumes:
  redis-data:
    driver: local

集群部署

安装 redis-cluster:3 主 3 从方式,从为了同步备份,主进行 slot 数据分片。

redis-cluster.sh

# 编辑运行多个redis容器脚本文件
# vim redis-cluster.sh
# cat redis-cluster.sh
for port in $(seq 8001 8006); \
do \
    mkdir -p /mydata/redis/node-${port}/conf
    touch /mydata/redis/node-${port}/conf/redis.conf
    cat << EOF >/mydata/redis/node-${port}/conf/redis.conf
    port ${port}
    cluster-enabled yes
    cluster-config-file nodes.conf
    cluster-node-timeout 5000
    cluster-announce-ip 192.168.255.157
    cluster-announce-port ${port}
    cluster-announce-bus-port 1${port}
    appendonly yes
    EOF

    docker run -p ${port}:${port} -p 1${port}:1${port} --name redis-${port} \
        -v /mydata/redis/node-${port}/data:/data \
        -v /mydata/redis/node-${port}/conf/redis.conf:/etc/redis/redis.conf \
        -d redis:5.0.7 redis-server /etc/redis/redis.conf; \
done

执行脚本:

sh redis-cluster.sh

登录 Redis 容器:

docker exec -it redis-8001 bash

创建 redis-cluster:

redis-cli --cluster create \
    192.168.255.157:8001 \
    192.168.255.157:8002 \
    192.168.255.157:8003 \
    192.168.255.157:8004 \
    192.168.255.157:8005 \
    192.168.255.157:8006 \
    --cluster-replicas 1

使用 docker-compose 部署:

version: '3'

services:
  redis-master-1:
    image: redis:6.0
    ports:
      - "7001:6379"
    command: ["redis-server", "--cluster-enabled", "yes", "--cluster-config-file", "/data/nodes.conf", "--cluster-node-timeout", "5000", "--appendonly", "yes"]
    volumes:
      - redis-master-1-data:/data

  redis-master-2:
    image: redis:6.0
    ports:
      - "7002:6379"
    command: ["redis-server", "--cluster-enabled", "yes", "--cluster-config-file", "/data/nodes.conf", "--cluster-node-timeout", "5000", "--appendonly", "yes"]
    volumes:
      - redis-master-2-data:/data

  redis-master-3:
    image: redis:6.0
    ports:
      - "7003:6379"
    command: ["redis-server", "--cluster-enabled", "yes", "--cluster-config-file", "/data/nodes.conf", "--cluster-node-timeout", "5000", "--appendonly", "yes"]
    volumes:
      - redis-master-3-data:/data

  redis-slave-1:
    image: redis:6.0
    ports:
      - "7004:6379"
    command: ["redis-server", "--slaveof", "redis-master-1", "6379", "--appendonly", "yes"]
    volumes:
      - redis-slave-1-data:/data

  redis-slave-2:
    image: redis:6.0
    ports:
      - "7005:6379"
    command: ["redis-server", "--slaveof", "redis-master-2", "6379", "--appendonly", "yes"]
    volumes:
      - redis-slave-2-data:/data

  redis-slave-3:
    image: redis:6.0
    ports:
      - "7006:6379"
    command: ["redis-server", "--slaveof", "redis-master-3", "6379", "--appendonly", "yes"]
    volumes:
      - redis-slave-3-data:/data

volumes:
  redis-master-1-data:
  redis-master-2-data:
  redis-master-3-data:
  redis-slave-1-data:
  redis-slave-2-data:
  redis-slave-3-data:

RabbitMQ

# 端口说明:
# 4369, 25672 (Erlang发现&集群端口)
# 5672, 5671 (AMQP端口)
# 15672 (web管理后台端口)
# 61613, 61614 (STOMP协议端口)
# 1883, 8883 (MQTT协议端口)
# 部署带有管理控制台的RabbitMQ
docker run -d --name rabbitmq \
    -p 5671:5671 \
    -p 5672:5672 \
    -p 4369:4369 \
    -p 25672:25672 \
    -p 15671:15671 \
    -p 15672:15672 \
    -v /opt/rabbitmq:/var/lib/rabbitmq \
    rabbitmq:management

MongoDB

使用 Docker-Compose 同时部署 MongoDB 和 Mongo-Express:

version: '3'  
services:  
    mongodb:  
        image: mongo
        container_name: mongodb
        restart: always
        volumes:
            - ./data/db:/data/db
        ports:
            - "27017:27017"
        environment:
        MONGO_INITDB_ROOT_USERNAME: your_mongo_username
        MONGO_INITDB_ROOT_PASSWORD: your_mongo_password

    mongo-express:
        image: mongo-express
        container_name: mongo-express
        restart: always
        ports:
            - "27018:8081" # ui的http端口
        environment: 
        ME_CONFIG_MONGODB_ADMINUSERNAME: your_mongo_username
        ME_CONFIG_MONGODB_ADMINPASSWORD: your_mongo_password
        ME_CONFIG_MONGODB_SERVER: mongodb # 直接通过容器网络通信,要和上面的容器名称一样

MinIO

MinIO 是一款开源免费的对象存储中间件。使用 Docker Compose 部署 MinIO 集群:

version: '3.7'

# 所有容器通用的设置和配置
x-minio-common: &minio-common
  image: minio/minio
  command: server --console-address ":9001" http://minio{1...4}/data
  expose:
    - "9000"
  # environment:
    # MINIO_ROOT_USER: minioadmin
    # MINIO_ROOT_PASSWORD: minioadmin
  healthcheck:
    test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
    interval: 30s
    timeout: 20s
    retries: 3

# 启动4个docker容器运行minio服务器实例
# 使用nginx反向代理9000端口,负载均衡, 你可以通过9001、9002、9003、9004端口访问它们的web console
services:
  minio1:
    <<: *minio-common
    hostname: minio1
    ports:
      - "9001:9001"
    volumes:
      - ./data/data1:/data

  minio2:
    <<: *minio-common
    hostname: minio2
    ports:
      - "9002:9001"
    volumes:
      - ./data/data2:/data

  minio3:
    <<: *minio-common
    hostname: minio3
    ports:
      - "9003:9001"
    volumes:
      - ./data/data3:/data

  minio4:
    <<: *minio-common
    hostname: minio4
    ports:
      - "9004:9001"
    volumes:
      - ./data/data4:/data

  nginx:
    image: nginx:1.19.2-alpine
    hostname: nginx
    volumes:
      - ./config/nginx.conf:/etc/nginx/nginx.conf:ro
    ports:
      - "9000:9000"
    depends_on:
      - minio1
      - minio2
      - minio3
      - minio4

在当前目录下新建 config 目录,然后再 config 目录中创建 nginx.conf 文件,配置 nginx 的路由装配置:

user  nginx;
worker_processes  auto;

error_log  /var/log/nginx/error.log warn;
pid        /var/run/nginx.pid;

events {
    worker_connections  4096;
}

http {
    include       /etc/nginx/mime.types;
    default_type  application/octet-stream;

    log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
                      '$status $body_bytes_sent "$http_referer" '
                      '"$http_user_agent" "$http_x_forwarded_for"';

    access_log  /var/log/nginx/access.log  main;
    sendfile        on;
    keepalive_timeout  65;

    # include /etc/nginx/conf.d/*.conf;

    upstream minio {
        server minio1:9000;
        server minio2:9000;
        server minio3:9000;
        server minio4:9000;
    }

    server {
        listen       9000;
        listen  [::]:9000;
        server_name  localhost;

        # To allow special characters in headers
        ignore_invalid_headers off;
        # Allow any size file to be uploaded.
        # Set to a value such as 1000m; to restrict file size to a specific value
        client_max_body_size 0;
        # To disable buffering
        proxy_buffering off;

        location / {
            proxy_set_header Host $http_host;
            proxy_set_header X-Real-IP $remote_addr;
            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
            proxy_set_header X-Forwarded-Proto $scheme;

            proxy_connect_timeout 300;
            # Default is HTTP/1, keepalive is only enabled in HTTP/1.1
            proxy_http_version 1.1;
            proxy_set_header Connection "";
            chunked_transfer_encoding off;

            proxy_pass http://minio;
        }
    }

}

访问 9000 端口可以进入控制台。

Jaeger

services:
  jaeger:
    container_name: Jaeger
    image: jaegertracing/all-in-one
    ports:
      - "6831:6831/udp"
      - "6832:6832/udp"
      - "5778:5778"
      - "16686:16686"
      - "4317:4317"
      - "4318:4318"
      - "14250:14250"
      - "14268:14268"
      - "14269:14269"
      - "9411:9411"
    environment:
      COLLECTOR_ZIPKIN_HOST_PORT: 9411
      COLLECTOR_OTLP_ENABLED: true

portainer

Portainer 是一款 Docker 可视化工具,你可以在浏览器页面上查看并且管理所有的安装在本机的 Docker 容器。

version: '3.8'
services:
  portainer:
    image: portainer/portainer-ce
    container_name: portainer
    restart: always
    ports:
      - "8000:8000"
      - "9443:9443"
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - ./portainer_data:/data

volumes:
  portainer_data: