elaticsearch logstash 安装流程 手把手教学

安装elaticserach

mkdir -p /data/es
chmod 777 /data/es/ -R
cd /usr/local/src/
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.6.0.tar.gz
tar -zxvf elasticsearch-6.6.0.tar.gz

vi elasticsearch-6.6.0/config/elasticsearch.yml

# 根据服务器内存大小配置
vi elasticsearch-6.6.0/config/jvm.options  
-Xms10g
-Xmx10g
                    

安装分词

# 进入plugins目录：
mkdir analysis-pinyin
cd analysis-pinyin
wget https://github.com/medcl/elasticsearch-analysis-pinyin/releases/download/v6.6.0/elasticsearch-analysis-pinyin-6.6.0.zip
unzip elasticsearch-analysis-pinyin-6.6.0.zip

mkdir ik
cd ik
wget https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v6.6.0/elasticsearch-analysis-ik-6.6.0.zip
unzip elasticsearch-analysis-ik-6.6.0.zip

创建用户：

useradd header
chown -R header:header /data/es/ -R
chown -R header:header /usr/local/src/elasticsearch* -R

设置系统参数：

vi /etc/sysctl.conf 	
vm.max_map_count=655360
sysctl -p

vi /etc/security/limits.conf
* soft nofile 65536		// 注意65535不行，必须最少65536
* hard nofile 65536
* soft nproc 65536
* hard nproc 65536

启动：

su header
./elasticsearch -d

logstash 安装

cd /usr/local/src/

wget https://artifacts.elastic.co/downloads/logstash/logstash-6.6.0.tar.gz
tar -zxvf logstash-6.6.0.tar.gz

安装插件

cd logstash-6.6.0
cd bin
./logstash-plugin install logstash-input-jdbc

安装mysql 插件

cd ../
mkdir sync
cd sync
wget https://downloads.mysql.com/archives/get/p/3/file/mysql-connector-java-5.1.4.tar.gz
tar -zxvf mysql-connector-java-5.1.4.tar.gz
cp mysql-connector-java-5.1.4/mysql-connector-java-5.1.4-bin.jar ./	

创建同步脚本

vi logstash.conf
# 根据自己需求写同步脚本

启动

/usr/local/src/logstash-6.6.0/bin/logstash -f /usr/local/src/logstash-6.6.0/sync/logstash.conf
#建议使用 supervisord 守护进程