k8s-4.2 日志框架搭建

315 阅读1分钟

fluentd+es架构

fluentd-elasticsearch/

  1. 下载kubernetes部署文件
wget https://raw.githubusercontent.com/kubernetes/kubernetes/release-1.14/cluster/addons/fluentd-elasticsearch/*.yaml
  1. 翻墙镜像处理
  2. kubectl apply -f .
  3. 访问kibana 删除kibana deployment配置KIBANA_BASE_URL configured. 创建nodeport cat kibana-nodeport.yaml
apiVersion: v1
kind: Service
metadata:
  name: kibana-logging-np
  namespace: kube-system
  labels:
    k8s-app: kibana-logging
    kubernetes.io/cluster-service: "true"
    addonmanager.kubernetes.io/mode: Reconcile
    kubernetes.io/name: "Kibana"
spec:
  type: NodePort
  ports:
  - port: 5601
    nodePort: 30004
  selector:
    k8s-app: kibana-logging

fluentbit+es架构

fluent bit

kubectl create namespace logging

helm repo add incubator https://kubernetes-charts-incubator.storage.googleapis.com/
helm install --name elasticsearch stable/elasticsearch \
    --set master.persistence.enabled=false \
    --set data.persistence.enabled=false \
    --namespace logging

helm install --name kibana stable/kibana \
--set env.ELASTICSEARCH_URL=http://elasticsearch-client:9200 \
--namespace logging

kubectl apply -f https://raw.githubusercontent.com/fluent/fluent-bit-kubernetes-logging/master/fluent-bit-service-account.yaml
kubectl apply -f https://raw.githubusercontent.com/fluent/fluent-bit-kubernetes-logging/master/fluent-bit-role.yaml
kubectl apply -f https://raw.githubusercontent.com/fluent/fluent-bit-kubernetes-logging/master/fluent-bit-role-binding.yaml

kubectl apply -f https://raw.githubusercontent.com/fluent/fluent-bit-kubernetes-logging/master/output/elasticsearch/fluent-bit-configmap.yaml
kubectl apply -f https://raw.githubusercontent.com/fluent/fluent-bit-kubernetes-logging/master/output/elasticsearch/fluent-bit-ds.yaml