elasticsearch_export Metrics含义

1,462 阅读7分钟

最近需要做elasticsearch监控相关的需求,采用elasticsearch_export采集es的各项监控指标,供后续prometheus、grafana、kibana等展示。

现特意梳理elasticsearch_export metrics各字段含义,具体参看github.com/justwatchco…

NameTypeCardinalityHelp
elasticsearch_breakers_estimated_size_bytesgauge4Estimated size in bytes of breakerbreaker字节的估计大小
elasticsearch_breakers_limit_size_bytesgauge4Limit size in bytes for breaker将断路器的大小限制为字节
elasticsearch_breakers_trippedcounter4tripped for breaker断路器跳闸
elasticsearch_cluster_health_active_primary_shardsgauge1The number of primary shards in your cluster. This is an aggregate total across all indices.活跃的主分片总数
elasticsearch_cluster_health_active_shardsgauge1Aggregate total of all shards across all indices, which includes replica shards.活跃的分片总数(包括复制分片)
elasticsearch_cluster_health_delayed_unassigned_shardsgauge1Shards delayed to reduce reallocation overhead分片延迟以减少重新分配开销
elasticsearch_cluster_health_initializing_shardsgauge1Count of shards that are being freshly created.正在初始化的分片数
elasticsearch_cluster_health_number_of_data_nodesgauge1Number of data nodes in the cluster.node节点的数量
elasticsearch_cluster_health_number_of_in_flight_fetchgauge1The number of ongoing shard info requests.正在进行的碎片信息请求的数量
elasticsearch_cluster_health_number_of_nodesgauge1Number of nodes in the cluster.集群内所有的节点
elasticsearch_cluster_health_number_of_pending_tasksgauge1Cluster level changes which have not yet been executed尚未执行的集群级别更改
elasticsearch_cluster_health_task_max_waiting_in_queue_millisgauge1Max time in millis that a task is waiting in queue.任务在队列中等待的最长时间(以毫秒为单位)。
elasticsearch_cluster_health_relocating_shardsgauge1The number of shards that are currently moving from one node to another node.当前节点正在迁移到其他节点的分片数量,通常为0,集群中有节点新加入或者退出时该值会增加
elasticsearch_cluster_health_statusgauge3Whether all primary and replica shards are allocated.集群状态,green,yellow,red
elasticsearch_cluster_health_timed_outgauge1Number of cluster health checks timed out.集群运行状况检查次数超时
elasticsearch_cluster_health_unassigned_shardsgauge1The number of shards that exist in the cluster state, but cannot be found in the cluster itself.未分配分片数
elasticsearch_filesystem_data_available_bytesgauge1Available space on block device in bytes块设备上的可用空间(以字节为单位)
elasticsearch_filesystem_data_free_bytesgauge1Free space on block device in bytes磁盘可用空间
elasticsearch_filesystem_data_size_bytesgauge1Size of block device in bytes块设备的大小(以字节为单位)
elasticsearch_filesystem_io_stats_device_operations_countgauge1Count of disk operations磁盘操作数
elasticsearch_filesystem_io_stats_device_read_operations_countgauge1Count of disk read operations磁盘读取操作数
elasticsearch_filesystem_io_stats_device_write_operations_countgauge1Count of disk write operations磁盘写操作数
elasticsearch_filesystem_io_stats_device_read_size_kilobytes_sumgauge1Total kilobytes read from disk从磁盘读取的总千字节
elasticsearch_filesystem_io_stats_device_write_size_kilobytes_sumgauge1Total kilobytes written to disk写入磁盘的总千字节
elasticsearch_indices_docsgauge1Count of documents on this node此节点上的文档数
elasticsearch_indices_docs_deletedgauge1Count of deleted documents on this node此节点上已删除文档的数量
elasticsearch_indices_docs_primarygaugeCount of documents with only primary shards on all nodes所有节点上仅具有主分片的文档数
elasticsearch_indices_fielddata_evictionscounter1Evictions from field data来自fielddata缓存的驱逐次数
elasticsearch_indices_fielddata_memory_size_bytesgauge1Field data cache memory usage in bytesfielddata缓存的大小(字节)
elasticsearch_indices_filter_cache_evictionscounter1Evictions from filter cache来自过滤器缓存的驱逐次数(仅版本2.x)
elasticsearch_indices_filter_cache_memory_size_bytesgauge1Filter cache memory usage in bytes过滤器高速缓存的大小(字节)(仅版本2.x)
elasticsearch_indices_flush_time_secondscounter1Cumulative flush time in seconds将索引刷新到磁盘上的总时间(累计flush时间)
elasticsearch_indices_flush_totalcounter1Total flushes索引刷新总数到磁盘
elasticsearch_indices_get_exists_time_secondscounter1Total time get exists in seconds获得的总时间以秒为单位
elasticsearch_indices_get_exists_totalcounter1Total get exists operations获得操作总数
elasticsearch_indices_get_missing_time_secondscounter1Total time of get missing in seconds花费在文档丢失的GET请求上的总时间
elasticsearch_indices_get_missing_totalcounter1Total get missing丢失的文件的GET请求总数
elasticsearch_indices_get_time_secondscounter1Total get time in seconds总获得时间(以秒为单位)
elasticsearch_indices_get_totalcounter1Total get总获得
elasticsearch_indices_indexing_delete_time_seconds_totalcounter1Total time indexing delete in seconds索引的文件删除总时间
elasticsearch_indices_indexing_delete_totalcounter1Total indexing deletes索引的文件删除总数
elasticsearch_indices_indexing_index_time_seconds_totalcounter1Cumulative index time in seconds索引文档总时间
elasticsearch_indices_indexing_index_totalcounter1Total index calls索引的文件总数
elasticsearch_indices_merges_docs_totalcounter1Cumulative docs merged累积文档合并
elasticsearch_indices_merges_totalcounter1Total merges合并总数
elasticsearch_indices_merges_total_size_bytes_totalcounter1Total merge size in bytes总合并大小(以字节为单位)
elasticsearch_indices_merges_total_time_seconds_totalcounter1Total time spent merging in seconds合并所花费的总时间(以秒为单位)
elasticsearch_indices_query_cache_cache_totalcounter1Count of query cache查询缓存数
elasticsearch_indices_query_cache_cache_sizegauge1Size of query cache查询缓存的大小
elasticsearch_indices_query_cache_countcounter2Count of query cache hit/miss查询缓存命中/未命中计数
elasticsearch_indices_query_cache_evictionscounter1Evictions from query cache从查询缓存中逐出
elasticsearch_indices_query_cache_memory_size_bytesgauge1Query cache memory usage in bytes查询缓存的内存使用量(以字节为单位)
elasticsearch_indices_query_cache_totalcounter1Size of query cache total查询缓存总大小
elasticsearch_indices_refresh_time_seconds_totalcounter1Total time spent refreshing in seconds刷新指数的总时间
elasticsearch_indices_refresh_totalcounter1Total refreshes索引刷新总数
elasticsearch_indices_request_cache_countcounter2Count of request cache hit/miss请求缓存命中/未命中计数
elasticsearch_indices_request_cache_evictionscounter1Evictions from request cache从请求缓存中逐出
elasticsearch_indices_request_cache_memory_size_bytesgauge1Request cache memory usage in bytes请求缓存内存使用量(以字节为单位)
elasticsearch_indices_search_fetch_time_secondscounter1Total search fetch time in seconds花费在提取上的总时间
elasticsearch_indices_search_fetch_totalcounter1Total number of fetches提取总数
elasticsearch_indices_search_query_time_secondscounter1Total search query time in seconds查询总时间(性能)
elasticsearch_indices_search_query_totalcounter1Total number of queries查询总数(吞吐量)
elasticsearch_indices_segments_countgauge1Count of index segments on this node此节点上索引段的计数
elasticsearch_indices_segments_memory_bytesgauge1Current memory size of segments in bytes段的当前内存大小(以字节为单位)
elasticsearch_indices_settings_stats_read_only_indicesgauge1Count of indices that have read_only_allow_delete=true具有read_only_allow_delete = true的索引计数
elasticsearch_indices_shards_docsgauge3Count of documents on this shard该分片上的文档数
elasticsearch_indices_shards_docs_deletedgauge3Count of deleted documents on each shard每个分片上已删除文档的数量
elasticsearch_indices_store_size_bytesgauge1Current size of stored index data in bytes当前存储的索引数据大小(以字节为单位)
elasticsearch_indices_store_size_bytes_primarygaugeCurrent size of stored index data in bytes with only primary shards on all nodes当前存储的索引数据大小(以字节为单位),所有节点上只有主分片
elasticsearch_indices_store_size_bytes_totalgaugeCurrent size of stored index data in bytes with all shards on all nodes所有节点上所有分片的已存储索引数据的当前大小(以字节为单位)
elasticsearch_indices_store_throttle_time_seconds_totalcounter1Throttle time for index store in seconds索引存储的节流时间(以秒为单位)
elasticsearch_indices_translog_operationscounter1Total translog operations总移转作业
elasticsearch_indices_translog_size_in_bytescounter1Total translog size in bytes总translog大小(以字节为单位)
elasticsearch_indices_warmer_time_seconds_totalcounter1Total warmer time in seconds总升温时间(以秒为单位)
elasticsearch_indices_warmer_totalcounter1Total warmer count总暖箱数
elasticsearch_jvm_gc_collection_seconds_countcounter2Count of JVM GC runs垃圾搜集数
elasticsearch_jvm_gc_collection_seconds_sumcounter2GC run time in seconds垃圾回收时间
elasticsearch_jvm_memory_committed_bytesgauge2JVM memory currently committed by area最大使用内存限制
elasticsearch_jvm_memory_max_bytesgauge1JVM memory max配置的最大jvm值
elasticsearch_jvm_memory_used_bytesgauge2JVM memory currently used by area内存使用量
elasticsearch_jvm_memory_pool_used_bytesgauge3JVM memory currently used by pool目前使用的JVM内存池
elasticsearch_jvm_memory_pool_max_bytescounter3JVM memory max by poolJVM内存最大池数
elasticsearch_jvm_memory_pool_peak_used_bytescounter3JVM memory peak used by pool池使用的JVM内存峰值
elasticsearch_jvm_memory_pool_peak_max_bytescounter3JVM memory peak max by pool最大的JVM内存峰值
elasticsearch_os_cpu_percentgauge1Percent CPU used by the OS操作系统使用的CPU百分比
elasticsearch_os_load1gauge1Shortterm load average短期平均负载
elasticsearch_os_load5gauge1Midterm load average中期平均负荷
elasticsearch_os_load15gauge1Longterm load average长期平均负载
elasticsearch_process_cpu_percentgauge1Percent CPU used by processCPU使用率
elasticsearch_process_cpu_time_seconds_sumcounter3Process CPU time in seconds处理CPU时间(以秒为单位)
elasticsearch_process_mem_resident_size_bytesgauge1Resident memory in use by process in bytes进程使用的驻留内存(以字节为单位)
elasticsearch_process_mem_share_size_bytesgauge1Shared memory in use by process in bytes进程正在使用的共享内存(以字节为单位)
elasticsearch_process_mem_virtual_size_bytesgauge1Total virtual memory used in bytes使用的总虚拟内存(以字节为单位)
elasticsearch_process_open_files_countgauge1Open file descriptorsES进程打开的文件描述符
elasticsearch_snapshot_stats_number_of_snapshotsgauge1Total number of snapshots快照总数
elasticsearch_snapshot_stats_oldest_snapshot_timestampgauge1Oldest snapshot timestamp最早的快照时间戳
elasticsearch_snapshot_stats_snapshot_start_time_timestampgauge1Last snapshot start timestamp上次快照开始时间戳
elasticsearch_snapshot_stats_snapshot_end_time_timestampgauge1Last snapshot end timestamp上次快照结束时间戳记
elasticsearch_snapshot_stats_snapshot_number_of_failuresgauge1Last snapshot number of failures上次快照失败次数
elasticsearch_snapshot_stats_snapshot_number_of_indicesgauge1Last snapshot number of indices索引的最后快照数量
elasticsearch_snapshot_stats_snapshot_failed_shardsgauge1Last snapshot failed shards上次快照失败的分片
elasticsearch_snapshot_stats_snapshot_successful_shardsgauge1Last snapshot successful shards上次快照成功分片
elasticsearch_snapshot_stats_snapshot_total_shardsgauge1Last snapshot total shard上次快照总分片
elasticsearch_thread_pool_active_countgauge14Thread Pool threads active线程池线程活动(bulk、index、search、force_merge)
elasticsearch_thread_pool_completed_countcounter14Thread Pool operations completed线程池操作完成(bulk、index、search、force_merge)
elasticsearch_thread_pool_largest_countgauge14Thread Pool largest threads count线程池最大线程数(bulk、index、search、force_merge)
elasticsearch_thread_pool_queue_countgauge14Thread Pool operations queued线程池中的排队线程数(bulk、index、search、force_merge)
elasticsearch_thread_pool_rejected_countcounter14Thread Pool operations rejected线程池的被拒绝线程数
elasticsearch_thread_pool_threads_countgauge14Thread Pool current threads count线程池当前线程数
elasticsearch_transport_rx_packets_totalcounter1Count of packets receivedES节点之间网络入流量
elasticsearch_transport_rx_size_bytes_totalcounter1Total number of bytes received接收的字节总数
elasticsearch_transport_tx_packets_totalcounter1Count of packets sentES节点之间网络出流量
elasticsearch_transport_tx_size_bytes_totalcounter1Total number of bytes sent发送的总字节数
elasticsearch_clusterinfo_last_retrieval_success_tsgauge1Timestamp of the last successful cluster info retrieval上一次成功的集群信息检索的时间戳
elasticsearch_clusterinfo_upgauge1Up metric for the cluster info collector集群信息收集器的启动指标
elasticsearch_clusterinfo_version_infogauge6Constant metric with ES version information as labels带有ES版本信息作为标签的常量指标