grafana展示toplingdb运行指标-手动配置

请先阅读 grafana 展示 toplingdb 运行指标 基础
需要了解 grafana dashboard设置基本操作

“grafana展示toplingdb运行指标-基础”介绍了 grafana 展示 toplingdb 指标的基本设置内容。本节介绍 grafana 的 dashboard 相关设置,以方便使用。

本节介绍内容为最基本设置方式,理解基本内容后就可以自行个性化配置了。

grafana 展示内容

展示 props 内容

  • 设置 grafana 变量

变量设置内容:
整理有些指标可以合并,方便处理,本次直接使用不处理,感兴趣请自行合并。

1
engine:num_immutable_mem_table,engine:num_immutable_mem_table_flushed,engine:mem_table_flush_pending,engine:compaction_pending,engine:background_errors,engine:cur_size_active_mem_table,engine:cur_size_all_mem_tables,engine:size_all_mem_tables,engine:num_entries_active_mem_table,engine:num_entries_imm_mem_tables,engine:num_deletes_active_mem_table,engine:num_deletes_imm_mem_tables,engine:estimate_num_keys,engine:estimate_table_readers_mem,engine:is_file_deletions_enabled,engine:num_snapshots,engine:oldest_snapshot_time,engine:oldest_snapshot_sequence,engine:num_live_versions,engine:current_super_version_number,engine:estimate_live_data_size,engine:min_log_number_to_keep,engine:min_obsolete_sst_number_to_keep,engine:base_level,engine:total_sst_files_size,engine:live_sst_files_size,engine:estimate_pending_compaction_bytes,engine:num_running_flushes,engine:num_running_compactions,engine:actual_delayed_write_rate,engine:is_write_stopped,engine:cfstats{flag="compaction:L0:AvgSec"},engine:cfstats{flag="compaction:L0:CompCount"},engine:cfstats{flag="compaction:L0:CompMergeCPU"},engine:cfstats{flag="compaction:L0:CompSec"},engine:cfstats{flag="compaction:L0:CompactedFiles"},engine:cfstats{flag="compaction:L0:KeyDrop"},engine:cfstats{flag="compaction:L0:KeyIn"},engine:cfstats{flag="compaction:L0:MovedGB"},engine:cfstats{flag="compaction:L0:NumFiles"},engine:cfstats{flag="compaction:L0:RblobGB"},engine:cfstats{flag="compaction:L0:ReadGB"},engine:cfstats{flag="compaction:L0:ReadMBps"},engine:cfstats{flag="compaction:L0:RnGB"},engine:cfstats{flag="compaction:L0:Rnp1GB"},engine:cfstats{flag="compaction:L0:Score"},engine:cfstats{flag="compaction:L0:SizeBytes"},engine:cfstats{flag="compaction:L0:WblobGB"},engine:cfstats{flag="compaction:L0:WnewGB"},engine:cfstats{flag="compaction:L0:WriteAmp"},engine:cfstats{flag="compaction:L0:WriteGB"},engine:cfstats{flag="compaction:L0:WriteMBps"},engine:cfstats{flag="compaction:L1:AvgSec"},engine:cfstats{flag="compaction:L1:CompCount"},engine:cfstats{flag="compaction:L1:CompMergeCPU"},engine:cfstats{flag="compaction:L1:CompSec"},engine:cfstats{flag="compaction:L1:CompactedFiles"},engine:cfstats{flag="compaction:L1:KeyDrop"},engine:cfstats{flag="compaction:L1:KeyIn"},engine:cfstats{flag="compaction:L1:MovedGB"},engine:cfstats{flag="compaction:L1:NumFiles"},engine:cfstats{flag="compaction:L1:RblobGB"},engine:cfstats{flag="compaction:L1:ReadGB"},engine:cfstats{flag="compaction:L1:ReadMBps"},engine:cfstats{flag="compaction:L1:RnGB"},engine:cfstats{flag="compaction:L1:Rnp1GB"},engine:cfstats{flag="compaction:L1:Score"},engine:cfstats{flag="compaction:L1:SizeBytes"},engine:cfstats{flag="compaction:L1:WblobGB"},engine:cfstats{flag="compaction:L1:WnewGB"},engine:cfstats{flag="compaction:L1:WriteAmp"},engine:cfstats{flag="compaction:L1:WriteGB"},engine:cfstats{flag="compaction:L1:WriteMBps"},engine:cfstats{flag="compaction:L2:AvgSec"},engine:cfstats{flag="compaction:L2:CompCount"},engine:cfstats{flag="compaction:L2:CompMergeCPU"},engine:cfstats{flag="compaction:L2:CompSec"},engine:cfstats{flag="compaction:L2:CompactedFiles"},engine:cfstats{flag="compaction:L2:KeyDrop"},engine:cfstats{flag="compaction:L2:KeyIn"},engine:cfstats{flag="compaction:L2:MovedGB"},engine:cfstats{flag="compaction:L2:NumFiles"},engine:cfstats{flag="compaction:L2:RblobGB"},engine:cfstats{flag="compaction:L2:ReadGB"},engine:cfstats{flag="compaction:L2:ReadMBps"},engine:cfstats{flag="compaction:L2:RnGB"},engine:cfstats{flag="compaction:L2:Rnp1GB"},engine:cfstats{flag="compaction:L2:Score"},engine:cfstats{flag="compaction:L2:SizeBytes"},engine:cfstats{flag="compaction:L2:WblobGB"},engine:cfstats{flag="compaction:L2:WnewGB"},engine:cfstats{flag="compaction:L2:WriteAmp"},engine:cfstats{flag="compaction:L2:WriteGB"},engine:cfstats{flag="compaction:L2:WriteMBps"},engine:cfstats{flag="compaction:L3:AvgSec"},engine:cfstats{flag="compaction:L3:CompCount"},engine:cfstats{flag="compaction:L3:CompMergeCPU"},engine:cfstats{flag="compaction:L3:CompSec"},engine:cfstats{flag="compaction:L3:CompactedFiles"},engine:cfstats{flag="compaction:L3:KeyDrop"},engine:cfstats{flag="compaction:L3:KeyIn"},engine:cfstats{flag="compaction:L3:MovedGB"},engine:cfstats{flag="compaction:L3:NumFiles"},engine:cfstats{flag="compaction:L3:RblobGB"},engine:cfstats{flag="compaction:L3:ReadGB"},engine:cfstats{flag="compaction:L3:ReadMBps"},engine:cfstats{flag="compaction:L3:RnGB"},engine:cfstats{flag="compaction:L3:Rnp1GB"},engine:cfstats{flag="compaction:L3:Score"},engine:cfstats{flag="compaction:L3:SizeBytes"},engine:cfstats{flag="compaction:L3:WblobGB"},engine:cfstats{flag="compaction:L3:WnewGB"},engine:cfstats{flag="compaction:L3:WriteAmp"},engine:cfstats{flag="compaction:L3:WriteGB"},engine:cfstats{flag="compaction:L3:WriteMBps"},engine:cfstats{flag="compaction:Sum:AvgSec"},engine:cfstats{flag="compaction:Sum:CompCount"},engine:cfstats{flag="compaction:Sum:CompMergeCPU"},engine:cfstats{flag="compaction:Sum:CompSec"},engine:cfstats{flag="compaction:Sum:CompactedFiles"},engine:cfstats{flag="compaction:Sum:KeyDrop"},engine:cfstats{flag="compaction:Sum:KeyIn"},engine:cfstats{flag="compaction:Sum:MovedGB"},engine:cfstats{flag="compaction:Sum:NumFiles"},engine:cfstats{flag="compaction:Sum:RblobGB"},engine:cfstats{flag="compaction:Sum:ReadGB"},engine:cfstats{flag="compaction:Sum:ReadMBps"},engine:cfstats{flag="compaction:Sum:RnGB"},engine:cfstats{flag="compaction:Sum:Rnp1GB"},engine:cfstats{flag="compaction:Sum:Score"},engine:cfstats{flag="compaction:Sum:SizeBytes"},engine:cfstats{flag="compaction:Sum:WblobGB"},engine:cfstats{flag="compaction:Sum:WnewGB"},engine:cfstats{flag="compaction:Sum:WriteAmp"},engine:cfstats{flag="compaction:Sum:WriteGB"},engine:cfstats{flag="compaction:Sum:WriteMBps"},engine:cfstats{flag="io_stalls:level0_numfiles"},engine:cfstats{flag="io_stalls:level0_numfiles_with_compaction"},engine:cfstats{flag="io_stalls:level0_slowdown"},engine:cfstats{flag="io_stalls:level0_slowdown_with_compaction"},engine:cfstats{flag="io_stalls:memtable_compaction"},engine:cfstats{flag="io_stalls:memtable_slowdown"},engine:cfstats{flag="io_stalls:slowdown_for_pending_compaction_bytes"},engine:cfstats{flag="io_stalls:stop_for_pending_compaction_bytes"},engine:cfstats{flag="io_stalls:total_slowdown"},engine:cfstats{flag="io_stalls:total_stop"},engine:aggregated_table_properties{flag="data_size"},engine:aggregated_table_properties{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties{flag="filter_size"},engine:aggregated_table_properties{flag="index_partitions"},engine:aggregated_table_properties{flag="index_size"},engine:aggregated_table_properties{flag="num_data_blocks"},engine:aggregated_table_properties{flag="num_deletions"},engine:aggregated_table_properties{flag="num_entries"},engine:aggregated_table_properties{flag="num_filter_entries"},engine:aggregated_table_properties{flag="num_merge_operands"},engine:aggregated_table_properties{flag="num_range_deletions"},engine:aggregated_table_properties{flag="raw_key_size"},engine:aggregated_table_properties{flag="raw_value_size"},engine:aggregated_table_properties{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties{flag="top_level_index_size"},engine:num_files_at_level0,engine:num_files_at_level1,engine:num_files_at_level2,engine:num_files_at_level3,engine:num_files_at_level4,engine:num_files_at_level5,engine:num_files_at_level6,engine:compression_ratio_at_level0,engine:compression_ratio_at_level1,engine:compression_ratio_at_level2,engine:compression_ratio_at_level3,engine:compression_ratio_at_level4,engine:compression_ratio_at_level5,engine:compression_ratio_at_level6,engine:aggregated_table_properties_at_level0{flag="data_size"},engine:aggregated_table_properties_at_level0{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties_at_level0{flag="filter_size"},engine:aggregated_table_properties_at_level0{flag="index_partitions"},engine:aggregated_table_properties_at_level0{flag="index_size"},engine:aggregated_table_properties_at_level0{flag="num_data_blocks"},engine:aggregated_table_properties_at_level0{flag="num_deletions"},engine:aggregated_table_properties_at_level0{flag="num_entries"},engine:aggregated_table_properties_at_level0{flag="num_filter_entries"},engine:aggregated_table_properties_at_level0{flag="num_merge_operands"},engine:aggregated_table_properties_at_level0{flag="num_range_deletions"},engine:aggregated_table_properties_at_level0{flag="raw_key_size"},engine:aggregated_table_properties_at_level0{flag="raw_value_size"},engine:aggregated_table_properties_at_level0{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties_at_level0{flag="top_level_index_size"},engine:aggregated_table_properties_at_level1{flag="data_size"},engine:aggregated_table_properties_at_level1{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties_at_level1{flag="filter_size"},engine:aggregated_table_properties_at_level1{flag="index_partitions"},engine:aggregated_table_properties_at_level1{flag="index_size"},engine:aggregated_table_properties_at_level1{flag="num_data_blocks"},engine:aggregated_table_properties_at_level1{flag="num_deletions"},engine:aggregated_table_properties_at_level1{flag="num_entries"},engine:aggregated_table_properties_at_level1{flag="num_filter_entries"},engine:aggregated_table_properties_at_level1{flag="num_merge_operands"},engine:aggregated_table_properties_at_level1{flag="num_range_deletions"},engine:aggregated_table_properties_at_level1{flag="raw_key_size"},engine:aggregated_table_properties_at_level1{flag="raw_value_size"},engine:aggregated_table_properties_at_level1{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties_at_level1{flag="top_level_index_size"},engine:aggregated_table_properties_at_level2{flag="data_size"},engine:aggregated_table_properties_at_level2{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties_at_level2{flag="filter_size"},engine:aggregated_table_properties_at_level2{flag="index_partitions"},engine:aggregated_table_properties_at_level2{flag="index_size"},engine:aggregated_table_properties_at_level2{flag="num_data_blocks"},engine:aggregated_table_properties_at_level2{flag="num_deletions"},engine:aggregated_table_properties_at_level2{flag="num_entries"},engine:aggregated_table_properties_at_level2{flag="num_filter_entries"},engine:aggregated_table_properties_at_level2{flag="num_merge_operands"},engine:aggregated_table_properties_at_level2{flag="num_range_deletions"},engine:aggregated_table_properties_at_level2{flag="raw_key_size"},engine:aggregated_table_properties_at_level2{flag="raw_value_size"},engine:aggregated_table_properties_at_level2{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties_at_level2{flag="top_level_index_size"},engine:aggregated_table_properties_at_level3{flag="data_size"},engine:aggregated_table_properties_at_level3{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties_at_level3{flag="filter_size"},engine:aggregated_table_properties_at_level3{flag="index_partitions"},engine:aggregated_table_properties_at_level3{flag="index_size"},engine:aggregated_table_properties_at_level3{flag="num_data_blocks"},engine:aggregated_table_properties_at_level3{flag="num_deletions"},engine:aggregated_table_properties_at_level3{flag="num_entries"},engine:aggregated_table_properties_at_level3{flag="num_filter_entries"},engine:aggregated_table_properties_at_level3{flag="num_merge_operands"},engine:aggregated_table_properties_at_level3{flag="num_range_deletions"},engine:aggregated_table_properties_at_level3{flag="raw_key_size"},engine:aggregated_table_properties_at_level3{flag="raw_value_size"},engine:aggregated_table_properties_at_level3{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties_at_level3{flag="top_level_index_size"},engine:aggregated_table_properties_at_level4{flag="data_size"},engine:aggregated_table_properties_at_level4{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties_at_level4{flag="filter_size"},engine:aggregated_table_properties_at_level4{flag="index_partitions"},engine:aggregated_table_properties_at_level4{flag="index_size"},engine:aggregated_table_properties_at_level4{flag="num_data_blocks"},engine:aggregated_table_properties_at_level4{flag="num_deletions"},engine:aggregated_table_properties_at_level4{flag="num_entries"},engine:aggregated_table_properties_at_level4{flag="num_filter_entries"},engine:aggregated_table_properties_at_level4{flag="num_merge_operands"},engine:aggregated_table_properties_at_level4{flag="num_range_deletions"},engine:aggregated_table_properties_at_level4{flag="raw_key_size"},engine:aggregated_table_properties_at_level4{flag="raw_value_size"},engine:aggregated_table_properties_at_level4{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties_at_level4{flag="top_level_index_size"},engine:aggregated_table_properties_at_level5{flag="data_size"},engine:aggregated_table_properties_at_level5{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties_at_level5{flag="filter_size"},engine:aggregated_table_properties_at_level5{flag="index_partitions"},engine:aggregated_table_properties_at_level5{flag="index_size"},engine:aggregated_table_properties_at_level5{flag="num_data_blocks"},engine:aggregated_table_properties_at_level5{flag="num_deletions"},engine:aggregated_table_properties_at_level5{flag="num_entries"},engine:aggregated_table_properties_at_level5{flag="num_filter_entries"},engine:aggregated_table_properties_at_level5{flag="num_merge_operands"},engine:aggregated_table_properties_at_level5{flag="num_range_deletions"},engine:aggregated_table_properties_at_level5{flag="raw_key_size"},engine:aggregated_table_properties_at_level5{flag="raw_value_size"},engine:aggregated_table_properties_at_level5{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties_at_level5{flag="top_level_index_size"},engine:aggregated_table_properties_at_level6{flag="data_size"},engine:aggregated_table_properties_at_level6{flag="fast_compression_estimated_data_size"},engine:aggregated_table_properties_at_level6{flag="filter_size"},engine:aggregated_table_properties_at_level6{flag="index_partitions"},engine:aggregated_table_properties_at_level6{flag="index_size"},engine:aggregated_table_properties_at_level6{flag="num_data_blocks"},engine:aggregated_table_properties_at_level6{flag="num_deletions"},engine:aggregated_table_properties_at_level6{flag="num_entries"},engine:aggregated_table_properties_at_level6{flag="num_filter_entries"},engine:aggregated_table_properties_at_level6{flag="num_merge_operands"},engine:aggregated_table_properties_at_level6{flag="num_range_deletions"},engine:aggregated_table_properties_at_level6{flag="raw_key_size"},engine:aggregated_table_properties_at_level6{flag="raw_value_size"},engine:aggregated_table_properties_at_level6{flag="slow_compression_estimated_data_size"},engine:aggregated_table_properties_at_level6{flag="top_level_index_size"},

image

  • 设置panel内容

image

  • 基本效果

image

展示 statistics 的 histogram 内容

  • 指标内容,变量设置方法同上。
    1
    engine:bytes:per:multiget,engine:bytes:per:read,engine:bytes:per:write,engine:compaction:outfile:sync:micros,engine:compaction:times:cpu_micros,engine:compaction:times:micros,engine:cond:wait:nanos,engine:db:flush:micros,engine:db:get:micros,engine:db:multiget:micros,engine:db:seek:micros,engine:db:write:micros,engine:db:write:stall,engine:dcompaction:input:raw:bytes,engine:dcompaction:input:zip:bytes,engine:dcompaction:output:file:raw:size,engine:dcompaction:output:file:zip:size,engine:error:handler:autoresume:retry:count,engine:hard:rate:limit:delay:count,engine:l0:slowdown:count,engine:lcompaction:input:raw:bytes,engine:lcompaction:input:zip:bytes,engine:lcompaction:output:file:raw:size,engine:lcompaction:output:file:zip:size,engine:manifest:file:sync:micros,engine:memtab:construct:nanos,engine:memtable:compaction:count,engine:memtab:write:kv:nanos,engine:mutex:wait:nanos,engine:number:per:multiget,engine:numfiles:in:singlecompaction,engine:num:files:stall:count,engine:num:sst:read:per:level,engine:num:subcompactions:scheduled,engine:read:block:compaction:micros,engine:read:num:merge_operands,engine:soft:rate:limit:delay:count,engine:sst:batch:size,engine:sst:read:micros,engine:subcompaction:setup:times:micros,engine:switch:wal:nanos,engine:table:open:io:micros,engine:table:sync:micros,engine:wal:file:sync:micros,engine:write:wal:nanos,
  • 设置 panel 内容

image

  • 基本效果

image

展示 statistics 的的普通指标内容

设置方法同 props 展示,不再重复。

  • 指标内容
    1
    engine:bloom:filter:useful,engine:bloom:filter:full:positive,engine:bloom:filter:full:true:positive,engine:bloom:filter:micros,engine:memtable:hit,engine:memtable:miss,engine:l0:hit,engine:l1:hit,engine:l2andup:hit,engine:compaction:key:drop:new,engine:compaction:key:drop:obsolete,engine:compaction:key:drop:range_del,engine:compaction:key:drop:user,engine:compaction:range_del:drop:obsolete,engine:compaction:optimized:del:drop:obsolete,engine:compaction:cancelled,engine:number:keys:written,engine:number:keys:read,engine:number:keys:updated,engine:bytes:read,engine:number:db:seek,engine:number:db:next,engine:number:db:prev,engine:number:db:seek:found,engine:number:db:next:found,engine:number:db:prev:found,engine:db:iter:bytes:read,engine:no:file:closes,engine:no:file:opens,engine:no:file:errors,engine:l0:slowdown:micros,engine:memtable:compaction:micros,engine:l0:num:files:stall:micros,engine:stall:micros,engine:db:cond:wait:nanos,engine:db:mutex:wait:nanos,engine:rate:limit:delay:millis,engine:num:iterators,engine:number:multiget:get,engine:number:multiget:keys:read,engine:number:multiget:bytes:read,engine:number:deletes:filtered,engine:number:merge:failures,engine:bloom:filter:prefix:checked,engine:bloom:filter:prefix:useful,engine:number:reseeks:iteration,engine:getupdatessince:calls,engine:wal:synced,engine:write:timeout,engine:compact:read:marked:bytes,engine:compact:read:periodic:bytes,engine:compact:read:ttl:bytes,engine:compact:write:marked:bytes,engine:compact:write:periodic:bytes,engine:compact:write:ttl:bytes,engine:number:direct:load:table:properties,engine:merge:operation:time:nanos,engine:filter:operation:time:nanos,engine:read:amp:estimate:useful:bytes,engine:read:amp:total:read:bytes,engine:number:rate_limiter:drains,engine:number:iter:skip,engine:number:multiget:keys:found,engine:num:iterator:created,engine:num:iterator:deleted,engine:files:marked:trash,engine:files:deleted:immediately,engine:error:handler:bg:errro:count,engine:error:handler:bg:io:errro:count,engine:error:handler:bg:retryable:io:errro:count,engine:error:handler:autoresume:count,engine:error:handler:autoresume:retry:total:count,engine:error:handler:autoresume:success:count,engine:bytes:written,engine:wal:bytes,engine:flush:write:bytes,engine:write:self,engine:write:other,engine:write:wal,engine:compact:read:bytes,engine:compact:write:bytes,engine:superversion_acquires,engine:superversion_cleanups,engine:superversion_releases,

grafana 设置 dashboard list

下图是个最简单的实现方式。
panel选择使用dashboard list;
选择search;
设置最大展示数量;
选择展示dashboard所在位置。

还有一个设置方式是选择Text的panel自己编写markdown或者html可以显示更灵活的设置。

image