Release Notes
Announcements
Security Announcements
Title | Metric | Unit | Description |
Delta data handled by compaction | Cumulative | rowsets | Amount of delta data handled by cumulative compaction |
| Base | rowsets | Amount of delta data handled by base compaction |
| Update | rowsets | Amount of delta data handled by update compaction |
Data handled by compaction | Cumulative | bytes | Amount of data handled by cumulative compaction |
| Base | bytes | Amount of data handled by base compaction |
| Update | bytes | Amount of data handled by update compaction |
Maximum compaction score of tablet | CumulativeMax | score | Maximum cumulative compaction score of tablet |
| BaseMax | score | Maximum base compaction score of tablet |
Engine request failure statistics (1) | base_compaction | count | Number of failed engine requests of base_compaction type |
| clone | count | Number of failed engine requests of clone type |
| create_rollup | count | Number of failed engine requests of create_rollup type |
| create_tablet | count | Number of failed engine requests of create_tablet type |
| cumulative_compaction | count | Number of failed engine requests of cumulative_compaction type |
| delete | count | Number of failed engine requests of delete type |
| finish_task | count | Number of failed engine requests of finish_task type |
Engine request failure statistics (2) | publish | count | Number of failed engine requests of publish type |
| report_all_tablets | count | Number of failed engine requests of report_all_tablets type |
| report_disk | count | Number of failed engine requests of report_disk type |
| report_tablet | count | Number of failed engine requests of report_tablet type |
| report_task | count | Number of failed engine requests of report_task type |
| schema_change | count | Number of failed engine requests of schema_change type |
Engine request statistics (1) | base_compaction | count | Number of failed engine requests of base_compaction type |
| clone | count | Number of failed engine requests of clone type |
| create_rollup | count | Number of failed engine requests of create_rollup type |
| create_tablet | count | Number of failed engine requests of create_tablet type |
| cumulative_compaction | count | Number of failed engine requests of cumulative_compaction type |
| delete | count | Number of failed engine requests of delete type |
| drop_tablet | count | Number of failed engine requests of drop_tablet type |
| finish_task | count | Number of failed engine requests of finish_task type |
Engine request statistics (2) | publish | count | Number of failed engine requests of publish type |
| report_all_tablets | count | Number of failed engine requests of report_all_tablets type |
| report_disk | count | Number of failed engine requests of report_disk type |
| report_tablet | count | Number of failed engine requests of report_tablet type |
| report_task | count | Number of failed engine requests of report_task type |
| schema_change | count | Number of failed engine requests of schema_change type |
| storage_migrate | count | Number of failed engine requests of storage_migrate type |
Fragment statistics | PlanFragment | count | Number of plan fragments |
| Endpoint | count | Number of DataStreams |
Fragment request duration | Duration | μs | Fragment request duration |
Transaction request statistics | begin | count | Number of transaction requests of begin type |
| commit | count | Number of transaction requests of commit type |
| exec | count | Number of transaction requests of exec type |
| rollback | count | Number of transaction requests of rollback type |
Data imported by streaming load | LoadTotal | bytes | Amount of data imported by streaming load |
Streaming load statistics | CurrentProcessing | count | Number of existing streaming load processes |
| PipeCount | count | Number of streaming load pipes |
Streaming load duration | Duration | ms | Streaming load duration |
BE memory | Total | bytes | Size of BE memory pool |
| Allocated | bytes | Size of allocated BE memory |
Process file handles | Used | count | Number of file handles used by BE process |
| SoftLimit | count | Soft limit on file handles for BE process |
| HardLimit | count | Hard limit on file handles for BE process |
Running threads in process | Thread | count | Number of threads running in BE process |
Used thrifts | Broker | count | Number of thrifts used by broker |
| Backend | count | Number of thrifts used by BE |
| Frontend | count | Number of thrifts used by FE |
Tablet write statistics | Writer | count | Statistics of tablet writes on BE |
Maximum compaction score of tablet | UpdateMax | score | Maximum cumulative compaction score of tablet |
Total byte amount of added/removed vectors | update_del_vector_bytes | byte | Total byte amount of added/removed vectors |
Number of current added/removed vectors | update_del_vector_num | count | Number of current added/removed vectors |
Total byte amount of updated primary key indexes | update_primary_index_bytes | byte | Total byte amount of updated primary key indexes |
Number of updated primary key indexes | update_primary_index_num | count | Number of updated primary key indexes |
Total number of deleted vectors | vector_deletes_total | count | Total number of deleted vectors |
Requests of updated rowset submission | failed | count | Failed requests of updated rowset submission |
| total | count | Total requests of updated rowset submission |
Application duration of updated rowset submission | duration | us | Application duration of updated rowset submission |
Application amount of updated rowset submission | total | count | Application amount of updated rowset submission |
BE memory allocation statistics (1) | chunk_allocator_mem | byte | chunk_allocator_mem size |
| clone_mem | byte | clone_mem size |
| column_pool_mem | byte | column_pool_mem size |
| compaction_mem | byte | compaction_mem size |
| consistency_mem | byte | consistency_mem size |
| load_mem | byte | load_mem size |
BE memory allocation statistics (2) | query_mem | byte | query_mem size |
| schema_change_mem | byte | schema_change_mem size |
| storage_page_cache_mem | byte | storage_page_cache_mem size |
| metadata_mem | byte | metadata_mem size |
| update_mem | byte | update_mem size |
PIP Execution Thread Queue Length | pip_exe_driver | byte | pip_exe_driver queue length |
| pip_exe_poller_block | byte | pip_exe_poller_block queue length |
| wg_pip_exe_driver | byte | wg_pip_exe_driver queue length |
| wg_pip_exe_poller_block | byte | wg_pip_exe_poller_block queue length |
Total cumulative number of scanned rows | rows | count | Total cumulative number of scanned rows |
STREAM LOAD data volume | load_rows | count | load_rows data volume |
Bytes scanned per second | query_scan_bytes | byte | Bytes scanned per second |
Number of metadata requests | write | count | Number of metadata write requests |
| read | count | Number of metadata read requests |
Duration of metadata requests | write | us | Duration of metadata write requests |
| read | us | Duration of metadata read requests |
Number of push requests | success | count | Number of successful push requests |
| fail | count | Number of failed push requests |
Disk data used capacity | used_capacity | byte | Disk usage |
disk status | disks_state | 1: normal 0: abnormal | disk status |
memory statistics | process | bytes | process memory usage |
| datacache | bytes | datacache memory usage |
| jit_cache | bytes | jit cache memory usage |
Metadata memory statistics | tablet | bytes | tablet metadata memory usage |
| rowset | bytes | rowset metadata memory usage |
| segment | bytes | segment metadata memory usage |
| column | bytes | column metadata memory usage |
Tablet Metadata memory statistics | tablet_schema | bytes | tablet schema memory usage |
Segment Metadata memory statistics | segment_zonemap | bytes | segment zonemap memory usage |
| short_key_index | bytes | short key index memory usage |
Column Metadata memory statistics | bitmap_index | bytes | bitmap cache memory usage |
| bf_index | bytes | bloom filter index cache memory usage |
| zonemap_index | bytes | column zonemap cache memory usage |
| ordinal_index | bytes | Memory usage of the ordinal index cache |
Column Pool memory statistics | binary | bytes | binary column pool memory usage |
| uint8 | bytes | uint8 column pool memory usage |
| int8 | bytes | int8 column pool memory usage |
| int16 | bytes | int16 column pool memory usage |
| int32 | bytes | int32 column pool memory usage |
| int64 | bytes | int64 column pool memory usage |
| int128 | bytes | int128 column pool memory usage |
| float | bytes | float column pool memory usage |
| double | bytes | double column pool memory usage |
| decimal | bytes | decimal column pool memory usage |
| date | bytes | date column pool memory usage |
| datetime | bytes | datetime column pool memory usage |
Result Block | block_count | Count | Number of blocks in the result cache |
| queue_count | Count | Number of results in the queue |
Publish latency | publish_latency | ms | publish latency |
Publish QPS | publish_qps | Count/s | publish QPS |
data recovery QPS | move_trash_qps | Count/s | data recovery QPS |
data recovery delay | latency_avg | ms | average data recovery delay |
| latency_80 | ms | 80th percentile data recovery delay |
| latency_99 | ms | 99th percentile data recovery delay |
Number of rowsets | unused | Count | total number of inactive rowsets |
| in_use | Count | number of active rowsets |
Delta Column Group statistics | get_non_pk | Count | Number of times to retrieve delta column groups for non-primary key tables |
| get_pk | Count | Number of times to retrieve delta column groups for primary key tables |
Delta Column Group Cache hit statistics | non_pk_hit | Count | Number of hits for delta column group cache in non-primary key tables |
| pk_hit | Count | Number of hits for delta column group cache in primary key tables |
Partial Update Apply duration | duration | us | Partial Update (column mode) APPLY task time |
Partial Update Apply count | count | Count | Partial Update (column mode) APPLY count |
Delta Writer waiting duration | wait_replica | us | delta writer waiting for replica synchronization duration |
| wait_writer | us | delta writer waiting for flush synchronization duration |
Segment open count | open_segments | Count | segment open frequency per minute |
| open_segments_io | Count | number of IO tasks generated per minute by opening segments |
Stream Load request | requests | Count | Number of Stream Load requests per second |
Transaction Stream Load data import volume | load_bytes | bytes | Number of bytes imported via Stream Load transaction interface |
Transaction Stream Load import duration | load_duration | ms | The time when the transaction was imported |
Number of Transaction Stream Load tasks | current_processing | Count | Number of currently running Transaction Stream Load tasks |
Transaction Stream Load request | load_requests | Count | Number of Transaction Stream Load requests per second |
Memtable Flush count | flush_count | Count/s | Memtable Flush count |
Memtable Flush size | flush_memory | bytes | Memtable Flush memory size |
| flush_disk | bytes | Memtable Flush disk size |
Memtable Flush duration | flush_io | us | Memtable Flush IO duration |
| flush_duration | us | Memtable Flush duration |
| finalize_duration | us | Memtable Flush finalize duration |
Segment Flush size | flush_bytes | bytes | Segment Flush data size |
Segment Flush count | flush_count | Count/s | Segment Flush count |
Segment Flush duration | flush_duration | us | Segment Flush duration |
| flush_io_duration | us | Segment Flush IO duration |
Primary key table Compaction count | outputs_count | Count/s | Primary key table Compaction count |
Primary key table Compaction write data volume | outputs_bytes | bytes | Number of bytes written during primary key table Compaction |
Primary key table Compaction duration | duration | us | Time taken for primary key table Compaction task |
Number of Routine Load tasks | tasks | Count | Number of running Routine Load tasks |
Spark Load write rate | write_bytes | bytes/s | Spark Load write rate |
Maximum number of rowsets per Tablet | rowset_nums | Count | Maximum number of rowsets per tablet |
Load RPC thread pool size | size | Count | Load RPC thread pool size |
Number of Load channels | count | Count | Number of channels |
Add Chunks duration | duration | us | add chunks duration |
| wait_memtable | us | add chunks wait for memtable duration |
| wait_replica | us | add chunks wait for replica duration |
| wait_writer | us | add chunks wait for write time consumed |
Add Chunks times | count | Count/s | add chunks times |
fragment request count | count | Count/s | Cumulative execution count of Fragment instances (non-Pipeline Engine) |
data import volume | load_bytes | bytes | Total imported bytes |
Number of rows imported | load_rows | Count | Total rows imported |
Number of Async Delta Writer executions | async_delta_writer | Count | Number of async delta writer executions |
Async Delta Writer Task execution time | execute | us | async delta writer task execution time |
| pending | us | async delta writer task waiting time |
Number of Async Delta Writer Task executions | count | Count | Number of async delta writer task executions |
Partial Update Apply thread pool duration | pending_time | ns | update apply thread pool queuing time |
| execute_time | ns | update apply thread pool task execution duration |
Update Apply thread pool task | executed_tasks | Count/s | update apply thread pool executed task count |
| queue_count | Count | update apply thread pool queued task count |
Update Apply thread pool size | active_threads | Count | update apply thread pool active thread count |
| running_threads | Count | update apply thread pool liveness thread count |
| threadpool_size | Count | update apply thread pool size |
Segment Replicate thread pool duration | pending_time | ns | segment replicate thread pool queuing time |
| execute_time | ns | segment replicate thread pool task execution duration |
Segment Replicate thread pool task | executed_tasks | Count/s | segment replicate thread pool executed task count |
| queue_count | Count | number of queued tasks in segment replicate thread pool |
Segment Replicate thread pool size | active_threads | Count | Number of active threads in segment replicate thread pool |
| running_threads | Count | Number of live threads in segment replicate thread pool |
| threadpool_size | Count | segment replicate thread pool size |
Segment Flush thread pool duration | pending_time | ns | segment flush thread pool queuing time |
| execute_time | ns | segment flush thread pool task execution duration |
Segment Flush thread pool task | executed_tasks | Count/s | segment flush thread pool executed task count |
| queue_count | Count | number of queued tasks in segment flush thread pool |
Segment Flush thread pool size | active_threads | Count | Number of active threads in segment flush thread pool |
| running_threads | Count | Number of live threads in segment flush thread pool |
| threadpool_size | Count | segment flush thread pool size |
Publish Version thread pool duration | pending_time | ns | publish version thread pool queuing time |
| execute_time | ns | publish version thread pool task execution duration |
Publish Version thread pool task | executed_tasks | Count/s | publish version thread pool executed task count |
| queue_count | Count | publish version thread pool queued task count |
Publish Version thread pool size | active_threads | Count | publish version thread pool active thread count |
| running_threads | Count | publish version thread pool liveness thread count |
| threadpool_size | Count | publish version thread pool size |
Primary Index Compaction thread pool duration | pending_time | ns | primary index compaction thread pool queuing time |
| execute_time | ns | primary index compaction thread pool task execution duration |
Primary Index Compaction thread pool tasks | executed_tasks | Count/s | primary index compaction thread pool executed task count |
| queue_count | Count | number of queued tasks in the primary index compaction thread pool |
Primary Index Compaction thread pool size | active_threads | Count | number of active threads in the primary index compaction thread pool |
| running_threads | Count | number of live threads in the primary index compaction thread pool |
| threadpool_size | Count | primary index compaction thread pool size |
Memtable Flush thread pool duration | pending_time | ns | memtable flush thread pool queuing time |
| execute_time | ns | memtable flush thread pool task execution duration |
Memtable Flush thread pool task | executed_tasks | Count/s | memtable flush thread pool executed task count |
| queue_count | Count | memtable flush thread pool number of queued tasks |
Memtable Flush thread pool size | active_threads | Count | Number of active threads in memtable flush thread pool |
| running_threads | Count | Number of live threads in memtable flush thread pool |
| threadpool_size | Count | memtable flush thread pool size |
Lake Memtable Flush thread pool duration | pending_time | ns | lake memtable flush thread pool queuing time |
| execute_time | ns | lake memtable flush thread pool task execution duration |
Lake Memtable Flush thread pool task | executed_tasks | Count/s | lake memtable flush thread pool executed task count |
| queue_count | Count | lake memtable flush thread pool number of queued tasks |
Lake Memtable Flush thread pool size | active_threads | Count | lake memtable flush thread pool active thread count |
| running_threads | Count | Number of live threads in lake memtable flush thread pool |
| threadpool_size | Count | lake memtable flush thread pool size |
Async Delta Writer thread pool duration | pending_time | ns | async delta writer thread pool queuing time |
| execute_time | ns | async delta writer thread pool task execution duration |
Async Delta Writer thread pool task | executed_tasks | Count/s | async delta writer thread pool executed task count |
| queue_count | Count | async delta writer thread pool number of queued tasks |
Async Delta Writer thread pool size | active_threads | Count | async delta writer thread pool active thread count |
| running_threads | Count | async delta writer thread pool liveness thread count |
| threadpool_size | Count | async delta writer thread pool size |
Total number of generated DELETE vectors in primary key table | new_delete_vector | Count | Total number of generated DELETE vectors in primary key table |
Query Cache utilization | usage_ratio | % | query cache usage |
Query Cache size | capacity | bytes | query cache capacity |
| usage | bytes | query cache usage |
Query Cache hit rate | hit_ratio | % | query cache hit rate |
Query Cache count | lookup | Count | query cache count |
| hit | Count | query cache hit count |
Page Cache count | lookup | Count | page cache query count |
| hit | Count | page cache hit count |
Page Cache capacity | capacity | bytes | page cache capacity |
Meta request duration | read | us | Metadata read duration |
| write | us | Metadata write duration |
Meta requests | read | Count | Number of metadata read requests |
| write | Count | Number of metadata write requests |
Brpc endpoint stub count | count | Count | Total number of bRPC stubs (by host address) |
Pipeline Driver duration | driver_execution_time | ns | PipelineDriver Executor handles PipelineDriver time |
Pipeline statistics | query_ctx_cnt | Count | Total number of running queries |
| driver_queue_len | Count | The number of Ready Drivers pending scheduling in BE |
| driver_schedule_count | Count | Scheduling count of Pipeline Executor Drivers in BE |
| pipe_drivers | Count | Current total number of drivers in BE |
| poller_block_queue_len | Count | Current length of the PipelineDriverPoller Block queue |
| perpare_pool_queue_len | Count | Number of queued tasks in the Pipeline Prepare thread pool |
| scan_executor_queuing | Count | Number of async I/O tasks triggered by Scan Operator pending execution |
PID | pid | None | process ID |
process CPU usage | usage | % | CPU Utilization |
| system_usage | % | system CPU usage |
| user_usage | % | user CPU usage |
Disk Usage Statistics | read | bytes/s | Number of bytes read from disk per second |
| write | bytes/s | Bytes written to disk per second |
Process FD Statistics | fd_count | Count | Number of file descriptors used by the process |
Total number of threads | thread_count | Count | Number of threads |
Process start time | uptime | s | Process uptime |
Maximum Disk IO Usage | io_util | % | Maximum Disk Usage Percentage |
Jemalloc memory | allocated | bytes | Jemalloc allocated bytes |
Disk I/O time | io_time | ms | IO Operation Time |
Resource group CPU | in_use_cores | Count | Estimated number of CPU cores in use per resource group |
Resource group limit exceeded | overflow_count | Count | Number of queries triggering concurrency limit per resource group (instantaneous value) |
Resource group query | bigquery_count | Count | Number of queries triggering large query limit per resource group (instantaneous value) |
network transmission statistics | send | bytes/s | Network Bytes Sent |
| receive | bytes/s | Network Bytes Received |
CPU utilization | ProcessCpuLoad | % | CPU utilization |
GC count | YGC | Count | Young GC count |
| FGC | Count | Full GC count |
GC time | FGCT | s | Full GC consumption time |
| GCT | s | Garbage collection consumption time |
| YGCT | s | Young GC consumption time |
Memory zone proportion | S0 | % | Percentage of used Survivor 0 memory |
| E | % | Percentage of used Eden memory |
| CCS | % | Percentage of used compressed class space memory |
| S1 | % | Percentage of used Survivor 1 memory |
| O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
JVM memory | MemHeapUsedM | Mbytes | Used heap memory |
| MemNonHeapUsedM | Mbytes | Used off-heap memory |
| MemHeapCommittedM | Mbytes | Committed heap memory |
| MemNonHeapCommittedM | Mbytes | Committed off-heap memory |
| MemHeapMaxM | Mbytes | Maximum heap memory |
| MemHeapInitM | Mbytes | Initial heap memory |
| MemNonHeapInitM | Mbytes | Initial off-heap memory |
Number of file handles | MaxFileDescriptorCount | Count | Maximum number of file descriptors |
| OpenFileDescriptorCount | Count | Number of open file descriptors |
Number of JVM threads | PeakThreadCount | Count | Peak thread count |
| ThreadCount | Count | Thread count |
| DaemonThreadCount | Count | Daemon thread count |
Txn Log Cache Hit Or Miss | hit | Count/min | Number of hits per minute for txn log cache |
| miss | Count/min | Number of misses per minute for txn log cache |
Segment Cache Hit Or Miss | hit | Count/min | Number of hits per minute for segment cache |
| miss | Count/min | Number of misses per minute for segment cache |
FSLIB Cache Hit Or Miss | hits | Count/s | CACHEFS hit count |
| misses | Count/s | CACHEFS miss count |
FSLIB Cache size | meta_memory_size | bytes | FSLIB starcache metadata amount of memory used |
| data_memory_size | bytes | FSLIB starcache data amount of memory used |
| data_disk_size | bytes | FSLIB starcache space occupied by data |
Currently processing transactional stream load in begin state | begin | Count | Currently processing transactional stream load in begin state |
txn_stream_load_begin request duration | latency | ms | txn_stream_load_begin request duration |
DataCache hit rate | rate | % | DataCache hit rate history |
DataCache hit rate | last_minute_rate | % | DataCache hit rate in the past minute |
DataCache number of bytes accessed in the past minute | hit | bytes | DataCaches number of bytes hit in the past minute |
DataCache number of bytes accessed in the past minute | miss | bytes | DataCaches number of bytes missed in the past minute |
Title | Metric | Unit | Description |
ALTER job statistics | RollupRunning | count | Number of running alter jobs of rollup type |
| SchemaChangeRunning | count | Number of running alter jobs of schema_change type |
Image statistics | Write | count | Number of image writes on FE |
| Push | count | Number of image pushes on FE |
Scheduled tablets | ScheduledTablet | count | Number of scheduled tablets on FE |
Transaction status statistics | Reject | count | Number of rejected transactions on FE |
| Begin | count | Number of started transactions on FE |
| Success | count | Number of successful transactions on FE |
| Failed | count | Number of failed transactions on FE |
Heap memory in JVM | max | bytes | Maximum amount of heap memory |
| committed | bytes | Amount of committed heap memory |
| used | bytes | Amount of used heap memory |
Non-heap memory in JVM | committed | bytes | Amount of committed non-heap memory |
| used | bytes | Amount of used non-heap memory |
Old memory in JVM | used | bytes | Amount of used old memory |
| peak_used | bytes | Maximum amount of used old memory |
| max | bytes | Maximum amount of old memory |
Young memory in JVM | used | bytes | Amount of used young memory |
| peak_used | bytes | Maximum amount of used young memory |
| max | bytes | Maximum amount of young memory |
FE memory | Delete_DeleteMgr | bytes | DeleteMgr memory usage (here should be the memory actually used by the corresponding class, not Mgr memory, the corresponding module should add up ALL classes) |
| Agent_AgentTaskTracker | bytes | AgentTask memory usage |
| Load_InsertOverwriteJobMgr | bytes | InsertOverwriteJobMgr memory usage |
| Load_LoadMgr | bytes | LoadMgr memory usage |
| Load_RoutineLoadMgr | bytes | RoutineLoadMgr memory usage |
| Load_StreamLoadMgr | bytes | StreamLoadMgr memory usage |
| Task_TaskManager | bytes | TaskManager memory usage |
| Task_TaskRunManager | bytes | TaskRunManager memory usage |
| Query_QueryTracker | bytes | QueryTracker memory usage |
| Report_ReportHandler | bytes | ReportHandler memory usage |
| Backup_BackupHandler | bytes | BackupHandler memory usage |
| Compaction_CompactionMgr | bytes | CompactionMgr memory usage |
| Coordinator_QeProcessorImpl | bytes | QeProcessorImpl memory usage |
| CachedStatisticStorage | bytes | CachedStatisticStorage memory usage |
| Profile_ProfileManager | bytes | ProfileManager memory usage |
| TabletInvertedIndex | bytes | TabletInvertedIndex memory usage |
| Transaction_GlobalTransactionMgr | bytes | GlobalTransactionMgr memory usage |
| Dict_CacheDictManager | bytes | CacheDictManager memory usage |
| Export_ExportMgr | bytes | ExportMgr memory usage |
| LocalMetastore_LocalMetastore | bytes | LocalMetastore memory usage |
Heap memory utilization | MemHeapUsedRate | % | Heap memory utilization |
FE object statistics | Delete_DeleteMgr_DeleteInfo | Count | Number of DeleteInfo objects |
| Delete_DeleteMgr_DeleteJob | Count | Number of DeleteJob objects |
| Agent_AgentTaskTracker_AgentTask | Count | Number of AgentTask objects |
| insertOverwriteJobs | Count | Number of insertOverwriteJobs objects |
| Load_LoadMgr_LoadJob | Count | Number of LoadJob objects |
| Load_RoutineLoadMgr_RoutineLoad | Count | Number of RoutineLoad objects |
| Load_StreamLoadMgr_StreamLoad | Count | Number of StreamLoad objects |
| Task_TaskManager_Task | Count | Number of Task objects |
| Task_TaskRunManager_PendingTaskRun | Count | Number of PendingTaskRun objects |
| Task_TaskRunManager_RunningTaskRun | Count | Number of RunningTaskRun objects |
| Task_TaskRunManager_HistoryTaskRun | Count | Number of HistoryTaskRun objects |
| Query_QueryTracker_QueryDetail | Count | Number of QueryDetail objects |
| Report_ReportHandler_PendingTask | Count | Number of PendingTask objects |
| Report_ReportHandler_ReportQueue | Count | Number of ReportQueue objects |
| Backup_BackupOrRestoreJob | Count | Number of BackupOrRestoreJob objects |
| Compaction_PartitionStats | Count | Number of PartitionStats objects |
| Coordinator_QueryCoordinator | Count | Number of QueryCoordinator objects |
| Statistics_TableStats | Count | Number of TableStats objects |
| Statistics_ColumnStats | Count | Number of ColumnStats objects |
| Statistics_PartitionStats | Count | Number of PartitionStats objects |
| Statistics_HistogramStats | Count | Number of HistogramStats objects |
| Statistics_ConnectorTableStats | Count | Number of ConnectorTableStats objects |
| Statistics_ConnectorHistogramStats | Count | Number of ConnectorHistogramStats objects |
| Profile_ProfileManager_QueryProfile | Count | Number of QueryProfile objects |
| Profile_ProfileManager_LoadProfile | Count | Number of LoadProfile objects |
| TabletInvertedIndex_TabletMeta | Count | Number of TabletMeta objects |
| TabletInvertedIndex_TabletCount | Count | Number of TabletCount objects |
| TabletInvertedIndex_ReplicateCount | Count | Number of ReplicateCount objects |
| Transaction_Txn | Count | Number of Txn objects |
| Transaction_TxnCallbackCount | Count | Number of TxnCallbackCount objects |
| Dict_CacheDictManager_ColumnDict | Count | Number of ColumnDict objects |
| Export_ExportMgr_ExportJob | Count | Number of ExportJob objects |
| LocalMetastore_Partition | Count | Number of Partition objects |
Number of http requests currently processing in FE | http_handle | Count | Number of http requests currently processing in FE |
FE query statistics | analysis_error | Count | Total number of errors in query resolution stage |
FE query statistics | internal_err | Count | Total number of internal errors in query execution |
Short-circuit RPC | shortcircuit_rpc | Count | Total count of RPCs sent for short-circuit queries. |
Number of established http connections | http_connect | Count | Number of established http connections |
Number of incomplete backup tasks | unfinished_backup_job | Count | Number of running BACKUP tasks in the warehouse. For integrated storage-compute clusters, this item only monitors the Default Warehouse. For storage-compute separation clusters, the value is always 0. |
Number of incomplete recovery tasks | unfinished_restore_job | Count | Number of running RESTORE tasks in the warehouse. For integrated storage-compute clusters, this item only monitors the Default Warehouse. For storage-compute separation clusters, the value is always 0. |
Short-circuit query count | shortcircuit_query | Count | Short-circuit query count. |
Deployment scheme video clip delay | latency | ms | fe transmits the total delay of query execution fragments to backend |
Deployment scheme video clip count | count | Count | fe transmits the total number of query execution fragments to backend |
query queue | pending | Count | Number of queries waiting in the query queue |
| slot_pending | Count | Total number of pending allocation query slots |
| slot_running | Count | Total count of physical slots occupied by all currently executed queries (slot is the resource allocation unit) |
| num | Count | Total number of historical queries entered the queue |
| timeout_num | Count | Total number of historical queries timed out in queue |
Currently processing transactional stream load in begin state | begin | Count | Currently processing transactional stream load in begin state |
Currently processing transactional stream load in prepare state | prepare | Count | Currently processing transactional stream load in prepare state |
Currently processing transactional stream load in rollback state | rollback | Count | Currently processing transactional stream load in rollback state |
Currently processing transactional stream load in load state | load | Count | Currently processing transactional stream load in load state |
Currently processing transactional stream load in commit state | commit | Count | Currently processing transactional stream load in commit state |
metadata log write to batch size | batch | Count | Journal log write to batch size |
metadata log written bytes | bytes | Bytes | Journal log written bytes |
metadata log write latency | latency | ms | Journal log write latency |
metadata log write operations | count | Count | Journal log write batch count |
Load count statistics | load_add | Count | Total number of load tasks. |
| load_finished | Count | Total number of ALL successfully completed load tasks |
RPC Count | rpc_backend | Count | Total number of brpc sent from fe to backend |
| brpc_lake | Count | Total number of brpc sent from fe to lake |
| brpc_total | Count | Total fe brpc calls |
RPC Plan Count | rpc_plan | Count | Number of executed fragments in brpc sent from fe to backend |
| rpc_plan_err | Count | Number of failed fragments in brpc sent from fe to backend |
RPC connection pool | active | Count | Number of active connections in the connection pool |
| idle | Count | Number of idle connections |
| wait | Count | Number of threads waiting to obtain connections |
| borrow | Count | Total number of connections borrowed from the connection pool (cumulative) |
| return | Count | Total number of connections returned to the connection pool (cumulative) |
| create | Count | Total number of connections created in the connection pool (cumulative) |
| destroyed | Count | Total number of connections terminated in the connection pool (cumulative) |
| active_time_mean | ms | Average time from borrowing to returning a connection object in the connection pool |
| idle_time_mean | ms | Average time a connection object remains in idle state in the connection pool |
| borrow_time_mean | ms | Average waiting time for a thread to get a connection from the connection pool |
Number of tasks waiting in http queue | http_pending_task | Count | Number of tasks in HTTP queue waiting Tips: Available only when Config.enable_http_detail_metrics is enabled, because retrieving this metric may be relatively expensive. |
Number of http worker threads | http_works | Count | Number of http worker threads |
http request processing time | latency_75 | ms | http request processing time (75th percentile) |
| latency_95 | ms | http request processing time (95th percentile) |
| latency | ms | http request processing time |
| count | Count | http request count |
JVM Memory Direct | used | Bytes | jvm direct Buffer Used Memory |
| capacity | Bytes | jvm direct Buffer Memory Capacity |
DB Num | db_num | Count | Total Number of Databases |
Routine Load Jobs | UNSTABLE | Count | The number of unstable routine_load_jobs (A kafka RoutineLoad partition is unstable if the delay in message consumption exceeds routine_load_unstable_threshold_second. Used to monitor data backlog). |
Alive CN Node | CnAliveNum | Count | Liveness cn node count |
Running Collect Job | running_collect_job | Count | Number of currently running jobs used to collect information |
Failed Collect Job | failed_collect_job | Count | Number of failed statistical information tasks |
txn_stream_load_begin request duration | latency | ms | txn_stream_load_begin request duration |
txn_stream_load_commit request duration | latency_75 | ms | txn_stream_load_commit request duration 75th percentile |
| latency_95 | ms | txn_stream_load_commit request duration 95th percentile |
| latency | ms | txn_stream_load_commit request duration |
txn_stream_load_load request duration | latency_75 | ms | txn_stream_load_load request duration 75th percentile |
| latency_95 | ms | txn_stream_load_load request duration 95th percentile |
| latency | ms | txn_stream_load_load request duration |
txn_stream_load_prepare request duration | latency_75 | ms | txn_stream_load_prepare request duration 75th percentile |
| latency_95 | ms | txn_stream_load_prepare request duration 95th percentile |
| latency | ms | txn_stream_load_prepare request duration |
txn_stream_load_rollback request duration | latency | ms | txn_stream_load_rollback request duration |
Starmgr metadata log replay count | replay_ops | Count | metadata log replay count |
Starmgr asynchronous write metadata log bytes | write_async_bytes | Bytes | asynchronous write metadata log bytes |
Starmgr asynchronous write metadata log count | write_async_ops | Count | asynchronous write metadata log count |
Starmgr synchronous write metadata log bytes | write_bytes | Bytes | synchronous write metadata log bytes |
Starmgr synchronous write metadata log count | write_ops | Count | synchronous write metadata log count |
Starmgr sharding update log count | log_update_shards_num | Count | Number of shards for log updates |
Starmgr sharding operation count | log_update_shards_ops | Count | Log update operation count |
SNMP | tcp_retrans_segs | Count | tcp retransmission packet |
| tcp_in_errs | Count | ALL incorrect tcp packets |
| tcp_in_segs | Count | ALL received tcp packets |
| tcp_out_segs | Count | ALL sent tcp packets |
Is Safe Mode enabled? | safe_mode | None | Is Safe Mode enabled? Value: 0 (disabled) or 1 (enabled). When enabled, the cluster no longer accepts any data import requests. disk remaining less than 10% or 50GB. |
Total CN Node | CnNodeNum | Count | ALL cn node count |
Total Collect Job | total_collect_job | Count | Number of tasks to collect statistics |
Txn Running | txn_running | Count | dynamic metric each running transactional fe in the library |
Table Num | table_num | Count | dynamic metric number of tables in each library |
ROUTINE LOAD queue size | report queue | count | FE report queue size |
Routine load rows | TotalRows | count | Number of FE routine load rows |
| ErrorRows | count | Number of FE routine load error rows |
Routine load size | Receive | bytes | Size of FE routine load |
Maximum compaction score of tablet | MAX | score | Maximum compaction score of FE tablet |
EditLog write latency | Quantile75 | ms | 75th percentile of the FE EditLog write latency |
| Quantile95 | ms | 95th percentile of the FE EditLog write latency |
| Quantile98 | ms | 98th percentile of the FE EditLog write latency |
| Quantile99 | ms | 99th percentile of the FE EditLog write latency |
| Quantile999 | ms | 99.9th percentile of the FE EditLog write latency |
GC count | YoungGC | count | FE node JVM Young GC count |
| OldGC | count | FE node JVM Old GC count |
GC time | YoungGC | Sec | FE node JVM Young GC time |
| OldGC | Sec | FE node JVM Old GC time |
JVM threads | Total | count | Total number of threads in the JVM of the FE node |
| Peak | count | Peak number of threads in the JVM of the FE node |
BROKER load job statistics | UNKNOWN | count | Number of load jobs of BROKER type in UNKNOWN status |
| PENDING | count | Number of load jobs of BROKER type in PENDING status |
| ETL | count | Number of load jobs of BROKER type in ETL status |
| LOADING | count | Number of load jobs of BROKER type in LOADING status |
| COMMITTED | count | Number of load jobs of BROKER type in COMMITTED status |
| FINISHED | count | Number of load jobs of BROKER type in FINISHED status |
| CANCELLED | count | Number of load jobs of BROKER type in CANCELLED status |
DELETE load job statistics | UNKNOWN | count | Number of load jobs of DELETE type in UNKNOWN status |
| PENDING | count | Number of load jobs of DELETE type in PENDING status |
| ETL | count | Number of load jobs of DELETE type in ETL status |
| LOADING | count | Number of load jobs of DELETE type in LOADING status |
| COMMITTED | count | Number of load jobs of DELETE type in COMMITTED status |
| FINISHED | count | Number of load jobs of DELETE type in FINISHED status |
| CANCELLED | count | Number of load jobs of DELETE type in CANCELLED status |
HADOOP load job statistics | UNKNOWN | count | Number of load jobs of HADOOP type in UNKNOWN status |
| PENDING | count | Number of load jobs of HADOOP type in PENDING status |
| ETL | count | Number of load jobs of HADOOP type in ETL status |
| LOADING | count | Number of load jobs of HADOOP type in LOADING status |
| COMMITTED | count | Number of load jobs of HADOOP type in COMMITTED status |
| FINISHED | count | Number of load jobs of HADOOP type in FINISHED status |
| CANCELLED | count | Number of load jobs of HADOOP type in CANCELLED status |
INSERT load job statistics | UNKNOWN | count | Number of load jobs of INSERT type in UNKNOWN status |
| PENDING | count | Number of load jobs of INSERT type in PENDING status |
| ETL | count | Number of load jobs of INSERT type in ETL status |
| LOADING | count | Number of load jobs of INSERT type in LOADING status |
| COMMITTED | count | Number of load jobs of INSERT type in COMMITTED status |
| FINISHED | count | Number of load jobs of INSERT type in FINISHED status |
| CANCELLED | count | Number of load jobs of INSERT type in CANCELLED status |
Routine load job statistics | NEED_SCHEDULE | count | Number of routine load jobs in NEED_SCHEDULE status |
| RUNNING | count | Number of routine load jobs in RUNNING status |
| PAUSED | count | Number of routine load jobs in PAUSED status |
| STOPPED | count | Number of routine load jobs in STOPPED status |
| CANCELLED | count | Number of routine load jobs in CANCELLED status |
SPARK load job statistics | UNKNOWN | count | Number of load jobs of SPARK type in UNKNOWN status |
| PENDING | count | Number of load jobs of SPARK type in PENDING status |
| ETL | count | Number of load jobs of SPARK type in ETL status |
| LOADING | count | Number of load jobs of SPARK type in LOADING status |
| COMMITTED | count | Number of load jobs of SPARK type in COMMITTED status |
| FINISHED | count | Number of load jobs of SPARK type in FINISHED status |
| CANCELLED | count | Number of load jobs of SPARK type in CANCELLED status |
FE MASTER | FE Master | count | Whether it is the FE master. Valid values: 1: Master; 0: Follower. |
Node information | FeNodeNum | count | Total number of FE nodes |
| BeNodeNum | count | Total number of BE nodes |
| BeAliveNum | count | Number of live BE nodes |
| BeDecommissionedNum | count | Number of live BE nodes |
| BkDeadNum | count | Number of dead broker nodes |
Request response | QPS | count/s | Number of queries per second |
| RPS | count/s | Number of requests that can be processed per second |
FE query statistics | total | count | Total number of FE queries |
| err | count | Total number of FE query errors |
| timeout | count | Number of timed-out FE queries |
| success | count | Total number of successful FE queries |
| slow | count | Total number of slow FE queries |
Query failure rate | ErrRate | % | Query error rate |
FE query latency | Quantile75 | ms | 75th percentile of the FE query latency |
| Quantile95 | ms | 95th percentile of the FE query latency |
| Quantile99 | ms | 99th percentile of the FE query latency |
| Quantile999 | ms | 99.9th percentile of the FE query latency |
Connections | Num | count | Number of FE node connections |
Maximum journal id | id | count | Maximum journal id |
Number of Edit Log writes | write | count | Edit Log write operations |
Total number of materialized view refresh jobs | jobs | Count | Total number of materialized view refresh jobs |
Number of materialized view refresh jobs executed successfully | total_success_jobs | Count | Number of materialized view refresh jobs executed successfully |
Number of materialized view refresh jobs that failed to execute | total_failed_jobs | Count | Number of materialized view refresh jobs with execution failure |
Number of materialized view refresh jobs canceled due to empty data | total_empty_jobs | Count | Number of materialized view refresh jobs canceled due to empty data |
Number of times materialized view refresh jobs check for base table updates | total_retry_meta_count | Count | Number of times materialized view refresh jobs check for base table updates |
Number of times materialized view is used in query pre-processing | total_count | Count | Number of times materialized view is used in query pre-processing |
Number of times the materialized view is considered by the query plan to rewrite the current query | total_hit_count | Count | Number of times the materialized view is considered by the query plan to rewrite the current query. Since the final query plan may skip rewriting due to extremely high cost, the observed value is relatively high compared to the actual. |
Number of times materialized view rewrites queries | total_considered_count | Count | Number of times materialized view rewrites queries (excluding direct queries against materialized view) |
Number of times materialized view participates in the final query plan | total_matched_count | Count | Number of times materialized view participates in the final query plan (including direct queries against materialized view) |
Number of pending materialized view refresh jobs | pending_jobs | Count | Number of pending materialized view refresh jobs |
Number of currently executing materialized view refresh jobs | running_jobs | Count | Number of currently executing materialized view refresh jobs |
Number of rows in the materialized view | row_count | Count | Number of rows in the materialized view |
Size of the materialized view | storage_size | bytes | Size of the materialized view. Unit: Byte |
State of the materialized view | inactive_state | Count | State of the materialized view. Valid values: 0 (active) and 1 (inactive) |
Number of partitions in the materialized view | partition_count | Count | Number of partitions in the materialized view. If the materialized view is unpartitioned, the value is 0. |
Number of database transactions | Dynamic Tag | Count | Number of DB transactions in each running status |
Number of database running transactions | Dynamic Tag | Count | Number of DB transactions in running status |
Number of running transactions | Dynamic Tag | Count | Number of transactions by task type in running |
Title | Metric | Unit | Description |
CPU utilization | ProcessCpuLoad | % | Process CPU utilization |
CPU usage time | ProcessCpuTime | ms | Cumulative CPU usage time |
GC count | YGC | - | Young GC count |
| FGC | - | Full GC count |
GC time | GCT | s | Garbage collection time |
| FGCT | s | Full GC time |
| YGCT | s | Young GC time |
Memory zone proportion | O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
| CCS | % | Percentage of used compressed class space memory |
| S0 | % | Percentage of used Survivor 0 memory |
| S1 | % | Percentage of used Survivor 1 memory |
| E | % | Percentage of used Eden memory |
JVM memory | MemHeapInitM | MB | Size of initial JVM HeapMemory |
| MemNonHeapInitM | MB | Size of initial JVM NonHeapMemory |
| MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
| MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
| MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
| MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
| MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
File handles | OpenFileDescriptorCount | count | Number of opened file descriptors |
| MaxFileDescriptorCount | count | Maximum number of file descriptors |
Process execution duration | Uptime | s | Process execution duration |
Worker threads | PeakThreadCount | count | Peak number of threads |
| ThreadCount | count | Total number of threads |
| DaemonThreadCount | count | Number of Daemon threads |
Title | Metric | Unit | Description |
Publish Version QPS | qps | Count/s | publish version executions per second |
Publish Version latency | latency_avg | us | publish version average latency |
| latency_80 | us | publish version 80th percentile latency |
| latency_90 | us | publish version 90th percentile latency |
| queuing_latency_avg | us | publish version task queuing average latency |
Publish Version task | queued_tasks | Count | publish version queued task count |
| active_tasks | Count | publish version active task count |
Get Tablet Metadata QPS | qps | Count/s | get tablet metadata executions per second |
Get Tablet Metadata latency | latency_avg | us | get tablet metadata avg delay |
| latency_80 | us | get tablet metadata 80th percentile delay |
| latency_90 | us | get tablet metadata 90th percentile delay |
Get Txn Log QPS | qps | Count/s | get txn log executions per second |
Get Txn Log latency | latency_99 | us | get txn log 99th percentile delay |
| latency_avg | us | get txn log avg delay |
Put Txn Log QPS | qps | Count/s | put txn log executions per second |
Put Txn Log latency | latency_99 | us | put txn log 99th percentile delay |
| latency_avg | us | put txn log avg delay |
Metadata Cache | usage | bytes | metadata cache usage |
| capacity | bytes | metadata cache capacity |
Schema Cache | hit | Count/min | Number of hits per minute for schema cache |
| miss | Count/min | Number of misses per minute for schema cache |
Delvec Cache | hit | Count/min | Number of hits per minute for delvec cache |
| miss | Count/min | Number of misses per minute for delvec cache |
Metadata Cache Hit Or Miss | hit | Count/min | Number of hits per minute for metadata cache |
| miss | Count/min | Number of misses per minute for metadata cache |
Txn Log Cache Hit Or Miss | hit | Count/min | Number of hits per minute for txn log cache |
| miss | Count/min | Number of misses per minute for txn log cache |
Segment Cache Hit Or Miss | hit | Count/min | Number of hits per minute for segment cache |
| miss | Count/min | Number of misses per minute for segment cache |
Vacuum thread pool task | active_tasks | Count | Number of active tasks in the vacuum thread pool |
| queued_tasks | Count | Number of queued tasks in the vacuum thread pool |
DeleteFile thread pool task | active_tasks | Count | Number of active tasks in the deletefile thread pool |
| queued_tasks | Count | Number of queued tasks in the deletefile thread pool |
Vacuum Del File delay | latency_avg | us | vacuum delete file average delay |
| latency_80 | us | vacuum delete file 80th percentile delay |
| latency_99 | us | vacuum delete file 99th percentile delay |
Vacuum Del File QPS | qps | Count/s | vacuum delete files executions per second |
Vacuum Del File number of failures | fails | Count | vacuum Del File failure count |
Vacuum Delete Txnlog latency | latency_avg | us | vacuum Delete txnlog average delay |
| latency_80 | us | vacuum Delete txnlog 80th percentile delay |
| latency_99 | us | vacuum Delete txnlog 99th percentile delay |
Vacuum Delete Txnlog QPS | qps | Count/s | vacuum delete txnlog executions per second |
Metadata Travel latency | latency_avg | us | metadata travel avg delay |
| latency_80 | us | metadata travel 80th percentile delay |
| latency_99 | us | metadata travel 99th percentile delay |
Metadata Travel QPS | qps | Count/s | metadata travel executions per second |
Load primary key index delay | latency_avg | us | Load primary key index average delay |
| latency_80 | us | Load primary key index 80th percentile delay |
| latency_99 | us | Load primary key index 99th percentile delay |
Load primary key index QPS | qps | Count/s | Load primary key index executions per second |
HDFS read percentile count | le16000 | Count | Number of HDFS reads with read waiting time less than 16ms |
| le32000 | Count | Number of HDFS reads with read waiting time less than 32ms |
| le64000 | Count | Number of HDFS reads with read waiting time less than 64ms |
| total | Count | HDFS read count |
CACHEFS read percentile count | le200 | Count | Number of CACHEFS reads with read waiting time less than 200us |
| le3200 | Count | Number of CACHEFS reads with read waiting time less than 3200us |
| le12800 | Count | Number of CACHEFS reads with read waiting time less than 12800us |
| total | Count | CACHEFS read times |
HDFS read size percentile count | le8192 | Count | Number of HDFS reads with size less than 8192 bytes |
| le65536 | Count | Number of HDFS reads with size less than 65536 bytes |
| le262144 | Count | Number of HDFS reads with size less than 262144 bytes |
| le4194304 | Count | Number of HDFS reads with size less than 4194304 bytes |
| total | Count | HDFS read count |
CACHEFS read size percentile count | le8192 | Count | Number of CACHEFS reads with size less than 8192 bytes |
| le65536 | Count | Number of CACHEFS reads with size less than 65536 bytes |
| le262144 | Count | Number of CACHEFS reads with size less than 262144 bytes |
| le4194304 | Count | Number of CACHEFS reads with size less than 4194304 bytes |
| total | Count | CACHEFS read times |
FSLIB read throughput | hdfs | bytes/s | HDFS read throughput per second |
| cachefs | bytes/s | CACHEFS read throughput per second |
HDFS write percentile count | le500 | Count | Number of HDFS writes with write time less than 500 us |
| le4000 | Count | Number of HDFS writes with write time less than 4 ms |
| le16000 | Count | Number of HDFS writes with write time less than 16 ms |
| le64000 | Count | Number of HDFS writes with write time less than 64 ms |
| total | Count | HDFS write count |
CACHEFS write percentile count | le200 | Count | Number of CACHEFS writes with write time less than 200us |
| le3200 | Count | Number of CACHEFS writes with write time less than 3200us |
| le12800 | Count | Number of CACHEFS writes with write time less than 12800us |
| total | Count | Number of CACHEFS writes |
HDFS write size percentile count | le8192 | Count | Number of HDFS writes with size less than 8192 bytes |
| le65536 | Count | Number of HDFS writes with size less than 65536 bytes |
| le262144 | Count | Number of HDFS writes with size less than 262144 bytes |
| le4194304 | Count | Number of HDFS writes with size less than 4194304 bytes |
| total | Count | HDFS write count |
CACHEFS write size percentile count | le8192 | Count | Number of CACHEFS writes with size less than 8192 bytes |
| le65536 | Count | Number of CACHEFS writes with size less than 65536 bytes |
| le262144 | Count | Number of CACHEFS writes with size less than 262144 bytes |
| le4194304 | Count | Number of CACHEFS writes with size less than 4194304 bytes |
| total | Count | Number of CACHEFS writes |
FSLIB write throughput | hdfs | bytes/s | HDFS write throughput per second |
| cachefs | bytes/s | CACHEFS write throughput per second |
FSLIB Cache Hit Or Miss | hits | Count/s | CACHEFS hit count |
| misses | Count/s | CACHEFS miss count |
FSLIB Cache size | meta_memory_size | bytes | FSLIB starcache metadata amount of memory used |
| data_memory_size | bytes | FSLIB starcache data amount of memory used |
| data_disk_size | bytes | FSLIB starcache space occupied by data |
Number of FS Instances | fs_instances | Count | Number of FS Instances in FSLIB |
Number of open files in FSLIB | hdfs | Count | Number of open HDFS files in FSLIB |
| cachefs | Count | Number of open CACHEFS files in FSLIB |
Number of files created in FSLIB | hdfs | Count/s | Number of HDFS files created per second in FSLIB |
| cachefs | Count/s | Number of CACHEFS files created per second in FSLIB |
FSLIB List | hdfs | Count/s | Number of HDFS files listed per second in FSLIB |
| cachefs | Count/s | FSLIB List CACHEFS files per second |
| posix | Count/s | FSLIB List POSIX files per second |
FSLIB List duration | hdfs | us | FSLIB List HDFS delay per second |
FSLIB List count | hdfs | Count/s | FSLIB List HDFS frequency per second |
FSLIB Delete Files percentile delay | le64000 | Count | FSLIB delete files duration less than 64ms count |
| total | Count | FSLIB delete files count |
FSLIB Delete Files avg duration per second | hdfs | us | FSLIB delete files HDFS avg duration per second |
FSLIB Delete File count | le64000 | Count | FSLIB delete file duration less than 64ms count |
| total | Count | FSLIB delete file count |
FSLIB Delete File avg duration per second | hdfs | us | FSLIB delete file HDFS avg duration per second |
FSLIB Delete Dir count | le64000 | Count | FSLIB delete dir duration less than 64ms count |
| total | Count | FSLIB delete dir count |
FSLIB Delete Dir avg duration per second | hdfs | us | FSLIB delete dir HDFS avg duration per second |
Starlet read size per second | read_bytes | bytes/s | Starlet read size per second |
Starlet reads per second | read_counts | Count/s | Starlet reads per second |
Starlet write size per second | write_bytes | bytes/s | Starlet write size per second |
Starlet write operations per second | write_counts | Count/s | Starlet write operations per second |
memory statistics | process | bytes | process memory usage |
| metadata | bytes | metadata memory usage |
| query | bytes | query memory usage |
| load | bytes | load memory usage |
| compaction | bytes | compaction memory usage |
| update | bytes | update memory usage |
| schema_change | bytes | schema change memory usage |
| clone | bytes | clone memory usage |
| chunk_allocator | bytes | chunk allocator memory usage |
| consistency | bytes | consistency memory usage |
| page_cache | bytes | page cache memory usage |
| column_pool | bytes | column pool memory usage |
| datacache | bytes | datacache memory usage |
| jit_cache | bytes | jit cache memory usage |
Metadata memory statistics | tablet | bytes | tablet metadata memory usage |
| rowset | bytes | rowset metadata memory usage |
| segment | bytes | segment metadata memory usage |
| column | bytes | column metadata memory usage |
Tablet Metadata memory statistics | tablet_schema | bytes | tablet schema memory usage |
Segment Metadata memory statistics | segment_zonemap | bytes | segment zonemap memory usage |
| short_key_index | bytes | short key index memory usage |
Column Metadata memory statistics | bitmap_index | bytes | bitmap cache memory usage |
| bf_index | bytes | bloom filter index cache memory usage |
| zonemap_index | bytes | column zonemap cache memory usage |
| ordinal_index | bytes | ordinal index cache memory usage |
Column Pool memory statistics | binary | bytes | binary column pool memory usage |
| uint8 | bytes | uint8 column pool memory usage |
| int8 | bytes | int8 column pool memory usage |
| int16 | bytes | int16 column pool memory usage |
| int32 | bytes | int32 column pool memory usage |
| int64 | bytes | int64 column pool memory usage |
| int128 | bytes | int128 column pool memory usage |
| float | bytes | float column pool memory usage |
| double | bytes | double column pool memory usage |
| decimal | bytes | decimal column pool memory usage |
| date | bytes | date column pool memory usage |
| datetime | bytes | datetime column pool memory usage |
Result Block | block_count | Count | Number of blocks in the result cache |
| queue_count | Count | Number of results in the queue |
Segment open count | open_segments | Count | segment open frequency per minute |
| open_segments_io | Count | number of IO tasks generated per minute by opening segments |
Stream Load data import volume | load_bytes | bytes | Total bytes imported via Stream Load |
Stream Load import duration | load_duration | ms | Total time consumed by Stream Load |
Number of Stream Load tasks | load_pipe_count | Count | Number of currently running Stream Load tasks |
| load_current_processing | Count | Number of currently running Stream Load tasks |
Stream Load request | requests | Count | Number of Stream Load requests per second |
Transaction Stream Load data import volume | load_bytes | bytes | Number of bytes imported via Stream Load transaction interface |
Transaction Stream Load import duration | load_duration | ms | The time when the transaction was imported |
Number of Transaction Stream Load tasks | current_processing | Count | Number of currently running Transaction Stream Load tasks |
Transaction Stream Load request | load_requests | Count | Number of Transaction Stream Load requests per second |
Memtable Flush count | flush_count | Count/s | Memtable Flush count |
Memtable Flush size | flush_memory | bytes | Memtable Flush memory size |
| flush_disk | bytes | Memtable Flush disk size |
Memtable Flush duration | flush_io | us | Memtable Flush IO duration |
| flush_duration | us | Memtable Flush duration |
| finalize_duration | us | Memtable Flush finalize duration |
Segment Flush size | flush_bytes | bytes | Segment Flush data size |
Segment Flush count | flush_count | Count/s | Segment Flush count |
Segment Flush duration | flush_duration | us | Segment Flush duration |
| flush_io_duration | us | Segment Flush IO duration |
Primary key table Compaction count | outputs_count | Count/s | Primary key table Compaction count |
Primary key table Compaction write data volume | outputs_bytes | bytes | Number of bytes written during primary key table Compaction |
Primary key table Compaction duration | duration | us | Time taken for primary key table Compaction task |
Number of Routine Load tasks | tasks | Count | Number of running Routine Load tasks |
Spark Load write rate | write_bytes | bytes/s | Spark Load write rate |
Maximum number of rowsets per Tablet | rowset_nums | Count | Maximum number of rowsets per tablet |
Load RPC thread pool size | size | Count | Load RPC thread pool size |
Number of channels | count | Count | Number of channels |
Add Chunks duration | duration | us | add chunks duration |
| wait_memtable | us | add chunks wait for memtable duration |
| wait_replica | us | add chunks wait for replica duration |
| wait_writer | us | add chunks wait for write time consumed |
Add Chunks times | count | Count/s | add chunks times |
fragment request count | count | Count/s | Cumulative execution count of Fragment instances (non-Pipeline Engine) |
data import volume | load_bytes | bytes | Total imported bytes |
Number of rows imported | load_rows | Count | Total rows imported |
Number of Async Delta Writer executions | async_delta_writer | Count | Number of async delta writer executions |
Async Delta Writer Task execution time | execute | us | async delta writer task execution time |
| pending | us | async delta writer task waiting time |
Number of Async Delta Writer Task executions | count | Count | Number of async delta writer task executions |
Partial Update Apply thread pool duration | pending_time | ns | update apply thread pool queuing time |
| execute_time | ns | update apply thread pool task execution duration |
| executed_tasks | Count/s | update apply thread pool executed task count |
| queue_count | Count | update apply thread pool queued task count |
Update Apply thread pool size | active_threads | Count | update apply thread pool active thread count |
| running_threads | Count | update apply thread pool liveness thread count |
| threadpool_size | Count | update apply thread pool size |
Segment Replicate thread pool duration | pending_time | ns | segment replicate thread pool queuing time |
| execute_time | ns | segment replicate thread pool task execution duration |
Segment Replicate thread pool task | executed_tasks | Count/s | segment replicate thread pool executed task count |
| queue_count | Count | number of queued tasks in segment replicate thread pool |
Segment Replicate thread pool size | active_threads | Count | Number of active threads in segment replicate thread pool |
| running_threads | Count | Number of live threads in segment replicate thread pool |
| threadpool_size | Count | segment replicate thread pool size |
Segment Flush thread pool duration | pending_time | ns | segment flush thread pool queuing time |
| execute_time | ns | segment flush thread pool task execution duration |
Segment Flush thread pool task | executed_tasks | Count/s | segment flush thread pool executed task count |
| queue_count | Count | number of queued tasks in segment flush thread pool |
Segment Flush thread pool size | active_threads | Count | Number of active threads in segment flush thread pool |
| running_threads | Count | Number of live threads in segment flush thread pool |
| threadpool_size | Count | segment flush thread pool size |
Publish Version thread pool duration | pending_time | ns | publish version thread pool queuing time |
| execute_time | ns | publish version thread pool task execution duration |
Publish Version thread pool task | executed_tasks | Count/s | publish version thread pool executed task count |
| queue_count | Count | publish version thread pool queued task count |
Publish Version thread pool size | active_threads | Count | publish version thread pool active thread count |
| running_threads | Count | publish version thread pool liveness thread count |
| threadpool_size | Count | publish version thread pool size |
Primary Index Compaction thread pool duration | pending_time | ns | primary index compaction thread pool queuing time |
| execute_time | ns | primary index compaction thread pool task execution duration |
Primary Index Compaction thread pool tasks | executed_tasks | Count/s | primary index compaction thread pool executed task count |
| queue_count | Count | number of queued tasks in the primary index compaction thread pool |
Primary Index Compaction thread pool size | active_threads | Count | number of active threads in the primary index compaction thread pool |
| running_threads | Count | number of live threads in the primary index compaction thread pool |
| threadpool_size | Count | primary index compaction thread pool size |
Memtable Flush thread pool duration | pending_time | ns | memtable flush thread pool queuing time |
| execute_time | ns | memtable flush thread pool task execution duration |
Memtable Flush thread pool task | executed_tasks | Count/s | memtable flush thread pool executed task count |
| queue_count | Count | memtable flush thread pool number of queued tasks |
Memtable Flush thread pool size | active_threads | Count | Number of active threads in memtable flush thread pool |
| running_threads | Count | Number of live threads in memtable flush thread pool |
| threadpool_size | Count | memtable flush thread pool size |
Lake Memtable Flush thread pool duration | pending_time | ns | lake memtable flush thread pool queuing time |
| execute_time | ns | lake memtable flush thread pool task execution duration |
Lake Memtable Flush thread pool task | executed_tasks | Count/s | lake memtable flush thread pool executed task count |
| queue_count | Count | lake memtable flush thread pool number of queued tasks |
Lake Memtable Flush thread pool size | active_threads | Count | lake memtable flush thread pool active thread count |
| running_threads | Count | Number of live threads in lake memtable flush thread pool |
| threadpool_size | Count | lake memtable flush thread pool size |
Async Delta Writer thread pool duration | pending_time | ns | async delta writer thread pool queuing time |
| execute_time | ns | async delta writer thread pool task execution duration |
Async Delta Writer thread pool task | executed_tasks | Count/s | async delta writer thread pool executed task count |
| queue_count | Count | async delta writer thread pool number of queued tasks |
Async Delta Writer thread pool size | active_threads | Count | async delta writer thread pool active thread count |
| running_threads | Count | async delta writer thread pool liveness thread count |
| threadpool_size | Count | async delta writer thread pool size |
Refresh rowset commit request | total | Count | Total number of RowsetCOMMIT requests in the primary key table |
| failed | Count | Total number of failed RowsetCOMMIT requests in the primary key table |
rowset commit application count | total | Count | Total number of COMMIT and APPLY in the primary key table |
rowset commit application duration | duration | us | Time taken for primary key table APPLY task |
THRIFT Client Usage | backend | Count | Currently used number of backend Thrift clients |
| broker | Count | Currently used number of broker Thrift clients |
| frontend | Count | Currently used number of frontend Thrift clients |
Number of primary key indexes in memory | nums | Count | Number of primary key indexes in memory |
Total memory of primary key indexes | index_bytes | bytes | Total memory of primary key indexes |
Memory usage of primary key DELETE Vector cache | delete_vector_bytes | bytes | Memory cost of primary key DELETE Vector cache |
Total number of generated DELETE vectors in primary key table | new_delete_vector | Count | Total number of generated DELETE vectors in primary key table |
Number of DELETE Vector cache entries in primary key table | delete_vector_counts | Count | Number of DELETE Vector cache entries in primary key table |
Query Cache utilization | usage_ratio | % | query cache usage |
Query Cache size | capacity | bytes | query cache capacity |
Query Cache size | usage | bytes | query cache usage |
Query Cache hit rate | hit_ratio | % | query cache hit rate |
Query Cache count | lookup | Count | query cache count |
| hit | Count | query cache hit count |
Page Cache count | lookup | Count | page cache query count |
| hit | Count | page cache hit count |
Page Cache capacity | capacity | bytes | page cache capacity |
Brpc endpoint stub count | count | Count | Total number of bRPC stubs (by host address) |
Pipeline Driver duration | driver_execution_time | ns | PipelineDriver Executor handles PipelineDriver time |
Pipeline statistics | query_ctx_cnt | Count | Total number of running queries |
| driver_queue_len | Count | The number of Ready Drivers pending scheduling in BE |
| driver_schedule_count | Count | Scheduling count of Pipeline Executor Drivers in BE |
| pipe_drivers | Count | Current total number of drivers in BE |
| poller_block_queue_len | Count | Current length of the PipelineDriverPoller Block queue |
| prepare_pool_queue_len | Count | Number of queued tasks in the Pipeline Prepare thread pool |
| scan_executor_queuing | Count | Number of async I/O tasks triggered by Scan Operator pending execution |
PID | pid | None | Process ID. |
process CPU usage | usage | % | CPU Utilization |
| system_usage | % | system CPU usage |
| user_usage | % | user CPU usage |
Disk Usage Statistics | read | bytes/s | Number of bytes read from disk per second |
| write | bytes/s | Bytes written to disk per second |
Process FD Statistics | fd_count | Count | Number of file descriptors used by the process |
Total number of threads | thread_count | Count | Number of threads |
Process start time | uptime | s | Process uptime |
Maximum Disk IO Usage | io_util | % | Maximum Disk Usage Percentage |
Jemalloc memory | allocated | bytes | Jemalloc allocated bytes |
cn Disk I/O Time | io_time | ms | IO Operation Time |
Resource Group CPU | in_use_cores | Count | Estimated number of CPU cores in use per resource group |
The resource group quota is exceeded. | overflow_count | Count | Number of queries triggering concurrency limit per resource group (instantaneous value) |
Resource group query | bigquery_count | Count | Number of queries triggering large query limit per resource group (instantaneous value) |
| running_queries | Count | Number of currently running queries per resource group (instantaneous value) |
| total_queries | Count | Total number of executed queries per resource group, including currently running queries (instantaneous value) |
cn resource group memory | limit_bytes | bytes | Memory limit per resource group (instantaneous value) |
| inuse_bytes | bytes | Currently used memory per resource group (instantaneous value) |
CPU limit ratio for cn resource group | limit_ratio | % | Ratio of CPU core limit per resource group to total CPU core limit across all resource groups (instantaneous value) |
network transmission statistics | send | bytes/s | Network Bytes Sent |
cn network reception statistics | receive | bytes/s | Network Bytes Received |
CPU utilization | ProcessCpuLoad | % | CPU utilization |
GC count | YGC | Count | Young GC count |
| FGC | Count | Full GC count |
GC time | FGCT | s | Full GC consumption time |
| GCT | s | Garbage collection consumption time |
| YGCT | s | Young GC consumption time |
Memory zone proportion | S0 | % | Percentage of used Survivor 0 memory |
| E | % | Percentage of used Eden memory |
| CCS | % | Percentage of used compressed class space memory |
| S1 | % | Percentage of used Survivor 1 memory |
| O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
JVM memory | MemHeapUsedM | Mbytes | Used heap memory |
| MemNonHeapUsedM | Mbytes | Used off-heap memory |
| MemHeapCommittedM | Mbytes | Committed heap memory |
| MemNonHeapCommittedM | Mbytes | Committed off-heap memory |
| MemHeapMaxM | Mbytes | Maximum heap memory |
| MemHeapInitM | Mbytes | Initial heap memory |
| MemNonHeapInitM | Mbytes | Initial off-heap memory |
Number of file handles | MaxFileDescriptorCount | Count | Maximum number of file descriptors |
| OpenFileDescriptorCount | Count | Number of open file descriptors |
Number of JVM threads | PeakThreadCount | Count | Peak thread count |
| ThreadCount | Count | Thread count |
| DaemonThreadCount | Count | Daemon thread count |
Total CN Node | CnNodeNum | Count | ALL cn node count |
Alive CN Node | CnAliveNum | Count | Liveness cn node count |
DataCache hit rate | rate | % | DataCache hit rate history |
DataCache hit rate | last_minute_rate | % | DataCache hit rate in the past minute |
DataCache number of bytes accessed in the past minute | hit | bytes | DataCaches number of bytes hit in the past minute |
DataCache number of bytes accessed in the past minute | miss | bytes | DataCaches number of bytes missed in the past minute |
HDFS write percentile count | le1000 | Count | Number of HDFS writes with write time less than 1 ms |
| le2000 | Count | Number of HDFS writes with write time less than 2 ms |
| le8000 | Count | Number of HDFS writes with write time less than 8 ms |
| le32000 | Count | Number of HDFS writes with write time less than 32 ms |
| le256000 | Count | Number of HDFS writes with write time less than 256 ms |
| le512000 | Count | Number of HDFS writes with write time less than 512 ms |
HDFS read percentile count | le1000 | Count | Number of HDFS reads with read waiting time less than 1ms |
| le2000 | Count | Number of HDFS reads with read waiting time less than 2ms |
| le4000 | Count | Number of HDFS reads with read waiting time less than 4ms |
| le8000 | Count | Number of HDFS reads with read waiting time less than 8ms |
| le256000 | Count | Number of HDFS reads with read waiting time less than 256ms |
| le512000 | Count | Number of HDFS reads with read waiting time less than 512ms |
FSLIB Delete File count | le1000 | Count | FSLIB delete file duration less than 1ms count |
| le2000 | Count | Number of FSLIB delete file operations with duration less than 2ms |
| le4000 | Count | Number of FSLIB delete file operations with duration less than 4ms |
| le8000 | Count | Number of FSLIB delete file operations with duration less than 8ms |
| le16000 | Count | Number of FSLIB delete file operations with duration less than 16ms |
| le32000 | Count | Number of FSLIB delete file operations with duration less than 32ms |
| le256000 | Count | Number of FSLIB delete file operations with duration less than 256ms |
| le512000 | Count | Number of FSLIB delete file operations with duration less than 512ms |
FSLIB Delete Files percentile delay | le1000 | Count | FSLIB delete files duration less than 1ms count |
| le2000 | Count | FSLIB delete files duration less than 2ms count |
| le4000 | Count | FSLIB delete files duration less than 4ms count |
| le8000 | Count | FSLIB delete files duration less than 8ms count |
| le16000 | Count | Number of FSLIB delete file operations with duration less than 16ms |
| le32000 | Count | FSLIB delete files duration less than 32ms count |
| le256000 | Count | Number of FSLIB delete file operations with duration less than 256ms |
| le512000 | Count | FSLIB delete files duration less than 512ms number of times |
FSLIB Delete Dir count | le1000 | Count | FSLIB delete dir duration less than 1ms count |
| le2000 | Count | FSLIB delete dir duration less than 2ms count |
| le4000 | Count | FSLIB delete dir duration less than 4ms count |
| le8000 | Count | FSLIB delete dir duration less than 8ms count |
| le16000 | Count | FSLIB delete dir duration less than 16ms count |
| le32000 | Count | FSLIB delete dir duration less than 32ms count |
| le256000 | Count | FSLIB delete dir duration less than 256ms count |
| le512000 | Count | FSLIB delete dir duration less than 512ms count |
フィードバック