- Release Notes and Announcements
- Product Introduction
- Purchase Guide
- Getting Started
- EMR on CVM Operation Guide
- Planning Cluster
- Configuring Cluster
- Managing Cluster
- Instance Information
- Node Specification Management
- Checking and Updating Public IP
- Cluster Scale-Out
- Cluster Scale-in
- Auto Scaling
- Repairing Disks
- Graceful Scale-In
- Disk Update Check
- Scaling up Cloud Disks
- Changing Configurations
- Automatic Replacement
- Exporting Software Configuration
- Cluster Scripts
- Cluster Termination
- Operation Logs
- Task Center
- Managing Service
- Managing Users
- Adding Components
- Restarting Service
- Starting/Stopping Services
- WebUI Access
- Resetting WebUI Password
- Software WebUI Entry
- Operation Guide for Access to WebUI over Private Network
- Role Management
- Client Management
- Configuration Management
- YARN Resource Scheduling
- HBase RIT Fixing
- Component Port Information
- Service Operation
- HBase Table-Level Monitoring
- Component Health Status
- Monitoring and Alarms
- Cluster Overview
- Node Status
- Service Status
- Cluster Event
- Log
- Application Analysis
- Cluster Inspection
- Monitoring Metrics
- Node Monitoring Metrics
- HDFS Monitoring Metrics
- YARN Monitoring Metrics
- ZooKeeper Monitoring Metrics
- HBase Monitoring Metrics
- Hive Monitoring Metrics
- Spark Monitoring Metrics
- Presto Monitoring Metrics
- Trino Monitoring Metrics
- ClickHouse Monitoring Metrics
- Druid Monitoring Metrics
- Kudu Monitoring Metrics
- Alluxio Monitoring Metrics
- PrestoSQL Monitoring Metrics
- Impala Monitoring Metrics
- Ranger Monitoring Metrics
- COSRanger Monitoring Metrics
- Doris Monitoring Metrics
- Kylin Monitoring Metrics
- Zeppelin Monitoring Metrics
- Oozie Monitoring Metrics
- Storm Monitoring Metrics
- Livy Monitoring Metrics
- Kyuubi Monitoring Metrics
- StarRocks Monitoring Metrics
- Kafka Monitoring Metrics
- Alarm Configurations
- Alarm Records
- Container-Based EMR
- EMR Development Guide
- Hadoop Development Guide
- HDFS Common Operations
- HDFS Federation Management Development Guide
- HDFS Federation Management
- Submitting MapReduce Tasks
- Automatically Adding Task Nodes Without Assigning ApplicationMasters
- YARN Task Queue Management
- Practices on YARN Label Scheduling
- Hadoop Best Practices
- Using API to Analyze Data in HDFS and COS
- Dumping YARN Job Logs to COS
- Spark Development Guide
- Hbase Development Guide
- Phoenix on Hbase Development Guide
- Hive Development Guide
- Presto Development Guide
- Sqoop Development Guide
- Hue Development Guide
- Oozie Development Guide
- Flume Development Guide
- Kerberos Development Guide
- Knox Development Guide
- Alluxio Development Guide
- Kylin Development Guide
- Livy Development Guide
- Kyuubi Development Guide
- Zeppelin Development Guide
- Hudi Development Guide
- Superset Development Guide
- Impala Development Guide
- ClickHouse Development Guide
- Druid Development Guide
- TensorFlow Development Guide
- Jupyter Development Guide
- Kudu Development Guide
- Ranger Development Guide
- Doris Development Guide
- Kafka Development Guide
- Iceberg Development Guide
- StarRocks Development Guide
- Flink Development Guide
- RSS Development Guide
- Hadoop Development Guide
- Best Practices
- API Documentation
- FAQs
- Service Level Agreement
- Contact Us
- Release Notes and Announcements
- Product Introduction
- Purchase Guide
- Getting Started
- EMR on CVM Operation Guide
- Planning Cluster
- Configuring Cluster
- Managing Cluster
- Instance Information
- Node Specification Management
- Checking and Updating Public IP
- Cluster Scale-Out
- Cluster Scale-in
- Auto Scaling
- Repairing Disks
- Graceful Scale-In
- Disk Update Check
- Scaling up Cloud Disks
- Changing Configurations
- Automatic Replacement
- Exporting Software Configuration
- Cluster Scripts
- Cluster Termination
- Operation Logs
- Task Center
- Managing Service
- Managing Users
- Adding Components
- Restarting Service
- Starting/Stopping Services
- WebUI Access
- Resetting WebUI Password
- Software WebUI Entry
- Operation Guide for Access to WebUI over Private Network
- Role Management
- Client Management
- Configuration Management
- YARN Resource Scheduling
- HBase RIT Fixing
- Component Port Information
- Service Operation
- HBase Table-Level Monitoring
- Component Health Status
- Monitoring and Alarms
- Cluster Overview
- Node Status
- Service Status
- Cluster Event
- Log
- Application Analysis
- Cluster Inspection
- Monitoring Metrics
- Node Monitoring Metrics
- HDFS Monitoring Metrics
- YARN Monitoring Metrics
- ZooKeeper Monitoring Metrics
- HBase Monitoring Metrics
- Hive Monitoring Metrics
- Spark Monitoring Metrics
- Presto Monitoring Metrics
- Trino Monitoring Metrics
- ClickHouse Monitoring Metrics
- Druid Monitoring Metrics
- Kudu Monitoring Metrics
- Alluxio Monitoring Metrics
- PrestoSQL Monitoring Metrics
- Impala Monitoring Metrics
- Ranger Monitoring Metrics
- COSRanger Monitoring Metrics
- Doris Monitoring Metrics
- Kylin Monitoring Metrics
- Zeppelin Monitoring Metrics
- Oozie Monitoring Metrics
- Storm Monitoring Metrics
- Livy Monitoring Metrics
- Kyuubi Monitoring Metrics
- StarRocks Monitoring Metrics
- Kafka Monitoring Metrics
- Alarm Configurations
- Alarm Records
- Container-Based EMR
- EMR Development Guide
- Hadoop Development Guide
- HDFS Common Operations
- HDFS Federation Management Development Guide
- HDFS Federation Management
- Submitting MapReduce Tasks
- Automatically Adding Task Nodes Without Assigning ApplicationMasters
- YARN Task Queue Management
- Practices on YARN Label Scheduling
- Hadoop Best Practices
- Using API to Analyze Data in HDFS and COS
- Dumping YARN Job Logs to COS
- Spark Development Guide
- Hbase Development Guide
- Phoenix on Hbase Development Guide
- Hive Development Guide
- Presto Development Guide
- Sqoop Development Guide
- Hue Development Guide
- Oozie Development Guide
- Flume Development Guide
- Kerberos Development Guide
- Knox Development Guide
- Alluxio Development Guide
- Kylin Development Guide
- Livy Development Guide
- Kyuubi Development Guide
- Zeppelin Development Guide
- Hudi Development Guide
- Superset Development Guide
- Impala Development Guide
- ClickHouse Development Guide
- Druid Development Guide
- TensorFlow Development Guide
- Jupyter Development Guide
- Kudu Development Guide
- Ranger Development Guide
- Doris Development Guide
- Kafka Development Guide
- Iceberg Development Guide
- StarRocks Development Guide
- Flink Development Guide
- RSS Development Guide
- Hadoop Development Guide
- Best Practices
- API Documentation
- FAQs
- Service Level Agreement
- Contact Us
Doris - FE
Title | Metric | Unit | Description |
Node information | FeNodeNum | count | Total number of FE nodes |
| BeAliveNum | count | Number of alive BE nodes |
| BkDeadNum | count | Number of dead broker nodes |
Connections | Num | count | Number of FE node JVM connections |
JVM threads | Total | count | Total number of threads in the JVM of the FE node, including daemon threads and non-daemon threads |
| Peak | count | Peak number of threads in the JVM of the FE node |
GC count | YoungGC | count | FE node JVM Young GC count |
| OldGC | count | FE node JVM Old GC count |
GC time | YoungGC | s | FE node JVM Young GC time |
| OldGC | s | FE node JVM Old GC time |
FE query latency | Quantile75 | ms | 75th percentile of the FE query latency |
| Quantile95 | ms | 95th percentile of the FE query latency |
| Quantile99 | ms | 99th percentile of the FE query latency |
| Quantile999 | ms | 99.9th percentile of the FE query latency |
Maximum compaction score of tablet | MAX | score | Maximum compaction score of FE tablet |
Scheduled tablets | ScheduledTablet | count | Number of scheduled tablets in FE |
Request response | QPS | count | Number of queries per second |
| RPS | count | Number of requests that can be processed per second |
Query failure rate | ErrRate | % | Query error rate |
Cache query | SqlModelHitQuery | count | Number of queries that hit the SQL model |
| PartitionModelHitQuery | count | Number of queries that hit the partition model |
| SqlModelQuery | count | Number of queries in the SQL cache model |
| PartitionModelQuery | count | Number of queries in the partition cache model |
| CachePartitionHit | count | Number of partitions that hit the cache in the query |
| CachePartitionScan | count | Number of all partitions scanned in the query |
Routine load rows | TotalRows | count | Number of FE routine load rows |
| ErrorRows | count | Number of FE routine load error rows |
Transaction status statistics | Reject | count | Number of rejected transactions on FE |
| Begin | count | Number of transactions that have begun on FE |
| Success | count | Number of successful transactions on FE |
| Failed | count | Number of failed transactions on FE |
Images | Write | count | Number of image writes on FE |
| Push | count | Number of image pushes on FE |
ALTER job statistics | RollupRunning | count | Number of running alter jobs of ROLLUP type |
| SchemaChangeRunning | count | Number of running alter jobs of SCHEMA_CHANGE type |
UNKNOWN load job statistics | UNKNOWN | count | Number of load jobs of UNKNOWN type in UNKNOWN status |
| PENDING | count | Number of load jobs of UNKNOWN type in PENDING status |
| ETL | count | Number of load jobs of UNKNOWN type in ETL status |
| LOADING | count | Number of load jobs of UNKNOWN type in LOADING status |
| COMMITTED | count | Number of load jobs of UNKNOWN type in COMMITTED status |
| FINISHED | count | Number of load jobs of UNKNOWN type in FINISHED status |
| CANCELLED | count | Number of load jobs of UNKNOWN type in CANCELLED status |
SPARK load job statistics | UNKNOWN | count | Number of load jobs of SPARK type in UNKNOWN status |
| PENDING | count | Number of load jobs of SPARK type in PENDING status |
| ETL | count | Number of load jobs of SPARK type in ETL status |
| LOADING | count | Number of load jobs of SPARK type in LOADING status |
| COMMITTED | count | Number of load jobs of SPARK type in COMMITTED status |
| FINISHED | count | Number of load jobs of SPARK type in FINISHED status |
| CANCELLED | count | Number of load jobs of SPARK type in CANCELLED status |
DELETE load job statistics | UNKNOWN | count | Number of load jobs of DELETE type in UNKNOWN status |
| PENDING | count | Number of load jobs of DELETE type in PENDING status |
| ETL | count | Number of load jobs of DELETE type in ETL status |
| LOADING | count | Number of load jobs of DELETE type in LOADING status |
| COMMITTED | count | Number of load jobs of DELETE type in COMMITTED status |
| FINISHED | count | Number of load jobs of DELETE type in FINISHED status |
| CANCELLED | count | Number of load jobs of DELETE type in CANCELLED status |
INSERT load job statistics | UNKNOWN | count | Number of load jobs of INSERT type in UNKNOWN status |
| PENDING | count | Number of load jobs of INSERT type in PENDING status |
| ETL | count | Number of load jobs of INSERT type in ETL status |
| LOADING | count | Number of load jobs of INSERT type in LOADING status |
| COMMITTED | count | Number of load jobs of INSERT type in COMMITTED status |
| FINISHED | count | Number of load jobs of INSERT type in FINISHED status |
| CANCELLED | count | Number of load jobs of INSERT type in CANCELLED status |
BROKER load job statistics | UNKNOWN | count | Number of load jobs of BROKER type in UNKNOWN status |
| PENDING | count | Number of load jobs of BROKER type in PENDING status |
| ETL | count | Number of load jobs of BROKER type in ETL status |
| LOADING | count | Number of load jobs of BROKER type in LOADING status |
| COMMITTED | count | Number of load jobs of BROKER type in COMMITTED status |
| FINISHED | count | Number of load jobs of BROKER type in FINISHED status |
| CANCELLED | count | Number of load jobs of BROKER type in CANCELLED status |
MINI load job statistics | UNKNOWN | count | Number of load jobs of MINI type in UNKNOWN status |
| PENDING | count | Number of load jobs of MINI type in PENDING status |
| ETL | count | Number of load jobs of MINI type in ETL status |
| LOADING | count | Number of load jobs of MINI type in LOADING status |
| COMMITTED | count | Number of load jobs of MINI type in COMMITTED status |
| FINISHED | count | Number of load jobs of MINI type in FINISHED status |
| CANCELLED | count | Number of load jobs of MINI type in CANCELLED status |
HADOOP load job statistics | UNKNOWN | count | Number of load jobs of HADOOP type in UNKNOWN status |
| PENDING | count | Number of load jobs of HADOOP type in PENDING status |
| ETL | count | Number of load jobs of HADOOP type in ETL status |
| LOADING | count | Number of load jobs of HADOOP type in LOADING status |
| COMMITTED | count | Number of load jobs of HADOOP type in COMMITTED status |
| FINISHED | count | Number of load jobs of HADOOP type in FINISHED status |
| CANCELLED | count | Number of load jobs of HADOOP type in CANCELLED status |
Doris - BE
Title | Metric | Unit | Description |
Thrift utilization | Broker | count | Number of thrifts used by broker |
| Backend | count | Number of thrifts used by BE |
| Extdatasource | count | Number of thrifts used by extdatasource |
| Frontend | count | Number of thrifts used by FE |
Streaming load statistics | RequestsTotal | count | Number of streaming load requests |
| CurrentProcessing | count | Number of existing streaming load processes |
| PipeCount | count | Number of streaming load pipes |
Streaming load time | Duration | ms | Streaming load duration |
Streaming load data volume | LoadTotal | bytes | Size of data imported by streaming load |
Fragment statistics | PlanFragment | count | Number of plan fragments |
| Endpoint | count | Number of DataStreams |
| RequestsTotal | count | Number of fragment requests |
Fragment request duration | Duration | μs | Fragment request duration |
BE memory | Total | bytes | Size of BE memory pool |
| Allocated | bytes | Size of allocated BE memory |
Maximum compaction score of tablet | CumulativeMax | score | Maximum cumulative compaction score of tablet |
| BaseMax | score | Maximum base compaction score of tablet |
Data handled by compaction | Cumulative | bytes | Amount of data handled by cumulative compaction |
| Base | bytes | Amount of data handled by base compaction |
Delta data handled by compaction | Cumulative | bytes | Amount of delta data handled by cumulative compaction |
| Base | bytes | Amount of delta data handled by base compaction |
MemPools used by compaction | CurrentConsumption | count | Sum of MemPools used by compaction (all compaction threads) |
Process file handles | Used | count | Number of file handles used by BE process |
| SoftLimit | count | Soft limit on file handles for BE process |
| HardLimit | count | Hard limit on file handles for BE process |
Running threads in process | NUM | count | Number of threads running in BE process |
Engine request statistics | FailedBaseCompaction | count | Number of failed engine requests of base_compaction type |
| FailedCultCompt | count | Number of failed engine requests of cumulative_compaction type |
| TotalBaseCompaction | count | Total number of engine requests of base_compaction type |
| TotalCultCompt | count | Total number of engine requests of cumulative_compaction type |
Doris - BK
Title | Metric | Unit | Description |
GC count | YGC | - | Young GC count |
| FGC | - | Full GC count |
GC time | FGCT | s | Full GC time |
| GCT | s | Garbage collection time |
| YGCT | s | Young GC time |
Memory zone proportion | S0 | % | Percentage of used Survivor 0 memory |
| E | % | Percentage of used Eden memory |
| CCS | % | Percentage of used compressed class space memory |
| S1 | % | Percentage of used Survivor 1 memory |
| O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
JVM memory | MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
| MemHeapCommittedM | MB | Size of HeapMemory committed by JVM |
| MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
| MemHeapInitM | MB | Size of initial JVM HeapMem |
| MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
| MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
| MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
CPU utilization | ProcessCpuLoad | % | CPU utilization |
File handles | MaxFileDescriptorCount | - | Maximum number of file descriptors |
| OpenFileDescriptorCount | - | Number of opened file descriptors |
CPU usage time | ProcessCpuTime | ms | Cumulative CPU usage time |
Process execution duration | Uptime | s | Process execution duration |
Worker threads | ThreadCount | - | Number of threads |
| PeakThreadCount | - | Peak number of threads |
| DaemonThreadCount | - | Number of backend threads |
Yes
No
Was this page helpful?