CKafka allows you to monitor the resources created under your account, such as instances, topics, and consumer groups, so that you can keep track of the status of your resources in real time and troubleshoot possible issues to ensure stable business operations.
This document describes how to view monitoring metrics and their descriptions in the CKafka console.
2. In the instance list, click the ID/Name of the target instance to enter the instance details page.
3. At the top of the instance details page, Click Monitor, select resource tags, and set the time range to view the monitoring data about the instance.
Monitoring information display
Note:
You can click the following tabs to view the monitoring data of instances, topic, and consumer groups.
Instance
Topic
Consumer Group
After selecting a partition, you can view its monitoring data.
If you don't select a partition, the current monitoring data at the topic level will be displayed.
Consumer group - topic monitoring
Consumer group - partition monitoring:
Descriptions of metrics
The following lists the CKafka monitoring metrics and their description. Based on user feedback and statistics, we recommend that you configure monitoring and alarming policies for metrics marked with the word recommended. Configure policies properly as needed.
Instance
Topic
Consumer Group
Monitoring Metric
Description
Instance Disk Usage (MB)
Instance disk usage (including replicas), which is the latest value in the selected time period.
Disk Utilization (%) (Recommended)
Ratio of the currently used disk capacity to the total disk capacity of the instance in percentages.
Instance Connections (Count) (Recommended)
Number of connections between clients and servers in the cluster.
Max Production Traffic in Instance (MB) (Recommended)
Instance message production bandwidth peak (excluding traffic generated by replicas). This is the basis for calculating the production bandwidth utilization in the instance.
Max Consumption Traffic in Instance (MB) (Recommended)
Instance message consumption bandwidth peak (there is no concept of replica for consumption). This is the basis for calculating the consumption bandwidth utilization in the instance.
Instance Consumption Bandwidth Percentage (%)
Ratio of the instance consumption bandwidth to the quota.
Number of instance consumption throttling occurrences.
Instance Production Bandwidth Percentage (%)
Ratio of the instance production bandwidth to the quota.
Instance Production Throttling Occurrences (Count)
Number of instance production throttling occurrences.
Messages Stored in Instance (Count)
Total number of stored messages in the instance (excluding those produced by replicas), which is the latest value in the selected time period.
Instance Consumption Traffic (MB)
Consumption traffic of the instance (excluding traffic generated by replicas), which is the total traffic in the selected time period.
Messages Produced in Instance (Count)
Number of messages produced in the instance, which is the total number of messages in the selected time period.
Instance Production Traffic (MB)
Production traffic of the instance (excluding traffic generated by replicas), which is the total traffic in the selected time period.
Messages Consumed in Instance (Count)
Number of messages consumed in the instance, which is the total number of messages in the selected time period.
Topic monitoring
Monitoring Metric
Description
Max Production Traffic (MB/sec)
Maximum production traffic in topic (excluding replica traffic).
Max Consumption Traffic (MB/sec)
Maximum consumption traffic in topic.
Consumed Messages (Count)
Number of messages consumed in the topic, which is the total number of messages in the selected time period.
Consumption Traffic (MB)
Consumption traffic in the topic (excluding traffic generated by replicas), which is the total traffic in the selected time period.
Used Disk Capacity (MB) (Recommended)
Total size of messages in the topic (excluding those produced by replicas) that actually use disk capacity, which is the latest value in the selected time period.
Produced Messages (Count)
Number of messages produced in the topic, which is the total number of messages in the selected time granularity.
Production Traffic (MB)
Production traffic in the topic (excluding traffic generated by replicas), which is the total traffic in the selected time granularity.
Persisted Messages (Count)
Total number of stored messages in the topic (excluding those produced by replicas), which is the latest value in the selected time period.
Number of topic consumption throttling occurrences, which is the total number of occurrences in the selected time granularity.
Topic Production Throttling Occurrences (Count/sec)
Number of topic production throttling occurrences, which is the total number of occurrences in the selected time granularity.
Topic - partition monitoring
Monitoring Metric
Description
Consumed Messages (Count)
Number of messages consumed in the partition, which is the total number of messages in the selected time period.
Consumption Traffic (MB)
Consumption traffic in the partition (excluding traffic generated by replicas), which is the total traffic in the selected time period.
Persisted Messages (Count)
Total number of stored messages in the partition (excluding those produced by replicas), which is the latest value in the selected time period.
Used Disk Capacity (MB)
Total size of messages in the partition (excluding those produced by replicas) that actually use disk capacity, which is the latest value in the selected time period.
Produced Messages (Count)
Number of messages produced in the partition, which is the total number of messages in the selected time granularity.
Production Traffic (MB)
Production traffic in the partition (excluding traffic generated by replicas), which is the total traffic in the selected time granularity.
Consumer group - topic monitoring
Monitoring Metric
Description
Max Offset in Topic
Maximum offset in all partitions of the topic.
Consumption Offset in Topic
Maximum consumption offset of consumer groups in all partitions of the topic.
Unconsumed Messages in Topic (Count)
Total number of messages not consumed by the consumer group in all partitions of the topic.
Consumption Speed in Topic (Count/min)
Total number of messages consumed by consumer groups from all partitions in the topic per second.
Consumer group - partition monitoring:
Monitoring Metric
Description
Consumption Speed in Partition (Count/min)
Number of messages consumed by consumer groups in the partition per second.
Current Consumption Offset
Current consumption offset of consumer groups in the partition.
Max Offset for Current Partition
Maximum offset for the current partition.
Unconsumed Messages (Count) (Recommended)
Number of messages not consumed by consumer groups in the partition.
Yes
No
Was this page helpful?