tencent cloud

Feedback

Kafka Monitoring Metrics

Last updated: 2023-12-27 15:01:37
Title
Metric
Unit
Description
CPU utilization
ProcessCpuLoad
%
Process CPU utilization
CPU usage time
ProcessCpuTime
ms
Cumulative CPU usage time
GC count
YGC
-
Young GC count
FGC
-
Full GC count
GC time
GCT
s
Garbage collection time
FGCT
s
Full GC time
YGCT
s
Young GC time
Memory zone proportion
O
%
Percentage of used Old memory
M
%
Percentage of used Metaspace memory
CCS
%
Percentage of used compressed class space memory
S0
%
Percentage of used Survivor 0 memory
S1
%
Percentage of used Survivor 1 memory
E
%
Percentage of used Eden memory
JVM memory
MemHeapInitM
MB
Size of initial JVM HeapMemory
MemNonHeapInitM
MB
Size of initial JVM NonHeapMemory
MemHeapMaxM
MB
Size of HeapMemory configured by JVM
MemHeapCommittedM
MB
Size of HeapMemory currently committed by JVM
MemHeapUsedM
MB
Size of HeapMemory currently used by JVM
MemNonHeapCommittedM
MB
Size of NonHeapMemory currently committed by JVM
MemNonHeapUsedM
MB
Size of NonHeapMemory currently used by JVM
File handles
OpenFileDescriptorCount
count/s
Number of opened file descriptors
MaxFileDescriptorCount
count/s
Maximum number of file descriptors
Process execution duration
Uptime
s
Process execution duration
Worker threads
PeakThreadCount
count/s
Peak number of threads
ThreadCount
count/s
Total number of threads
DaemonThreadCount
count/s
Number of Daemon threads
Production traffic of Broker
OneMinuteRate
bytes/s
Rate of message production by the Broker per minute
Consumption traffic of Broker
OneMinuteRate
bytes/s
Rate of message consumption by the Broker per minute
Rejected consumption traffic
OneMinuteRate
bytes/s
Rate of Topic request rejection per minute
Failed Fetch requests
OneMinuteRate
count/s
Rate of Fetch request failures per minute
Failed Produce requests
OneMinuteRate
count/s
Rate of Produce request failures per minute
Produced messages
OneMinuteRate
count/s
Rate of message production per minute
Read traffic from other Brokers
OneMinuteRate
bytes/s
Amount of traffic read from other Brokers per minute
Read traffic to other Brokers
OneMinuteRate
bytes/s
Amount of traffic read to other Brokers per minute
Fetch requests
OneMinuteRate
count/s
Rate of Fetch requests per minute
Produce requests
OneMinuteRate
count/s
Rate of Produce requests per minute
ControllerBroker
IsControllerBroker
-
The metric value is 1 on the Broker where Controller is located and is 0 on other Brokers.
LeaderElection rate
OneMinuteRate
count/s
Rate of LeaderElections per minute
LeaderElection latencies
99thPercentile
ms
The 99th percentile of LeaderElection latencies
999thPercentile
The 99.9th percentile of LeaderElection latencies
Mean
Mean value of LeaderElection latencies
UncleanLeaderElections rate
OneMinuteRate
count/s
Rate of UncleanLeaderElections per minute
GlobalPartition count
GlobalPartitionCount
count/s
Number of global partitions observed by the controller
OfflinePartitions count
OfflinePartitionCount
count/s
Number of offline partitions observed by the controller
GlobalTopic count
GlobalTopicCount
count/s
Number of global topics observed by the controller
Offline log directory count
OfflineLogDirectory
count/s
Number of offline log directories
LogFlush rate
OneMinuteRate
calls/s
Rate of message log flush per minute
LogFlush latencies
99thPercentile
ms
The 99th percentile of LogFlush latencies
999thPercentile
The 99.9th percentile of LogFlush latencies
Mean
Mean value of LogFlush latencies
Average network processor idleness rate
NetworkProcessorAvgIdlePercent
-
Average idleness rate of threads in a network thread pool
ISR expansion rate
OneMinuteRate
count/s
In-sync replica (ISR) expansion rate per minute
ISR shrinkage rate
OneMinuteRate
count/s
ISR shrinkage rate per minute
Replicas count
LeaderReplicaCount
count/s
Number of offline replicas
OfflineReplicaCount
count/s
Number of leader replicas
Partitions count
PartitionCount
count
Number of partitions
UnderMinIsrPartitionCount
Number of partitions under the minimum ISR count
UnderReplicatedPartitions
Number of UnderReplicatedPartitions
FetchConsumer request latencies
99thPercentile
ms
The 99.9th percentile of FetchConsumer request latencies
999thPercentile
The 99.9th percentile of FetchConsumer request latencies
Mean
Mean value of FetchConsumer request latencies
FetchFollower request latencies
99thPercentile
ms
The 99.9th percentile of FetchFollower request latencies
999thPercentile
The 99.9th percentile of FetchFollower request latencies
Mean
Mean value of FetchFollower request latencies
Produce request latency
99thPercentile
ms
The 99.9th percentile of Produce request latencies
999thPercentile
The 99.9th percentile of Produce request latencies
Mean
Mean value of Produce request latencies
Size of the request queue
RequestQueueSize
size
Size of the request queue
Purgatory size
Fetch
size
Number of requests waiting in fetch purgatory
Produce
-
Number of requests waiting in producer purgatory
Average request handler idleness rate
OneMinuteRate
-
Idleness rate of request handlers per minute
ZooKeeper request latencies
99thPercentile
ms
The 99th percentile of ZooKeeper request latencies
999thPercentile
The 99.9th percentile of ZooKeeper request latencies
Mean
Mean value of ZooKeeper request latencies

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

7x24 Phone Support