tencent cloud

Feedback

Impala Monitoring Metrics

Last updated: 2022-08-19 10:32:07
    Note:

    Currently, only Impala v3.4.0 and later support Impala metrics.

    Impala - catalog

    Title Metric Unit Description
    Resident set size RSS bytes Resident set size
    JVM memory MemHeapInitM MB Peak size of initial JVM HeapMemory
    MemHeapCommittedM MB Size of HeapMemory currently committed by JVM
    MemHeapMaxM MB Size of HeapMemory configured by JVM
    MemHeapUsedM MB Size of HeapMemory currently used by JVM
    MemNonHeapInitM MB Size of initial JVM NonHeapMemory
    MemNonHeapCommittedM MB Size of NonHeapMemory currently committed by JVM
    MemNonHeapUsedM MB Size of NonHeapMemory currently used by JVM
    Interval between heartbeats from the daemon process to StateStore Last s Latest interval between heartbeats from the daemon process to StateStore
    Max s Maximum interval between heartbeats from the daemon process to StateStore
    Mean s Average interval between heartbeats from the daemon process to StateStore
    Min s Minimum interval between heartbeats from the daemon process to StateStore
    Stddev s Standard deviation in the interval between heartbeats from the daemon process to StateStore
    TCMalloc memory Used bytes Number of bytes used by the program
    PageheapFreeBytes bytes Number of bytes of free mapped pages in the page heap
    PageheapUnmappedBytes bytes Number of bytes of free unmapped pages in the page heap
    PhysicalBytesReserved bytes Amount of physical memory used by the process
    TotalBytesReserved bytes Number of bytes of system memory reserved by TCMalloc
    Active connections Thrift_Server_Connections_Used - Number of active connections
    Process execution duration Uptime s Process execution duration
    File descriptors MaxFileDescriptorCount - Maximum number of file descriptors
    OpenFileDescriptorCount - Number of opened file descriptors
    Threads ThreadCount - Total number of threads
    DaemonThreadCount - Number of daemon threads
    CPU utilization SystemCpuLoad - System CPU Utilization

    Impala - StateStore

    Title Metric Unit Description
    Resident set size RSS bytes Resident set size
    TCMalloc memory Used bytes Number of bytes used by the program
    PageheapFreeBytes bytes Number of bytes of free mapped pages in the page heap
    PageheapUnmappedBytes bytes Number of bytes of free unmapped pages in the page heap
    PhysicalBytesReserved bytes Amount of physical memory used by the process
    TotalBytesReserved bytes Number of bytes of system memory reserved by TCMalloc
    Connections Used - Number of active connections
    Running threads Count - Number of running threads
    StateStore subscribers Count - Number of StateStore subscribers

    Impala - daemon

    Title Metric Unit Description
    JVM memory MemHeapInitM MB Peak size of initial JVM HeapMemory
    MemHeapCommittedM MB Size of HeapMemory currently committed by JVM
    MemHeapMaxM MB Size of HeapMemory configured by JVM
    MemHeapUsedM MB Size of HeapMemory currently used by JVM
    MemNonHeapInitM MB Size of initial JVM NonHeapMemory
    MemNonHeapCommittedM MB Size of NonHeapMemory currently committed by JVM
    MemNonHeapUsedM MB Size of NonHeapMemory currently used by JVM
    TCMalloc memory Used bytes Number of bytes used by the program
    PageheapFreeBytes bytes Number of bytes of free mapped pages in the page heap
    PageheapUnmappedBytes bytes Number of bytes of free unmapped pages in the page heap
    PhysicalBytesReserved bytes Amount of physical memory used by the process
    TotalBytesReserved bytes Number of bytes of system memory reserved by TCMalloc
    Threads ThreadCount - Total number of threads
    DaemonThreadCount - Number of daemon threads
    Process execution duration Uptime s Process execution duration
    File descriptors MaxFileDescriptorCount - Maximum number of file descriptors
    OpenFileDescriptorCount - Number of opened file descriptors
    CPU utilization SystemCpuLoad - System CPU Utilization
    Beeswax API client connections Use - Number of active Beeswax API connections
    Conn_In_Use - Number of active Beeswax API connections to this Impala daemon
    TotalConns - Total number of active Beeswax API connections to this Impala daemon
    ConnSetupQueueSize - Number of Beeswax API connections that this Impala daemon has received and are waiting to establish
    HS2 API client connections Use - Number of active HS2 API connections
    Conn_In_Use - Number of active HS2 API connections
    TotalConns - Total number of HS2 API connections this Impala daemon has established during the lifecycle
    ConnSetupQueueSize - Number of HS2 API connections that this Impala daemon has received and are waiting to establish
    Thread manager RunningThreads - Number of running threads
    TotalCreatedThreads - Number of threads created during the lifecycle
    Memory manager limit Limit Bytes Memory beyond the memory limit (default value: -1)
    Amount of memory beyond the memory limit (default value: -1) OverLimit Bytes Number of threads created during the lifecycle
    HS2 API client wait time for connection establishment P20 us HS2 API client wait time for connection establishment
    P50
    P70
    P90
    P95
    P99.9
    Beeswax API client wait time for service thread establishment P20 us Beeswax API client wait time for service thread establishment
    P50
    P70
    P90
    P95
    P99.9
    Timed-out Beeswax API connections TimeOutCnncRequests - Number of timed-out Beeswax API connections
    Time spent parsing requests from request pool (milliseconds) Total ms Time spent parsing requests from request pool (milliseconds)
    Cache misses in external data source cache class Misses - Number of cache misses in external data source cache class
    Impala backend server connection requests that timed out waiting for setup ConnSetupQueueSize - Number of Impala backend server connection requests that timed out waiting for setup
    Impala backend connection requests that timed out waiting for setup TimeOutCnncRequests - Number of Impala backend connection requests that timed out waiting for setup
    Total Impala backend client connections to this Impala daemon TotalConnections - Total number of Impala backend client connections to this Impala daemon
    Time spent by Impala backend client waiting for connection establishment P20 us Time spent by Impala backend client waiting for connection establishment
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    Time spent by Impala backend client waiting for service thread P20 us Time spent by Impala backend client waiting for service thread
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    HS2 API client wait time for service thread establishment P20 us HS2 API client wait time for service thread establishment
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    HS2 HTTP API client wait time for service thread P20 us HS2 HTTP API client wait time for service thread
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    DataStreamService: Rejected service queue overflows RpcsQueueOverflow - DataStreamService: Number of rejected service queue overflows
    ControlStreamService: Rejected service queue overflows RpcsQueueOverflow - ControlStreamService: Number of rejected service queue overflows
    DataStreamService: Used bytes PeakUsageBytes Bytes Peak number of bytes used by Memtracker DataStreamService
    CurrentUsageBytes Bytes Current number of bytes used by Memtracker DataStreamService
    ControlService: Used bytes PeakUsageBytes Bytes Peak number of bytes used by Memtracker ControlService
    CurrentUsageBytes Bytes Current number of bytes used by Memtracker ControlService
    Resident set size (RSS) for this process RSS Bytes Resident set size (RSS) for this process
    Total backends registered in StateStore Total - Total number of backends registered in StateStore
    Query release delay P20 us Query release delay
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    Opened HDFS filed NumFilesOpenForInsert - Number of opened HDFS files
    Scan range read during the lifecycle of the process ScanRangesTotal - Scan range read during the lifecycle of the process
    Opened Beeswax sessions NumOpenBeeswaxSessions - Number of opened Beeswax sessions
    Total query fragments processed during the lifecycle of the process NumFragments - Total number of query fragments processed during the lifecycle of the process
    Total scan ranges read during the lifecycle of the process without volume metadata ScanRangesNumMissingVolumId - Total number of scan ranges read during the lifecycle of the process without volume metadata
    Hedged read attempts HedgedReadOps - Number of hedged read attempts
    Total queries processed during the lifecycle of the process NumQueries - Total number of queries processed during the lifecycle of the process
    Total rows supporting caching HS2 FETCH_FIRST ResultSetCacheTotalNumRows - Total number of rows supporting caching HS2 FETCH_FIRST
    Total queries registered on this Impala server NumQueriesRegistered - Total number of queries registered on this Impala server
    Total backend queries NumQueriesExecuted - Total number of backend queries
    Sessions terminated due to inactivity NumSessionsExpired - Number of sessions terminated due to inactivity
    Queries terminated due to inactivity NumQueriesExpired - Number of queries terminated due to inactivity
    Opened HS2 sessions NumOpenHS2Sessions - Number of opened HS2 sessions
    Tables in catalog NumTables - Number of tables in catalog
    Databases in catalog NumDatabases - Number of databases in catalog
    Bytes written to the disk by the I/O manager BytesWritten - Number of bytes written to the disk by the I/O manager
    Files opened by the I/O manager NumOpenFiles - Number of files opened by the I/O manager
    Used HDFS file handles NumFileHandlesOutstanding Bytes Number of used HDFS file handles
    Read local bytes LocalBytesRead Bytes Number of local bytes read by the I/O manager
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support