tencent cloud

PrevNext

Feedback

search by keyword

Recent Pages

Documentation
Tencent Cloud Observability Platform
    Documentation
    Download PDF

    EMR (Spark)

    Last updated: 2024-01-27 17:52:39
    Download PDF

      Namespace

      Namespace=QCE/TXMR_SPARK

      Monitoring Metrics

      Spark - SparkJobHistory

      Parameter
      Metric Name
      Description
      Unit
      Dimension
      SparkShGcUtilGcCountYgc
      GC count_YGC
      Young GC count
      Count
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilGcCountFgc
      GC count_FGC
      Full GC count
      Count
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilGcTimeFgct
      GC time_FGCT
      Time consumed by Full GC
      s
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilGcTimeGct
      GC time_GCT
      Time used to collect garbage
      s
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilGcTimeYgct
      GC time_YGCT
      Time consumed by Young GC
      s
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilMemoryS0
      Memory space percentage_S0
      Percentage of used Survivor 0 memory
      %
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilMemoryE
      Memory space percentage_E
      Percentage of used Eden memory
      %
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilMemoryCcs
      Memory space percentage_CCS
      Percentage of memory used by compressed class space
      %
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilMemoryS1
      Memory space percentage_S1
      Percentage of used Survivor 1 memory
      %
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilMemoryO
      Memory space percentage_O
      Percentage of used Old memory
      %
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver
      SparkShGcUtilMemoryM
      Memory space percentage_M
      Percentage of used Metaspace memory
      %
      host4sparksparkjobhistoryserver
      id4sparksparkjobhistoryserver

      Overview of the Parameters in Each Dimension

      Parameter Name
      Dimension Name
      Dimension Description
      Format
      Instances.N.Dimensions.0.Name
      id4sparksparkjob
      historyserver
      Dimension name of the EMR instance ID
      String-type dimension name, such as id4sparksparkjobhistoryserver
      Instances.N.Dimensions.0.Value
      id4sparksparkjob
      historyserver
      Specific EMR instance ID
      Specific EMR instance ID, such as emr-mm8bs222
      Instances.N.Dimensions.1.Name
      host4sparksparkjob
      historyserver
      Dimension name of the node IP in the EMR instance
      String-type dimension name, such as host4sparksparkjobhistoryserver
      Instances.N.Dimensions.1.Value
      host4sparksparkjob
      historyserver
      Specific node IP in the EMR instance
      Specific node IP, such as 1.1.1.1

      Input Parameters

      To query the monitoring data of EMR (Spark), use the following input parameters: &Namespace=QCE/TXMR_SPARK &Instances.N.Dimensions.0.Name=id4sparksparkjobhistoryserver &Instances.N.Dimensions.0.Value=Specific EMR instance ID &Instances.N.Dimensions.1.Name=host4sparksparkjobhistoryserver &Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
      Contact Us

      Contact our sales team or business advisors to help your business.

      Contact Us
      Technical Support

      Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

      Submit a Ticket
      7x24 Phone Support
      Copyright © 2013-2024 Tencent Cloud. All Rights Reserved.
      Privacy PolicyLegalCookie Policy