tencent cloud

Feedback

Release Notes

Last updated: 2024-12-03 16:49:37

    October 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    Flume Monitoring
    EMR on CVM enhances Flume service role process information, Dashboard monitoring, and real-time GC logs
    2024-10-18
    Event
    1. EMR on CVM & EMR on TKE event records support searching by event record content
    2. EMR on CVM enriches YARN application run duration, blacklisted NodeManager, and YARN insights-related events
    2024-10-18
    Log
    EMR on CVM real-time logs support viewing GC log paths, with upgraded and optimized real-time log viewing paths;
    2024-10-18
    -
    Monitoring Metric
    1. EMR on CVM enriches node network TCP6 link state and related metrics
    2. EMR on CVM enriches HDFS, Spark HistoryServer file descriptor count, and Kudu Server process memory metrics
    2024-10-18

    September 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    StarRocks clusters support unified authentication
    EMR on CVM adds OpenLDAP user authentication and Ranger access control for StarRocks cluster type
    2024-09-30
    
    EMR on TKE adds StarRocks component
    EMR on TKE supports StarRocks component in EMR-TKE-V1.1.0 and above versions
    2024-09-21
    
    Auto-scaling
    EMR on TKE supports auto-scaling for Trino and RSS Worker roles
    2024-09-21
    Event
    EMR on CVM enriches App query metadata acceleration buckets, single bucket bandwidth, request frequency, and related event items
    2024-09-04
    Application Insights
    1. EMR on CVM enriches Spark Query Insights Overview
    2. EMR on CVM enriches TrinoSQL query large table scan and other insight capabilities
    2024-09-02
    Storage Insights
    1. EMR on CVM enriches HDFS and COS integrated bucket storage with size, empty files, and hot/cold data insight feature
    2. EMR on CVM adds insight feature for analyzing file tables such as small file tables, cold data tables, large file tables, and small file analysis based on Hive metadata
    2024-09-02
    Event
    EMR on CVM enriches event item alert capabilities for the dimensions of CPU, memory, and IO resources
    2024-09-02
    Log
    EMR on CVM supports console log delivery to CLS cloud product
    2024-09-02
    -

    August 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    YARN Resource Scheduling
    1. Capacity scheduling supports planned mode
    2. Optimize the scheduler switching interaction and the Tag scheduling switch path
    3. Optimize the deployment activation logic steps; clearly display pending activation quantity prompts and content comparison
    4. Under the Fair Scheduling strategy, it is necessary to support the formulation of resource ratios. Tag scheduling supports displaying node information and total information within each Tag
    2024-08-30
    Managed Node
    EMR on CVM introduces a new resource type: Managed Node (abbr: MNode)
    
    2024-08-30
    New StarRocks version added: EMR-STARROCKS-V2.1.1
    EMR on CVM adds the standard distribution of StarRocks EMR-STARROCKS-V2.1.1, supporting storage-compute separation deployment scenarios
    2024-08-09

    July 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    EMR on CVM Manage LDAP Authentication
    The console supports enabling or disabling LDAP Authentication for Hive and Impala components,
    2024-07-10
    EMR on CVM Trino supports high availability
    Trino HA is achieved through keepalived and High Availability Virtual IP (HAVIP).
    2024-07-10
    EMR on CVM Flame Graph
    The node console supports querying and obtaining process flame graphs
    2024-07-02

    June 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    EMR on CVM has enhanced service monitoring
    1. Rich cluster memory weighting and disk weighting usage
    2. HDFS Namenode RPC, Yarn queue, StarRocks Be disk status, and related metrics
    June 26, 2024
    EMR on CVM has enriched event items
    1. Added 12 alert events such as CVM node memory Oom, node disk read-only, and Ping unreachable
    2. Enriched event items related to Hive SQL compilation timeout, Impala Query job Create status, etc
    June 26, 2024
    EMR on TKE Console features enriched
    1. Supports Hive and Spark services from custom definitions when creating new clusters and adding new components
    2. Rich service termination and role stopping features
    2024-06-10
    Stop Role
    EMR on TKE Monitoring Rich
    1. Enriched RSS service monitoring Dashboard and metrics alerts
    2. Enhanced cluster and some component event items, with event alerts
    2024-06-10
    New EMR on TKE version
    Released EMR on TKE V1.1.0, enriching the cosranger component in the new version
    2024-06-10

    May 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    New StarRocks version added: EMR-STARROCKS-V2.1.0
    EMR on CVM adds the standard distribution of StarRocks EMR-STARROCKS-V2.1.0
    2024-05-28
    EMR on TKE supports purchasing compute resources
    Added linked purchase of compute resources and support for resource association with EMR on TKE clusters
    2024-05-28
    --
    StarRocks query topology
    EMR on CVM StarRocks cluster (StarRocks V3.1.8 and above) query supports DAG topology
    2024-05-28
    Spark Query Insights
    EMR on CMV adds various dimensional metrics for Spark query management and supports multiple Spark insights
    2024-05-11
    Application Insights
    1. EMR on CVM adds Hive overview insights, supports scheduling-query dimensional insights, and resource optimization suggestions
    2. EMR on CVM opens Hive and Yarn engine insight rule templates and can allocate on demand
    2024-05-11
    HDFS service files
    EMR on CVM supports scheduled periodic export of HDFS file information
    2024-05-11
    Trino Query Management
    1. Trino Query supports viewing Error logs
    2. Trino Query list optimized by time sorting
    2024-05-11
    -
    Impala Query Management
    EMR on CVM enriches Impala Query Management with dimensions such as total FragmentInstances, remaining FragmentInstances, and Backend count
    2024-05-11
    -
    SR Managing a data table
    EMR on CVM StarRocks Table Management - Added table schema information and support for filtering
    2024-05-11
    -
    Hive Query Insights
    EMR on CVM enhances Hive insight items with input like too many small files, data reading lag, empty input and output, etc
    2024-05-11
    -

    April 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    New Hadoop cluster version EMR v3.6.1 (Beta)
    Added new Hadoop cluster type Beta version EMR v3.6.1, supports Spark Native Engine
    2024-04-28
    Auto-scaling supports cross-availability zone expansion
    EMR on CVM auto-scaling supports cross-availability zone expansion for elastic nodes
    April 9, 2024
    Overview
    Rich Service Hosting
    1. EMR on CVM adds Filebeat, Flume, Knox services and configuration hosting
    2. EMR on CVM adds HBase REST Server service hosting
    April 9, 2024
    -
    Operation Log Experience Optimization
    EMR on CVM Operation Logs have added a search feature, supporting searches by time, operation, operation details, and operator, as well as filtering by operation object and security level
    April 9, 2024

    March 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    EMR on CVM
    Added Service Monitoring
    Added basic monitoring metrics for Goosefs service Cluster, Master, Worker
    2024-03-22
    EMR on CVM
    Rich Service Monitoring
    1. Enhance monitoring metrics related to Trino's queues and queries
    2. Enhance Alluxio service cluster data read/write monitoring metrics
    3. Enrich HDFS active file write count, optimize NameNode RPC metrics
    4. StarRocks service metadata, Query/Update, BE resources, execution thread metrics support alarm
    5. Optimize Impala service scaling roles to support role monitoring metrics
    2024-03-22
    Cluster Event
    EMR on CVM enriches process OOMKiller kill events and supports alerts
    2024-03-22
    Cluster Logs
    1. EMR on CVM supports Spark SQL audit log filtering and export
    2. EMR on CVM versions 270&280 optimize Trino logs by splitting collection by roles
    2024-03-22
    log
    Interaction Optimization
    EMR on CVM optimizes Hbase/Kudu data table management page interaction
    2024-03-22
    -
    New Hadoop cluster version EMR v2.8.0
    Added Hadoop 3.x standard distribution EMR v2.6.0, supports Spark 3.3.4, Trino 435, Flink 1.16.1, Iceberg 1.4.3, Hudi 0.14.1, Kyuubi 1.7.1
    2024-03-08

    January 2024

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    Enriched Trino service applications
    EMR on CVM adds multidimensional query management feature for Trino
    January 30, 2024
    Enriched Yarn Insights
    Yarn enriches insights on abnormal Stage execution time and Resource expenditure anomalies for same-origin scheduling
    January 30, 2024
    Enriched StarRocks Service Application
    1. New database table daily statistics, multi-dimensional list of library table partitions
    2. Added Service Export Task Management
    January 30, 2024
    Event items enriched
    EMR on CVM enriches HDFS small file proportion event items
    January 30, 2024
    HDFS File Analysis Optimization
    HDFS File Analysis Scope Displayed According to Configured Path Range
    January 30, 2024
    Impala Enriches Hot Tables
    Impala Query Management Supports Top Hot Data Tables and Hot Data Table Trend Views
    January 30, 2024
    Scenario-Based Configuration Parameter Tuning and Specification Recommendation Optimization
    EMR on CVM Hadoop cluster types for different application scenarios. Based on the selected components and the number of components, recommend reasonable machine types, specifications, and configuration optimization tuning.
    January 17, 2024
    -
    Task Center Experience Optimization
    The Task Center offers rich search criteria, supports node-level instruction aggregation display, and real-time task progress refreshes consistent with cluster status.
    January 17, 2024
    Scale operations support task process concurrency
    EMR on CVM: When scaling out or in the cluster, tasks can be performed on other nodes that are not the target of the current operation. For example, when scaling out, it is possible to scale in or restart services on another node.
    January 17, 2024
    -
    Auto-scaling supports scaling group types
    EMR on CVM auto-scaling supports new types of scaling groups. Scaling groups support setting scaling policies at the queue level.
    January 17, 2024
    Support deployment from service self Definition
    In the default EMR on CVM Hadoop scenario, some optional components support Uninstall in the console after deployment. When adding new components, service self Definition deployment is supported, and role-level addition and Uninstall are also supported.
    January 17, 2024
    Export software configuration supports dimension and scope selection
    EMR on CVM Export software configuration supports dimension and scope selection, enhancing export file use cases.
    January 17, 2024
    Operation Log Optimization
    EMR on CVM enhances operation log details, enriching content to help users quickly troubleshoot and locate issues.
    January 17, 2024
    Supports mounting CBS
    The EMR on CVM console supports the ability to attach external cloud disks and initialize disks.
    January 17, 2024
    Mount CBS
    Console Node Ops
    EMR on CVM node processes support viewing real-time logs and obtaining Thread Dump information.
    January 17, 2024
    StarRocks Metrics
    StarRocks service enriches 34 related metrics including BE primary key, Meta, etc., and 2 FE metrics, and corrects the unit of existing GC time metric to ms (original unit: seconds)
    January 17, 2024
    HBase Thrift Metrics
    EMR on CVM adds HBase Thrift role monitoring, enriching 31 related metrics such as JVM and JMX
    January 17, 2024
    Overview - Node Comparison Optimization
    EMR on CVM Cluster Overview Node Monitoring Comparison feature upgrade. Added node type options and support for comparing up to 20 nodes at once
    January 17, 2024
    Event items enriched
    Added event item for the number of currently unhealthy NodeManagers in YARN
    January 17, 2024
    Other
    TCOP > EMR (Dynamic) metric alarms enhanced for services such as ALLUXIO, ZEPPELIN, KUDU, DORIS, KYLIN, STORM, OOZIE
    January 17, 2024
    -

    November 2023

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    TKE Version Release
    Release EMR-TKE V1.0.1 version, EMR-TKE-DLC V1.0.0 version
    November 17, 2023
    TKE Available regions
    EMR on TKE launched in Singapore
    November 17, 2023
    -
    TKE POD Operations and Maintenance enhanced
    EMR on TKE POD Rebuild feature allows configuration item updates and supports POD Destruction
    November 17, 2023
    Rebuild
    Configuration association features are rich
    During the EMR on CVM scale-out of TKE nodes, custom parameters support tolerance
    EMR on TKE HiveMetaStore supports DLC address association
    November 17, 2023
    -
    Meta Database Interface upgrade
    EMR on TKE & CVM optimizes Hive Metastore interface, only loading the deployed MetaDB's CDB
    November 17, 2023
    -
    TKE supports Task Center
    EMR on TKE adds Cluster Content Task Center feature
    November 17, 2023
    -
    Adjust accessing COS
    EMR on TKE accesses COS with read/write permissions using "service-related roles"
    November 17, 2023
    -

    October 2023

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    Kyuubi Service Application enriched
    EMR on CVM adds Kyuubi Query Management and Query Details
    2023-10-30
    Hive Service Application enriched
    EMR on CVM Hive Query supports multiple insights, enriching query tables and scanning related information dimensions
    EMR on CVM Hive Query Management adds new insight item Perspective Insight Overview feature, observing distribution trends and insight item list
    2023-10-30
    Role Logs enriched
    EMR on CVM enriches Yarn Service Timeline Server Logs
    2023-10-13
    log
    Rich Service Metrics
    EMR on CVM enriches Node Single Disk Metrics, OpenLdap Heartbeat, Yarn Queue Memory Usage Rate, Kyuubi, Hbase RS, Timeline Server, and 48 other monitoring indicators
    2023-10-13
    Event items enriched
    EMR on CVM adds Yarn RM without Active State, HDFS NN no Checkpoint for an extended period, Yarn Application Job Running Failure Event Item, and fixes Scale-in Node False Alarm in Process Missing Events
    2023-10-13
    Other
    EMR reports TCOP Monitoring Metrics Interface DescribeEMRInstances to support Resource-Level Authentication
    2023-10-13
    -

    September 2023

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    StarRocks Cluster Type adds Product Version StarRocks-V2.0.0
    Added Product Version StarRocks-V2.0.0, corresponding to Community StarRocks Version 3.1.2
    September 21, 2023
    StarRocks Query Management
    StarRocks Cluster Type V1.4.0 and above versions support Query Management feature in the console
    September 12, 2023

    August 2023

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    EMR-V3.5.0 Service Role Audit Logs Enhanced
    EMR-V3.5.0 enhances HDFS, YARN, Hbase, Zookeeper Service Role Audit Logs
    August 24, 2023
    log
    Event items enriched
    EMR on CVM adds HMaster Primary-Standby Switch, Zookeeper Leader Switching Event Item
    August 24, 2023
    Added Hadoop Cluster Version EMR v3.6.0
    Added Hadoop 3.x Standard Release EMR v3.6.0, supporting Spark 3.3.2, Trino 414, Flink 1.16.1, Iceberg 1.1.0, Hudi 0.13.0, Kyuubi 1.7.0
    August 8, 2023

    July 2023

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    Auto Scaling supports Hybrid Scaling
    Auto Scaling supports hybrid execution of time policy and load policy. The load policy supports triggering scaling rules when multiple metrics are met
    July 13, 2023
    Release now
    Clusters or cloud data disks in isolation status support one-click release
    July 13, 2023
    Log feature enhanced
    EMR on CVM log feature upgrade, supports Filter Logs and Source Log Export and Download. EMR on CVM Console Logs add Kyuubi, Hue, Trino, SR
    July 13, 2023
    log
    Rich Service Metrics
    Added Kyuubi monitoring indicators, enriched NameNode NameService dimensional monitoring indicators, PrestoSQL Query related monitoring indicators, Hbase RegionServer enriched monitoring indicators
    July 13, 2023
    Enhanced API interface
    Added DescribeHiveQueries, DescribeYarnApplications, DescribeImpalaQueries query interfaces
    July 13, 2023
    -

    June 2023

    Dynamic Name
    Dynamic Description
    Release Date
    Documentation
    Cross-Availability Zone Deployment enabled
    Create Cluster Multi-AZ deployment feature available for use
    2023-06-30
    User Management feature optimized
    After adding a new user through the Console User Management feature, it will be automatically synchronized to Ranger
    2023-06-30
    Hive Query Management enriched
    Query List enriched with Execution Cycle and 10+ Dimensional Indicator Information
    New Query Overview with Multi-dimensional Metrics Distribution View
    Abnormal Hive Queries provide the capability to view execution logs online
    2023-06-30
    EMR on TKE Public Beta
    Support the simple and fast deployment of open-source big data clusters using Tencent Cloud TKE (TKE) as the resource base, improving off-peak resource utilization rate and achieving cost optimization
    2023-06-25

    May 2023

    Update
    Description
    Release Date
    Documentation
    Added support for federation monitoring.
    Query of monitoring metrics for the Router component and alerts are supported for HDFS federations.
    2023-05-18
    Added support for scaling based on the load of subqueues.
    Auto-scaling based on the load of subqueues is supported.
    2023-05-18

    April 2023

    Update
    Description
    Release Date
    Documentation
    Released the StarRocks cluster version: StarRocks v1.4.0.
    The StarRocks cluster version StarRocks v1.4.0 is released, corresponding to the open-source StarRocks v2.5.3.
    2023-04-18
    Product Releases and Component Versions

    March 2023

    Update
    Description
    Release Date
    Documentation
    Added table analysis in Kudu.
    Supported viewing information by table, Tablet, and TabletServer.
    Supported analyzing Tablet-level read and write QPS, storage size and other information.
    2023-03-24
    Added statistics by Region in HBase.
    Added Region-level read QPS, write QPS and other information to help locate hot spots.
    2023-03-24
    Added more monitoring metrics and alarms.
    For HiveMetaStore, more than 14 monitoring metrics and alarms (including the number of opened and connected processes, Get Table requests, and currently active requests) were added.
    For HiveServer2, more than 20 monitoring metrics and alarms (including the current requests and query submission time/average execution time) were added.
    For YARN, alarms for the queue CPU and memory usage in percentages were added.
    2023-03-24
    Added more health status events.
    Two events were added: exception in service role health status and timeout of service role health status.
    2023-03-24
    Optimized log accuracy.
    The log search accuracy was optimized, with search by keyword and by phrase supported.
    2023-03-24
    Released the Kafka cluster version: Kafka v2.0.0.
    Released the Kafka cluster version Kafka v2.0.0, corresponding to the open-source Kafka v2.4.1.
    2023-03-23
    Released the StarRocks cluster version: StarRocks v1.3.0.
    Released the StarRocks cluster version StarRocks v1.3.0, corresponding to the open-source Kafka v2.4.3.
    2023-03-10
    Released the Hadoop cluster version: JDK11-Beta-based EMR v4.0.0.
    Released the Hadoop cluster version JDK11-Beta-based EMR v4.0.0, with all of its components running in the JDK 11 environment.
    2023-03-10
    Suspended the provision of the container-based EMR service.
    The container-based EMR service was unavailable for purchase for feature update in progress.
    2023-03-10

    February 2023

    Update
    Description
    Release Date
    Documentation
    Added more metrics for job query in YARN.
    Statistics of jobs submitted by users, resources consumed, and other information were added for job query in YARN.
    2023-02-09
    Added table analysis in Hive (based on Hive MetaStore).
    Supported viewing global metrics at key dimensions such as total tables, total storage size, table count by access time, and trends.
    Supported viewing multi-dimensional data of tables and their partitions.
    2023-02-09
    Added the file-level analysis feature in HDFS.
    Supported viewing HDFS data distribution at key dimensions such as file count and file size.
    Supported viewing and downloading the lists of top large files and top small files.
    2023-02-09

    January 2023

    Update
    Description
    Release Date
    Documentation
    Supported automatic node replacement
    Task and router nodes can be monitored, and abnormal nodes can be replaced automatically, mitigating the risk of service unavailability due to node exceptions.
    2023-01-16
    
    Supported local disk repair
    Local disk replacement events can be automatically monitored. After disk replacement, you can initialize the new disk in the console on your own.
    2023-01-16
    

    December 2022

    Update
    Description
    Release Date
    Documentation
    Supported Java-GC online analysis.
    Java-GC online log analysis is supported to help you troubleshoot process exceptions due to GC, collect and record GC logs in real time, and analyze the logs.
    2022-12-06
    
    Supported role-level monitoring of Kafka.
    Kafka adds more than 70 role-level monitoring metrics and supports configuring alarms for core monitoring metrics.
    2022-12-06
    
    Added more default event-related metrics.
    More event-related metrics are added, such as the UTC time and NTP time difference of the server, Kerberos response time, number of HDFS MissingBlocks, and safe mode for the HDFS NameNode.
    2022-12-06
    Added more default alarm policies for Kudu.
    Kudu adds more alarm policies, such as the number of teservers, number of failed data directories, and number of full data directories.
    2022-12-06
    -
    Upgraded the configuration management feature.
    The configuration status is added, and you can view the details of expired configuration and failed configuration.
    More configuration files, configuration items, configuration item descriptions, and configuration filters are added.
    2022-12-06
    Upgraded the YARN resource scheduling feature.
    Label-based scheduling, queue deletion, and scheduling history viewing are supported.
    2022-12-06
    Capacity Scheduler
    Added client management.
    The client management entry is added, and you can view the client information.
    2022-12-06
    
    Supported cloud disk adjustment.
    You can adjust the cloud data disk models on nodes and expand and mount disks in the EMR console.
    Heterogeneous capacity is supported by the heterogeneous capabilities of cloud disks.
    2022-12-06
    
    Supported batch configuration of automatic renewal
    You can batch enable/disable automatic renewal for nodes in the EMR console.
    2022-12-06
    
    Supported batch configuration adjustment.
    The configurations of nodes in the same billing mode and the same region can be batch adjusted.
    2022-12-06

    November 2022

    Update
    Description
    Release Date
    Documentation
    Added more StarRocks monitoring metrics.
    More basic monitoring metrics are added for various StarRocks roles.
    2022-11-03
    
    Supported Remote Shuffle Service (RSS) clusters for container-based EMR.
    Container-based EMR supports RSS deployment in EKS.
    Spark clusters can be associated with RSS clusters.
    2022-11-01
    Overview
    Supported managed scaling for automatic scaling.
    The managed scaling feature continuously monitors the load system of the YARN cluster and automatically adds or removes compute nodes.
    2022-11-01
    

    October 2022

    Update
    Description
    Release Date
    Documentation
    Released a Hadoop cluster version of EMR v3.5.0
    The Hadoop cluster version of EMR v3.5.0 is released to support Hive v3.1.3, Spark v3.2.2, HBase v2.4.5, Flink v1.14.5, Trino v389, Iceberg v0.13.1, Delta Lake v2.0.0, Hudi v0.12.0, Zeppelin v0.10.1, Superset v1.5.1, and Ranger v2.3.0.
    2022-10-27

    September 2022

    Update
    Description
    Release Date
    Documentation
    Supported Impala percentile distribution statistics.
    Impala query supports statistics collection for execution status distribution and multidimensional percentile distribution.
    More metrics are added for Impala queries, such as total/HDFS/Kudu scanned rows, memory peak, read/sent bytes, and internal total scanned/sent bytes.
    Overview and structured profile features are provided for queries that take more than 3 seconds to execute.
    2022-09-21
    Added more alarm policies for monitoring events.
    100+ monitoring metrics are added for Druid in the "Elastic MapReduce (dynamic)" category in CM, for which dynamic alarm policies can be configured.
    20 default monitoring metrics for eight services are added for default alarm policies.
    Four Impala query events support alarm configuration through EventBridge.
    2022-09-21
    -
    Launched application comparison and application insights features for YARN job management.
    You can view task information for TEZ jobs.
    Application-level insights and comparison are supported for Tez/Spark/MapReduce jobs.
    Task-level host monitoring metric comparison is supported for Tez/MapReduce jobs.
    The experience to use YARN task information and filter task time is optimized.
    2022-09-09

    August 2022

    Update
    Description
    Release Date
    Documentation
    Released a StarRocks cluster version: StarRocks v1.1.0.
    Added support for StarRocks v2.2.2.
    2022-08-04
    Released a Druid cluster version: Druid v1.1.0.
    Added support for Druid v0.23.0.
    2022-08-04

    July 2022

    Update
    Description
    Release Date
    Documentation
    Launched the overview page in the console.
    The cluster overview page displays various information, such as cluster status, health status of running services, and event statistics.
    2022-07-22
    -
    Upgraded the cluster overview feature.
    The cluster directory navigation is optimized and upgraded.
    The health status information of deployed services is refined to display real-time statistics of cluster events.
    2022-07-22
    Added new Impala query dimension and inspection items.
    Dimensions of session ID, coordinator, and single-point memory peak are added.
    Four inspection items are added for Impala: query timeouts, total query failures, total query commits, and query execution failure rate.
    2022-07-22
    Added the Impala daemon role.
    Over 70 visual Impala daemon metrics are added, which can trigger alarms in CM.
    2022-07-22
    Added new application APIs.
    The API for collecting YARN application queue statistics is added.
    2022-07-22
    Released a Hadoop cluster version—EMR v2.7.0.
    Added support for Hive 2.3.9, Spark 3.2.1, HBase 2.4.5, Flink 1.14.3, Trino 385, ZooKeeper 3.6.3, Iceberg 0.13.0, Hudi 0.11.0, Alluxio 2.8.0, Zeppelin 0.10.1, Superset 1.4.1, and Ranger 2.1.0.
    2022-07-18
    Improved the availability of the automatic scaling feature.
    Scale-out rules support the hybrid deployment of multiple resource specifications as well as pay-as-you-go/spot instances.
    2022-07-07
    Added support for the RIT fixing tool for HBase.
    Regions in the RIT status can be fixed.
    2022-07-07
    HBase RIT Fixing
    Started the open beta test for container-based EMR clusters.
    Container-based EMR clusters become available in Beijing, Shanghai, and Guangzhou regions.
    2022-07-07

    June 2022

    Update
    Description
    Release Date
    Documentation
    Optimized the configuration management feature.
    Configuration management is upgraded to support configuration filtering, categorization, and comparison.
    The delivery priority rules for configurations at different levels are optimized to support delivery at the minimum level first.
    A configuration group can be specified for the selected components.
    2022-06-20
    Added support for Hive query management.
    The Hive service supports query management.
    2022-06-07
    Optimized the YARN job query.
    YARN job query supports displaying task information and querying task logs.
    2022-06-07
    Connected to Pricing Center.
    The pricing of EMR is connected to the Pricing Center, where you can query EMR node fees.
    2022-06-07
    Pricing

    May 2022

    Update
    Description
    Release Date
    Documentation
    Optimized the scaling feature.
    New subnets can be added to expand cluster node capacity.
    The Kyuubi service supports scaling.
    2022-05-17
    Enhanced role management and user management.
    User management supports batch import and export of users through APIs.
    Resource management supports displaying client information.
    The `DescribeClusterPhysicalMetaInfo` API is added for resource-level authentication.
    2022-05-17
    -

    April 2022

    Update
    Description
    Release Date
    Documentation
    Released the EMR v3.4.0 for the Hadoop cluster.
    Added support for Spark 3.2.1, Trino 372, Flink 1.14.3, HBase 2.4.5, ZooKeeper 3.6.3, Impala 4.0.0, Zeppelin 0.10.1, Alluxio 2.8.0, Hudi 0.10.1, Iceberg 0.13.1, and GooseFS 1.2.0.
    Renamed PrestoSQL as Trino in the new version and added support for Ranger. Monitoring metric alarms need to be configured according to Trino in the new version.
    2022-04-22
    Component VersionTrino Monitoring Metrics
    Enriched monitoring.
    Launched the new version of the interactive features of the event list.
    Added event-related metrics such as node single-disk inode utilization, single-disk space utilization, single-disk IO utilization, all HBase HMasters standby, and all HDFS NameNodes standby.
    Added monitoring metrics of the HDFS-Data node, including the block count, used disk space, available disk space, and reserved disk space.
    2022-04-22
    Added support for container-based EMR clusters.
    Added support for Spark deployment based on EKS in Beijing, Shanghai, Guangzhou, and Nanjing regions.
    2022-04-12

    March 2022

    Update
    Description
    Release Date
    Documentation
    Added the StarRocks cluster type.
    Added the StarRocks cluster type and integrated open-source StarRocks.
    2022-03-11
    Added support for adding nodes without assigning ApplicationMasters by default.
    Added support for adding nodes without assigning ApplicationMasters by default, ensuring that the running ApplicationMaster will not be terminated and the job can be performed normally.
    2022-03-08
    Added load-based scaling metrics.
    Added load-based scaling metrics such as ContainerPending, AppPending, and AppRunning.
    2022-03-08
    Added support for setting node labels for added host resources.
    Added support for setting YARN node labels for added host resources to increase the resource utilization efficiency.
    2022-03-08
    -

    January 2022

    Update
    Description
    Release Date
    Documentation
    Released a Doris cluster version—Doris v1.2.0.
    Released Doris v0.15.
    2022-01-21
    Added support for sharing component configurations.
    Added support for sharing the components of an existing cluster with other clusters without deploying such components again. This makes it easier to manage multiple clusters with the same component configurations.
    January 14, 2022
    Added monitoring metrics.
    Added Kylin, Zeppelin, Oozie, Storm, Livy, and Kyuubi monitoring metrics.Added new CosRanger monitoring metrics.
    -
    Optimized log search.
    Added support for more components and global regions and optimized log search interactions.
    -

    December 2021

    Update
    Description
    Release Date
    Documentation
    Added four use cases for the Hadoop cluster type.
    Added the ZooKeeper, HBase, Presto, and Kudu use cases for the Hadoop cluster type to help you quickly create a cluster based on your business scenario.
    2021-12-17
    Launched a new purchase page.
    Optimized the existing cluster creation process to support the placement group node dimension for unified resource management.
    2021-12-17
    Added support for system disk selection.
    Added support for selecting the system disk type and size as needed.
    2021-12-17
    -
    Optimized the task center.
    Added support for viewing the details of all tasks of the current cluster inside the cluster, and optimized the interaction path of the task center for easier viewing and use.
    2021-12-17
    -
    Launched diversified component operation features.
    Added support for visually setting instruction-level operations of components such as HDFS and YARN.
    2021-12-07
    Added monitoring metrics.
    Added Doris monitoring metrics.Adjusted the original HBase table load to HBase table-level monitoring.
    2021-12-07
    Upgraded the operating system.
    Upgraded the operating systems of all EMR versions of the Hadoop type to TencentOS Server to provide a more stable, secure, and high-performance cloud native runtime environment.If you encounter any security issues related to the operating system of an existing cluster, contact us for assistance.
    2021-12-03
    Product Overview of TencentOS Server

    September 2021

    Update
    Description
    Release Date
    Documentation
    Released a Hadoop cluster version—EMR v3.3.0.
    Added support for HBase v2.3.5, Phoenix v5.1.2, Kudu v1.15.0, Hue v4.10.0, Hudi v0.8.0, Tez v0.10.1, Livy v0.8.0, Ganglia v3.7.2, Kyuubi v1.1.0, and LDAP v2.4.44.
    September 28, 2021
    Added monitoring metrics.
    Enriched Alluxio service monitoring metrics and added COSRanger monitoring metrics.
    September 15, 2021
    Connected to Cloud Monitor's default alarms
    Cloud Monitor supports default alarm policies for Elastic MapReduce metrics/events.
    September 15, 2021
    -

    August 2021

    Update
    Description
    Release Date
    Documentation
    Added support for YARN resource scheduling.
    Added support for UI-based YARN resource scheduling configuration.
    August 31, 2021
    Added support for user management.
    Added support for visually managing Kerberos and Ranger users.
    August 31, 2021

    July 2021

    Update
    Description
    Release Date
    Documentation
    Released a Hadoop cluster version—EMR v2.6.0.
    Added support for Spark v3.0.2, Impala v3.4.0, GooseFS v1.0.0, OpenLDAP v2.4.44, Kyuubi v1.1.0, etc.
    July 15, 2021

    June 2021

    Update
    Description
    Release Date
    Documentation
    Added support for YARN job query.
    Added detailed metric statistics for YARN jobs.
    June 24, 2021
    Added support for Impala query management.
    Added detailed metric statistics for Impala query jobs.
    June 24, 2021
    Added support for automatic scaling for the spot instance mode.
    Added support for automatically adding compute nodes of the spot instance mode.
    June 3, 2021
    Added support for graceful scale-in.
    When a scale-in action is triggered, nodes that are executing tasks will not be released immediately. Instead, they will be released after completing the tasks.
    June 3, 2021
    Added support for integrating Knox with Tez.
    Added support for viewing Tez tasks via UI.
    June 3, 2021
    Added availability zones.
    Added support for Singapore Zone 3 and Tokyo Zone 2.
    June 3, 2021
    -
    Added regions.
    Added support for regions such as Frankfurt, Virginia, Bangkok, Mumbai, Tokyo, and Seoul.
    June 3, 2021
    -

    May 2021

    Update
    Description
    Release Date
    Documentation
    Released a Kafka cluster version—Kafka v1.0.0.
    Added support for Kafka v1.1.1, KafkaManager v2.0.0.2, Knox v1.2.0, and ZooKeeper v3.6.1.
    May 13, 2021
    Released a Doris cluster version—Doris v1.0.0.
    Added support for Doris v0.13.0 and Knox v1.2.0.
    May 13, 2021

    April 2021

    Update
    Description
    Release Date
    Documentation
    Released a Hadoop cluster version—EMR v3.2.0.
    Added support for Hadoop v3.2.2, Spark v3.0.2, Presto v350, Flink v1.12.1, Alluxio v2.5.0, Ranger v2.1.0, Iceberg v0.11.0, and Hudi v0.7.0.
    April 30, 2021
    Added the **Start/Stop Services** feature.
    Added support for starting or stopping all services on a node.
    April 27, 2021
    Released a Hadoop cluster version—EMR v2.5.1.
    Added support for Alluxio v2.5.0 and Hudi v0.5.1. Alluxio supports COS Transparent-URI.
    April 10, 2021

    March 2021

    Update
    Description
    Release Date
    Documentation
    Supported cluster restoration
    You can renew monthly subscribed clusters in isolated status to restore them.
    2021-03-17
    

    February 2021

    Update
    Description
    Release Date
    Documentation
    Released the EMR service in new regions on Tencent Cloud Chinese.
    Added support for the Bangkok, Seoul, Tokyo, and Virginia regions on Tencent Cloud Chinese.
    February 2, 2021
    -

    January 2021

    Update
    Description
    Release Date
    Documentation
    Added the cluster script feature.
    Added support for running a specified script on multiple nodes at a time for higher efficiency.
    January 26, 2021
    Added support for cross-model configuration change.
    You can select other models to change the node configuration when the current model is sold out.
    January 26, 2021
    Added the auto scaling feature.
    The auto scaling feature automatically adds or removes task nodes, helping you save costs while meeting the requirement for cluster computing power.
    January 26, 2021
    Added monitoring metrics.
    Added new monitoring metrics for the HDFS, Yarn, HBase, Hive, and Druid services.
    Added support for monitoring on the Kudu and Alluxio services.
    January 13, 2021
    Released the EMR service in Singapore on the international version.
    Added support for Singapore Zone 1 and Singapore Zone 2 on the international version.
    January 13, 2021
    -

    December 2020

    Update
    Description
    Release Date
    Documentation
    Released a Hadoop cluster version—EMR v3.1.0.
    Added support for Impala v3.4.0, Flink v1.10.0, HBase v2.3.3, Phoenix v5.0.0, Alluxio v2.3.0, Kudu v1.13.0, and ZooKeeper v3.6.1.
    December 14, 2020

    November 2020

    Update
    Description
    Release Date
    Documentation
    Released the EMR TianQiong edition.
    Added support for Spark materialized views.
    November 27, 2020
    Optimized monitoring and alarming.
    Added support for setting alarms for disk monitoring metrics in Cloud Monitor (CM).
    Added support for customizing EMR monitoring dashboard in CM dashboard.
    Added support for subscribing to EMR event monitoring alarms in CM.
    November 20, 2020

    October 2020

    Update
    Description
    Release Date
    Documentation
    Added support for Cloud Object Storage (COS) password-free access.
    Added support for authorizing access to COS through roles. Authorized users do not need to enter an authorization key and private key.
    2020-10-26
    -
    Added new service inspection items to the inspection system.
    Added the HDFS, Yarn, HBase, Hive, and ZooKeeper service inspection items, enhancing the health check of metrics.
    2020-10-13
    Added support for customizing event policies.
    Added support for customizing event policies so you can identify cluster events more efficiently.
    2020-10-13

    September 2020

    Update
    Description
    Release Date
    Documentation
    Released a Hadoop cluster version—EMR v2.5.0.
    Upgraded the Alluxio component to the stable version 2.3.0, which delivers better performance in the use cases where compute and storage are separated.
    September 17, 2020

    August 2020

    Update
    Description
    Release Date
    Documentation
    Released a Hadoop cluster version—EMR v2.4.0.
    Added the Kudu component and upgraded some existing components.
    August 27, 2020
    Added support for data migration in ClickHouse clusters.
    Improved cluster resource utilization for data security.
    August 17, 2020

    July 2020

    Update
    Description
    Release Date
    Documentation
    Added support for custom configuration files.
    Added support for custom configuration files, which improves the flexibility of configuration management.
    July 29, 2020
    Optimized configuration item editing.
    Added descriptions for configuration items and support for restoring them to defaults.
    2020-07-29
    -

    June 2020

    Update
    Description
    Release Date
    Documentation
    Added support for Druid service monitoring and HBase Thrift role monitoring.
    Improved troubleshooting efficiency.
    June 15, 2020
    Released a Hadoop cluster version—EMR v2.3.0.
    Added support for the TensorFlow and Jupyter Notebook components.
    June 15, 2020
    Released ClickHouse v1.1.0 for ClickHouse clusters.
    Upgraded the ClickHouse component version to the LTS version, and added support for the Superset component.
    June 15, 2020
    -
    Added support for cluster events and cluster inspections.
    Added support for recording major change events and exception events in clusters in the console for improved efficiency of cluster troubleshooting. Added support for one-time inspections and periodical inspections, making it easier to keep track of the health of your clusters and to deal with exceptions and risks in time.
    June 4, 2020

    May 2020

    Update
    Description
    Release Date
    Documentation
    Optimized console interactions, UI, and operation paths.
    Improved operation path hierarchy for easier service management.
    May 15, 2020
    -
    Added support for service monitoring for ClickHouse clusters.
    Made it easier to keep track of the operation status of ClickHouse clusters.
    May 15, 2020
    Added support for monitoring status for role management.
    Made it easier to keep track of the real-time status of role processes.
    May 15, 2020
    -

    April 2020

    Update
    Description
    Release Date
    Documentation
    Added new cluster types.
    Added support for the ClickHouse and Druid clusters to provide more real-time query solutions.
    April 15, 2020
    Optimized bootstrap actions.
    Added support for the running occasions of bootstrap actions before a cluster starts. Added support for adjusting bootstrap actions after a cluster is created, so you can change your bootstrap actions based on business changes.
    April 15, 2020
    -
    Optimized service restart policies.
    Added support for setting service restart policies, so you can select a proper restart method and a policy for handling restart exceptions.
    2020-04-15
    -

    March 2020

    Update
    Description
    Release Date
    Documentation
    Optimized the cluster monitoring page.
    Optimized the cluster overview, service monitoring, and node monitoring pages for improved readability. Monitoring metrics now support customization and heat maps about nodes.
    March 2020
    -
    Added support for log search.
    Added support for filtering by log file, node IP, and time range, and viewing cluster log content. (Currently, this feature is supported only in Guangzhou region.)
    2020-03
    Released EMR v2.2.0.
    Upgraded Hadoop to v2.8.5. Upgraded common components such as Spark, Hive, and HBase. Added the Hudi, Superset, Livy, Impala, Zeppelin, and Kylin components.
    2020-03

    February 2020

    Update
    Description
    Release Date
    Documentation
    Added support for sharing Hive metadatabase.
    Added support for associating an external Hive metadatabase to store the Hive metadata of a new cluster, so multiple Hive clusters can share metadata.
    February 2020
    Optimized cluster operation logs.
    Added display items for cluster operation logs to increase the readability of operation logs.
    February 2020
    -
    Released the international version.
    Released the international version in Beijing, Shanghai, Guangzhou, and Mumbai regions.
    2020-02
    -

    January 2020

    Update
    Description
    Release Date
    Documentation
    Added support for cloud disk encryption.
    Added support for cloud disk encryption for Cloud Block Storage (CBS) users on the allowlist when creating an EMR cluster.
    January 2020
    Added support for mounting cloud disks to a task node.
    Added support for mounting cloud disks to a task node when creating or scaling out a cluster.
    January 2020
    -
    Released EMR in Nanjing region.
    Released EMR in Nanjing region.
    2020-01
    -

    December 2019

    Update
    Description
    Release Date
    Documentation
    Released the feature of delivering group configuration.
    Added support for delivering group configuration. If the configuration of a node is different from that of the configuration group to which the node belongs, the configuration of the configuration group can be delivered to the node.
    December 2019
    -
    Released the feature of resource-level CAM authorization.
    Added support for CAM authorization at the resource level.
    December 2019
    -
    Released the feature of associating CHDFS.
    Added support for associating CHDFS and reading/writing data on CHDFS.
    December 2019
    Released the AMD model.
    Released the AMD Standard SA2 model in Beijing, Shanghai, and Guangzhou regions.
    2019-12
    Added the cluster monitoring overview page.
    Added the cluster monitoring overview page, which provides the views about the cluster, node, and service status.
    December 2019
    Added support for selecting metric display granularity as needed on the service monitoring page.
    Optimized the service monitoring page, so you can select a metric display granularity as needed.
    December 2019
    -
    Added support for node service deployment and load status views on the node monitoring page.
    Optimized the node monitoring page, which provides the views about node service deployment and load status.
    December 2019
    -

    November 2019

    Update
    Description
    Release Date
    Documentation
    Added support for node specification management.
    Added support for setting the default specification of nodes based on their billing mode. The default specification is pay-as-you-go.
    2019-11
    Added support for the configuration of the ZooKeeper, Alluxio, and Flink components.
    Added support for the configuration of the ZooKeeper, Alluxio, and Flink components.
    November 2019
    -
    Released the feature of tagging clusters and nodes.
    Added support for tagging clusters and nodes.
    November 2019
    Released new models in Beijing, Shanghai, and Guangzhou regions.
    Released the S5, M5, C3, and CN3 models in Beijing, Shanghai, and Guangzhou regions.
    2019-11
    -

    October 2019

    Update
    Description
    Release Date
    Documentation
    Released EMR v3.0.0.
    Released EMR v3.0.0 with updated versions of major components.
    October 2019

    September 2019

    Update
    Description
    Release Date
    Documentation
    Added full support for TencentCloud API 3.0.
    Added full support for TencentCloud API 3.0. Standardized the output/input parameters of certain existing v3.0 APIs. Added full support for v2.0 APIs in v3.0.
    September 2019
    -
    Modified console configuration.
    Disused the escape feature for special characters.
    September 2019
    -
    Added support for CM alarm policy configuration.
    Added support for configuring alarm policies in CM (in the Elastic MapReduce product category) for key metrics for node and service monitoring.
    September 2019
    -

    August 2019

    Update
    Description
    Release Date
    Documentation
    Released the software configuration feature.
    Added support for software configuration, which enables you to create a cluster with custom component parameters. The feature of accessing external clusters was added as well.
    August 2019
    Added support for configuring the remote login port when you purchase a cluster.
    Added support for enabling or disabling the remote login port when you purchase a cluster.
    August 2019
    -
    Added support for mounting multiple cloud disks to a new cluster.
    Added support for mounting multiple cloud disks to a new cluster.
    August 2019
    -
    Released the feature of scaling specified components.
    Added support for scaling specified components.
    August 2019
    -
    Added monitoring metrics.
    Added new monitoring metrics for the Spark, Hive, Presto, and ZooKeeper components.
    August 2019
    -

    July 2019

    Update
    Description
    Release Date
    Documentation
    Released the feature of HBase table-level monitoring.
    Added support for HBase table-level monitoring, which covers the number of read and write requests and storage of each table in HBase.
    July 2019
    Released EMR in new regions.
    Added support for the Singapore, Mumbai, and Chengdu regions.
    July 2019
    -
    Released new models.
    Released the Standard S4 and Standard Network-Optimized SN3ne models in Beijing, Shanghai, and Guangzhou regions.
    2019-07
    -
    Optimized the interactions of monitoring pages and added new monitoring metrics.
    Optimized the interactions of monitoring pages and added new monitoring metrics.
    July 2019
    -
    Optimized WebUI proxy address.
    Optimized WebUI proxy address.
    July 2019
    -

    June 2019

    Update
    Description
    Release Date
    Documentation
    Released the feature of accessing external clusters.
    Added support for accessing external clusters.
    June 2019
    -
    Released the feature of setting bootstrap actions.
    Added support for setting bootstrap actions.
    June 2019
    Released the feature of delivering component parameter configuration to nodes.
    Added support for delivering component parameter configuration to nodes.
    June 2019
    -
    Released the feature of rolling back parameter configuration.
    Added support for rolling back parameter configuration.
    June 2019

    May 2019

    Update
    Description
    Release Date
    Documentation
    Released EMR v2.1.0.
    Released EMR v2.1.0 with updated versions of main components.
    May 2019
    Added support for Kerberos security clusters.
    Added support for creating security clusters. The open source components in clusters are launched in Kerberos security mode. In this security environment, only authenticated clients can access the services (such as HDFS) of the clusters.
    May 2019
    Optimized monitoring metrics.
    Optimized the Node, HDFS, YARN, and HBase monitoring metrics.
    May 2019
    Optimized the style of console.
    Improved the style of console for a better interactive experience.
    May 2019
    -
    Optimized CVM and TencentDB naming.
    Optimized CVM and TencentDB naming with the EMR cluster serial number for easier locating of cluster information.
    May 2019
    -
    Changed the setting of public IPs of master nodes to optional.
    Changed the setting of public IPs of master nodes to optional.
    May 2019
    -
    Released the feature of adjusting the number of common nodes.
    Added support for adjusting the number of common nodes as needed.
    May 2019
    -

    March 2019

    Update
    Description
    Release Date
    Documentation
    Released new models.
    Released the I3 model in Beijing, Shanghai, and Guangzhou regions. This model is included in the CVM allowlist, and you can purchase it only if you are in the I3 allowlist.
    March 2019
    -
    Released EMR in a new region.
    Made the purchase of EMR clusters available in the Silicon Valley region.
    March 2019
    -
    Added support for router nodes.
    Added support for router nodes, which are mainly used to relieve the load of master nodes and as task submitters.
    March 2019
    Released the feature of adjusting node configuration.
    Added support for adjusting node configuration. Nodes can be upgraded to a higher configuration.
    March 2019

    January 2019

    Update
    Description
    Release Date
    Documentation
    Added new components to existing clusters.
    Added support for adding new components to existing clusters.
    January 2019
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support