Dynamic Name | Dynamic Description | Release Date | Documentation |
Flume Monitoring | EMR on CVM enhances Flume service role process information, Dashboard monitoring, and real-time GC logs | 2024-10-18 | |
Event | 1. EMR on CVM & EMR on TKE event records support searching by event record content 2. EMR on CVM enriches YARN application run duration, blacklisted NodeManager, and YARN insights-related events | 2024-10-18 | |
Log | EMR on CVM real-time logs support viewing GC log paths, with upgraded and optimized real-time log viewing paths; | 2024-10-18 | - |
Monitoring Metric | 1. EMR on CVM enriches node network TCP6 link state and related metrics 2. EMR on CVM enriches HDFS, Spark HistoryServer file descriptor count, and Kudu Server process memory metrics | 2024-10-18 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
StarRocks clusters support unified authentication | EMR on CVM adds OpenLDAP user authentication and Ranger access control for StarRocks cluster type | 2024-09-30 | |
EMR on TKE adds StarRocks component | EMR on TKE supports StarRocks component in EMR-TKE-V1.1.0 and above versions | 2024-09-21 | |
Auto-scaling | EMR on TKE supports auto-scaling for Trino and RSS Worker roles | 2024-09-21 | |
Event | EMR on CVM enriches App query metadata acceleration buckets, single bucket bandwidth, request frequency, and related event items | 2024-09-04 | |
Application Insights | 1. EMR on CVM enriches Spark Query Insights Overview 2. EMR on CVM enriches TrinoSQL query large table scan and other insight capabilities | 2024-09-02 | |
Storage Insights | 1. EMR on CVM enriches HDFS and COS integrated bucket storage with size, empty files, and hot/cold data insight feature 2. EMR on CVM adds insight feature for analyzing file tables such as small file tables, cold data tables, large file tables, and small file analysis based on Hive metadata | 2024-09-02 | |
Event | EMR on CVM enriches event item alert capabilities for the dimensions of CPU, memory, and IO resources | 2024-09-02 | |
Log | EMR on CVM supports console log delivery to CLS cloud product | 2024-09-02 | - |
Dynamic Name | Dynamic Description | Release Date | Documentation |
YARN Resource Scheduling | 1. Capacity scheduling supports planned mode 2. Optimize the scheduler switching interaction and the Tag scheduling switch path 3. Optimize the deployment activation logic steps; clearly display pending activation quantity prompts and content comparison 4. Under the Fair Scheduling strategy, it is necessary to support the formulation of resource ratios. Tag scheduling supports displaying node information and total information within each Tag | 2024-08-30 | |
Managed Node | EMR on CVM introduces a new resource type: Managed Node (abbr: MNode) | 2024-08-30 | |
New StarRocks version added: EMR-STARROCKS-V2.1.1 | EMR on CVM adds the standard distribution of StarRocks EMR-STARROCKS-V2.1.1, supporting storage-compute separation deployment scenarios | 2024-08-09 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
EMR on CVM Manage LDAP Authentication | The console supports enabling or disabling LDAP Authentication for Hive and Impala components, | 2024-07-10 | |
EMR on CVM Trino supports high availability | Trino HA is achieved through keepalived and High Availability Virtual IP (HAVIP). | 2024-07-10 | |
EMR on CVM Flame Graph | The node console supports querying and obtaining process flame graphs | 2024-07-02 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
EMR on CVM
has enhanced service monitoring | 1. Rich cluster memory weighting and disk weighting usage 2. HDFS Namenode RPC, Yarn queue, StarRocks Be disk status, and related metrics | June 26, 2024 | |
EMR on CVM has enriched event items | 1. Added 12 alert events such as CVM node memory Oom, node disk read-only, and Ping unreachable 2. Enriched event items related to Hive SQL compilation timeout, Impala Query job Create status, etc | June 26, 2024 | |
EMR on TKE Console features enriched | 1. Supports Hive and Spark services from custom definitions when creating new clusters and adding new components 2. Rich service termination and role stopping features | 2024-06-10 | |
EMR on TKE Monitoring Rich | 1. Enriched RSS service monitoring Dashboard and metrics alerts 2. Enhanced cluster and some component event items, with event alerts | 2024-06-10 | |
New EMR on TKE version | Released EMR on TKE V1.1.0, enriching the cosranger component in the new version | 2024-06-10 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
New StarRocks version added: EMR-STARROCKS-V2.1.0 | EMR on CVM adds the standard distribution of StarRocks EMR-STARROCKS-V2.1.0 | 2024-05-28 | |
EMR on TKE supports purchasing compute resources | Added linked purchase of compute resources and support for resource association with EMR on TKE clusters | 2024-05-28 | -- |
StarRocks query topology | EMR on CVM StarRocks cluster (StarRocks V3.1.8 and above) query supports DAG topology | 2024-05-28 | |
Spark Query Insights | EMR on CMV adds various dimensional metrics for Spark query management and supports multiple Spark insights | 2024-05-11 | |
Application Insights | 1. EMR on CVM adds Hive overview insights, supports scheduling-query dimensional insights, and resource optimization suggestions 2. EMR on CVM opens Hive and Yarn engine insight rule templates and can allocate on demand | 2024-05-11 | |
HDFS service files | EMR on CVM supports scheduled periodic export of HDFS file information | 2024-05-11 | |
Trino Query Management | 1. Trino Query supports viewing Error logs 2. Trino Query list optimized by time sorting | 2024-05-11 | - |
Impala Query Management | EMR on CVM enriches Impala Query Management with dimensions such as total FragmentInstances, remaining FragmentInstances, and Backend count | 2024-05-11 | - |
SR Managing a data table | EMR on CVM StarRocks Table Management - Added table schema information and support for filtering | 2024-05-11 | - |
Hive Query Insights | EMR on CVM enhances Hive insight items with input like too many small files, data reading lag, empty input and output, etc | 2024-05-11 | - |
Dynamic Name | Dynamic Description | Release Date | Documentation |
New Hadoop cluster version EMR v3.6.1 (Beta) | Added new Hadoop cluster type Beta version EMR v3.6.1, supports Spark Native Engine | 2024-04-28 | |
Auto-scaling supports cross-availability zone expansion | EMR on CVM auto-scaling supports cross-availability zone expansion for elastic nodes | April 9, 2024 | |
Rich Service Hosting | 1. EMR on CVM adds Filebeat, Flume, Knox services and configuration hosting 2. EMR on CVM adds HBase REST Server service hosting | April 9, 2024 | - |
Operation Log Experience Optimization | EMR on CVM Operation Logs have added a search feature, supporting searches by time, operation, operation details, and operator, as well as filtering by operation object and security level | April 9, 2024 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
EMR on CVM Added Service Monitoring | Added basic monitoring metrics for Goosefs service Cluster, Master, Worker | 2024-03-22 | |
EMR on CVM Rich Service Monitoring | 1. Enhance monitoring metrics related to Trino's queues and queries 2. Enhance Alluxio service cluster data read/write monitoring metrics 3. Enrich HDFS active file write count, optimize NameNode RPC metrics 4. StarRocks service metadata, Query/Update, BE resources, execution thread metrics support alarm 5. Optimize Impala service scaling roles to support role monitoring metrics | 2024-03-22 | |
Cluster Event | EMR on CVM enriches process OOMKiller kill events and supports alerts | 2024-03-22 | |
Cluster Logs | 1. EMR on CVM supports Spark SQL audit log filtering and export 2. EMR on CVM versions 270&280 optimize Trino logs by splitting collection by roles | 2024-03-22 | |
Interaction Optimization | EMR on CVM optimizes Hbase/Kudu data table management page interaction | 2024-03-22 | - |
New Hadoop cluster version EMR v2.8.0 | Added Hadoop 3.x standard distribution EMR v2.6.0, supports Spark 3.3.4, Trino 435, Flink 1.16.1, Iceberg 1.4.3, Hudi 0.14.1, Kyuubi 1.7.1 | 2024-03-08 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
Enriched Trino service applications | EMR on CVM adds multidimensional query management feature for Trino | January 30, 2024 | |
Enriched Yarn Insights | Yarn enriches insights on abnormal Stage execution time and Resource expenditure anomalies for same-origin scheduling | January 30, 2024 | |
Enriched StarRocks Service Application | 1. New database table daily statistics, multi-dimensional list of library table partitions 2. Added Service Export Task Management | January 30, 2024 | |
Event items enriched | EMR on CVM enriches HDFS small file proportion event items | January 30, 2024 | |
HDFS File Analysis Optimization | HDFS File Analysis Scope Displayed According to Configured Path Range | January 30, 2024 | |
Impala Enriches Hot Tables | Impala Query Management Supports Top Hot Data Tables and Hot Data Table Trend Views | January 30, 2024 | |
Scenario-Based Configuration Parameter Tuning and Specification Recommendation Optimization | EMR on CVM Hadoop cluster types for different application scenarios. Based on the selected components and the number of components, recommend reasonable machine types, specifications, and configuration optimization tuning. | January 17, 2024 | - |
Task Center Experience Optimization | The Task Center offers rich search criteria, supports node-level instruction aggregation display, and real-time task progress refreshes consistent with cluster status. | January 17, 2024 | |
Scale operations support task process concurrency | EMR on CVM: When scaling out or in the cluster, tasks can be performed on other nodes that are not the target of the current operation. For example, when scaling out, it is possible to scale in or restart services on another node. | January 17, 2024 | - |
Auto-scaling supports scaling group types | EMR on CVM auto-scaling supports new types of scaling groups. Scaling groups support setting scaling policies at the queue level. | January 17, 2024 | |
Support deployment from service self Definition | In the default EMR on CVM Hadoop scenario, some optional components support Uninstall in the console after deployment. When adding new components, service self Definition deployment is supported, and role-level addition and Uninstall are also supported. | January 17, 2024 | |
Export software configuration supports dimension and scope selection | EMR on CVM Export software configuration supports dimension and scope selection, enhancing export file use cases. | January 17, 2024 | |
Operation Log Optimization | EMR on CVM enhances operation log details, enriching content to help users quickly troubleshoot and locate issues. | January 17, 2024 | |
Supports mounting CBS | The EMR on CVM console supports the ability to attach external cloud disks and initialize disks. | January 17, 2024 | |
Console Node Ops | EMR on CVM node processes support viewing real-time logs and obtaining Thread Dump information. | January 17, 2024 | |
StarRocks Metrics | StarRocks service enriches 34 related metrics including BE primary key, Meta, etc., and 2 FE metrics, and corrects the unit of existing GC time metric to ms (original unit: seconds) | January 17, 2024 | |
HBase Thrift Metrics | EMR on CVM adds HBase Thrift role monitoring, enriching 31 related metrics such as JVM and JMX | January 17, 2024 | |
Overview - Node Comparison Optimization | EMR on CVM Cluster Overview Node Monitoring Comparison feature upgrade. Added node type options and support for comparing up to 20 nodes at once | January 17, 2024 | |
Event items enriched | Added event item for the number of currently unhealthy NodeManagers in YARN | January 17, 2024 | |
Other | TCOP > EMR (Dynamic) metric alarms enhanced for services such as ALLUXIO, ZEPPELIN, KUDU, DORIS, KYLIN, STORM, OOZIE | January 17, 2024 | - |
Dynamic Name | Dynamic Description | Release Date | Documentation |
TKE Version Release | Release EMR-TKE V1.0.1 version, EMR-TKE-DLC V1.0.0 version | November 17, 2023 | |
TKE Available regions | EMR on TKE launched in Singapore | November 17, 2023 | - |
TKE POD Operations and Maintenance enhanced | EMR on TKE POD Rebuild feature allows configuration item updates and supports POD Destruction | November 17, 2023 | |
Configuration association features are rich | During the EMR on CVM scale-out of TKE nodes, custom parameters support tolerance EMR on TKE HiveMetaStore supports DLC address association | November 17, 2023 | - |
Meta Database Interface upgrade | EMR on TKE & CVM optimizes Hive Metastore interface, only loading the deployed MetaDB's CDB | November 17, 2023 | - |
TKE supports Task Center | EMR on TKE adds Cluster Content Task Center feature | November 17, 2023 | - |
Adjust accessing COS | EMR on TKE accesses COS with read/write permissions using "service-related roles" | November 17, 2023 | - |
Dynamic Name | Dynamic Description | Release Date | Documentation |
Kyuubi Service Application enriched | EMR on CVM adds Kyuubi Query Management and Query Details | 2023-10-30 | |
Hive Service Application enriched | EMR on CVM Hive Query supports multiple insights, enriching query tables and scanning related information dimensions EMR on CVM Hive Query Management adds new insight item Perspective Insight Overview feature, observing distribution trends and insight item list | 2023-10-30 | |
Role Logs enriched | EMR on CVM enriches Yarn Service Timeline Server Logs | 2023-10-13 | |
Rich Service Metrics | EMR on CVM enriches Node Single Disk Metrics, OpenLdap Heartbeat, Yarn Queue Memory Usage Rate, Kyuubi, Hbase RS, Timeline Server, and 48 other monitoring indicators | 2023-10-13 | |
Event items enriched | EMR on CVM adds Yarn RM without Active State, HDFS NN no Checkpoint for an extended period, Yarn Application Job Running Failure Event Item, and fixes Scale-in Node False Alarm in Process Missing Events | 2023-10-13 | |
Other | EMR reports TCOP Monitoring Metrics Interface DescribeEMRInstances to support Resource-Level Authentication | 2023-10-13 | - |
Dynamic Name | Dynamic Description | Release Date | Documentation |
StarRocks Cluster Type adds Product Version StarRocks-V2.0.0 | Added Product Version StarRocks-V2.0.0, corresponding to Community StarRocks Version 3.1.2 | September 21, 2023 | |
StarRocks Query Management | StarRocks Cluster Type V1.4.0 and above versions support Query Management feature in the console | September 12, 2023 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
EMR-V3.5.0 Service Role Audit Logs Enhanced | EMR-V3.5.0 enhances HDFS, YARN, Hbase, Zookeeper Service Role Audit Logs | August 24, 2023 | |
Event items enriched | EMR on CVM adds HMaster Primary-Standby Switch, Zookeeper Leader Switching Event Item | August 24, 2023 | |
Added Hadoop Cluster Version EMR v3.6.0 | Added Hadoop 3.x Standard Release EMR v3.6.0, supporting Spark 3.3.2, Trino 414, Flink 1.16.1, Iceberg 1.1.0, Hudi 0.13.0, Kyuubi 1.7.0 | August 8, 2023 |
Dynamic Name | Dynamic Description | Release Date | Documentation |
Auto Scaling supports Hybrid Scaling | Auto Scaling supports hybrid execution of time policy and load policy. The load policy supports triggering scaling rules when multiple metrics are met | July 13, 2023 | |
Release now | Clusters or cloud data disks in isolation status support one-click release | July 13, 2023 | |
Log feature enhanced | EMR on CVM log feature upgrade, supports Filter Logs and Source Log Export and Download. EMR on CVM Console Logs add Kyuubi, Hue, Trino, SR | July 13, 2023 | |
Rich Service Metrics | Added Kyuubi monitoring indicators, enriched NameNode NameService dimensional monitoring indicators, PrestoSQL Query related monitoring indicators, Hbase RegionServer enriched monitoring indicators | July 13, 2023 | |
Enhanced API interface | Added DescribeHiveQueries, DescribeYarnApplications, DescribeImpalaQueries query interfaces | July 13, 2023 | - |
Dynamic Name | Dynamic Description | Release Date | Documentation |
Cross-Availability Zone Deployment enabled | Create Cluster Multi-AZ deployment feature available for use | 2023-06-30 | |
User Management feature optimized | After adding a new user through the Console User Management feature, it will be automatically synchronized to Ranger | 2023-06-30 | |
Hive Query Management enriched | Query List enriched with Execution Cycle and 10+ Dimensional Indicator Information New Query Overview with Multi-dimensional Metrics Distribution View Abnormal Hive Queries provide the capability to view execution logs online | 2023-06-30 | |
EMR on TKE Public Beta | Support the simple and fast deployment of open-source big data clusters using Tencent Cloud TKE (TKE) as the resource base, improving off-peak resource utilization rate and achieving cost optimization | 2023-06-25 |
Update | Description | Release Date | Documentation |
Added support for federation monitoring. | Query of monitoring metrics for the Router component and alerts are supported for HDFS federations. | 2023-05-18 | |
Added support for scaling based on the load of subqueues. | Auto-scaling based on the load of subqueues is supported. | 2023-05-18 |
Update | Description | Release Date | Documentation |
Released the StarRocks cluster version: StarRocks v1.4.0. | The StarRocks cluster version StarRocks v1.4.0 is released, corresponding to the open-source StarRocks v2.5.3. | 2023-04-18 | Product Releases and Component Versions |
Update | Description | Release Date | Documentation |
Added table analysis in Kudu. | Supported viewing information by table, Tablet, and TabletServer. Supported analyzing Tablet-level read and write QPS, storage size and other information. | 2023-03-24 | |
Added statistics by Region in HBase. | Added Region-level read QPS, write QPS and other information to help locate hot spots. | 2023-03-24 | |
Added more monitoring metrics and alarms. | For HiveMetaStore, more than 14 monitoring metrics and alarms (including the number of opened and connected processes, Get Table requests, and currently active requests) were added. For HiveServer2, more than 20 monitoring metrics and alarms (including the current requests and query submission time/average execution time) were added. For YARN, alarms for the queue CPU and memory usage in percentages were added. | 2023-03-24 | |
Added more health status events. | Two events were added: exception in service role health status and timeout of service role health status. | 2023-03-24 | |
Optimized log accuracy. | The log search accuracy was optimized, with search by keyword and by phrase supported. | 2023-03-24 | |
Released the Kafka cluster version: Kafka v2.0.0. | Released the Kafka cluster version Kafka v2.0.0, corresponding to the open-source Kafka v2.4.1. | 2023-03-23 | |
Released the StarRocks cluster version: StarRocks v1.3.0. | Released the StarRocks cluster version StarRocks v1.3.0, corresponding to the open-source Kafka v2.4.3. | 2023-03-10 | |
Released the Hadoop cluster version: JDK11-Beta-based EMR v4.0.0. | Released the Hadoop cluster version JDK11-Beta-based EMR v4.0.0, with all of its components running in the JDK 11 environment. | 2023-03-10 | |
Suspended the provision of the container-based EMR service. | The container-based EMR service was unavailable for purchase for feature update in progress. | 2023-03-10 |
Update | Description | Release Date | Documentation |
Added more metrics for job query in YARN. | Statistics of jobs submitted by users, resources consumed, and other information were added for job query in YARN. | 2023-02-09 | |
Added table analysis in Hive (based on Hive MetaStore). | Supported viewing global metrics at key dimensions such as total tables, total storage size, table count by access time, and trends. Supported viewing multi-dimensional data of tables and their partitions. | 2023-02-09 | |
Added the file-level analysis feature in HDFS. | Supported viewing HDFS data distribution at key dimensions such as file count and file size. Supported viewing and downloading the lists of top large files and top small files. | 2023-02-09 |
Update | Description | Release Date | Documentation |
Supported automatic node replacement | Task and router nodes can be monitored, and abnormal nodes can be replaced automatically, mitigating the risk of service unavailability due to node exceptions. | 2023-01-16 | |
Supported local disk repair | Local disk replacement events can be automatically monitored. After disk replacement, you can initialize the new disk in the console on your own. | 2023-01-16 | |
Update | Description | Release Date | Documentation |
Supported Java-GC online analysis. | Java-GC online log analysis is supported to help you troubleshoot process exceptions due to GC, collect and record GC logs in real time, and analyze the logs. | 2022-12-06 | |
Supported role-level monitoring of Kafka. | Kafka adds more than 70 role-level monitoring metrics and supports configuring alarms for core monitoring metrics. | 2022-12-06 | |
Added more default event-related metrics. | More event-related metrics are added, such as the UTC time and NTP time difference of the server, Kerberos response time, number of HDFS MissingBlocks, and safe mode for the HDFS NameNode. | 2022-12-06 | |
Added more default alarm policies for Kudu. | Kudu adds more alarm policies, such as the number of teservers, number of failed data directories, and number of full data directories. | 2022-12-06 | - |
Upgraded the configuration management feature. | The configuration status is added, and you can view the details of expired configuration and failed configuration. More configuration files, configuration items, configuration item descriptions, and configuration filters are added. | 2022-12-06 | |
Upgraded the YARN resource scheduling feature. | Label-based scheduling, queue deletion, and scheduling history viewing are supported. | 2022-12-06 | Capacity Scheduler |
Added client management. | The client management entry is added, and you can view the client information. | 2022-12-06 | |
Supported cloud disk adjustment. | You can adjust the cloud data disk models on nodes and expand and mount disks in the EMR console. Heterogeneous capacity is supported by the heterogeneous capabilities of cloud disks. | 2022-12-06 | |
Supported batch configuration of automatic renewal | You can batch enable/disable automatic renewal for nodes in the EMR console. | 2022-12-06 | |
Supported batch configuration adjustment. | The configurations of nodes in the same billing mode and the same region can be batch adjusted. | 2022-12-06 |
Update | Description | Release Date | Documentation |
Added more StarRocks monitoring metrics. | More basic monitoring metrics are added for various StarRocks roles. | 2022-11-03 | |
Supported Remote Shuffle Service (RSS) clusters for container-based EMR. | Container-based EMR supports RSS deployment in EKS. Spark clusters can be associated with RSS clusters. | 2022-11-01 | Overview |
Supported managed scaling for automatic scaling. | The managed scaling feature continuously monitors the load system of the YARN cluster and automatically adds or removes compute nodes. | 2022-11-01 | |
Update | Description | Release Date | Documentation |
Released a Hadoop cluster version of EMR v3.5.0 | The Hadoop cluster version of EMR v3.5.0 is released to support Hive v3.1.3, Spark v3.2.2, HBase v2.4.5, Flink v1.14.5, Trino v389, Iceberg v0.13.1, Delta Lake v2.0.0, Hudi v0.12.0, Zeppelin v0.10.1, Superset v1.5.1, and Ranger v2.3.0. | 2022-10-27 |
Update | Description | Release Date | Documentation |
Supported Impala percentile distribution statistics. | Impala query supports statistics collection for execution status distribution and multidimensional percentile distribution. More metrics are added for Impala queries, such as total/HDFS/Kudu scanned rows, memory peak, read/sent bytes, and internal total scanned/sent bytes. Overview and structured profile features are provided for queries that take more than 3 seconds to execute. | 2022-09-21 | |
Added more alarm policies for monitoring events. | 100+ monitoring metrics are added for Druid in the "Elastic MapReduce (dynamic)" category in CM, for which dynamic alarm policies can be configured. 20 default monitoring metrics for eight services are added for default alarm policies. Four Impala query events support alarm configuration through EventBridge. | 2022-09-21 | - |
Launched application comparison and application insights features for YARN job management. | You can view task information for TEZ jobs. Application-level insights and comparison are supported for Tez/Spark/MapReduce jobs. Task-level host monitoring metric comparison is supported for Tez/MapReduce jobs. The experience to use YARN task information and filter task time is optimized. | 2022-09-09 |
Update | Description | Release Date | Documentation |
Released a StarRocks cluster version: StarRocks v1.1.0. | Added support for StarRocks v2.2.2. | 2022-08-04 | |
Released a Druid cluster version: Druid v1.1.0. | Added support for Druid v0.23.0. | 2022-08-04 |
Update | Description | Release Date | Documentation |
Launched the overview page in the console. | The cluster overview page displays various information, such as cluster status, health status of running services, and event statistics. | 2022-07-22 | - |
Upgraded the cluster overview feature. | The cluster directory navigation is optimized and upgraded. The health status information of deployed services is refined to display real-time statistics of cluster events. | 2022-07-22 | |
Added new Impala query dimension and inspection items. | Dimensions of session ID, coordinator, and single-point memory peak are added. Four inspection items are added for Impala: query timeouts, total query failures, total query commits, and query execution failure rate. | 2022-07-22 | |
Added the Impala daemon role. | Over 70 visual Impala daemon metrics are added, which can trigger alarms in CM. | 2022-07-22 | |
Added new application APIs. | The API for collecting YARN application queue statistics is added. | 2022-07-22 | |
Released a Hadoop cluster version—EMR v2.7.0. | Added support for Hive 2.3.9, Spark 3.2.1, HBase 2.4.5, Flink 1.14.3, Trino 385, ZooKeeper 3.6.3, Iceberg 0.13.0, Hudi 0.11.0, Alluxio 2.8.0, Zeppelin 0.10.1, Superset 1.4.1, and Ranger 2.1.0. | 2022-07-18 | |
Improved the availability of the automatic scaling feature. | Scale-out rules support the hybrid deployment of multiple resource specifications as well as pay-as-you-go/spot instances. | 2022-07-07 | |
Added support for the RIT fixing tool for HBase. | Regions in the RIT status can be fixed. | 2022-07-07 | HBase RIT Fixing |
Started the open beta test for container-based EMR clusters. | Container-based EMR clusters become available in Beijing, Shanghai, and Guangzhou regions. | 2022-07-07 |
Update | Description | Release Date | Documentation |
Optimized the configuration management feature. | Configuration management is upgraded to support configuration filtering, categorization, and comparison. The delivery priority rules for configurations at different levels are optimized to support delivery at the minimum level first. A configuration group can be specified for the selected components. | 2022-06-20 | |
Added support for Hive query management. | The Hive service supports query management. | 2022-06-07 | |
Optimized the YARN job query. | YARN job query supports displaying task information and querying task logs. | 2022-06-07 | |
Connected to Pricing Center. | The pricing of EMR is connected to the Pricing Center, where you can query EMR node fees. | 2022-06-07 |
Update | Description | Release Date | Documentation |
Optimized the scaling feature. | New subnets can be added to expand cluster node capacity. The Kyuubi service supports scaling. | 2022-05-17 | |
Enhanced role management and user management. | User management supports batch import and export of users through APIs. Resource management supports displaying client information. The `DescribeClusterPhysicalMetaInfo` API is added for resource-level authentication. | 2022-05-17 | - |
Update | Description | Release Date | Documentation |
Released the EMR v3.4.0 for the Hadoop cluster. | Added support for Spark 3.2.1, Trino 372, Flink 1.14.3, HBase 2.4.5, ZooKeeper 3.6.3, Impala 4.0.0, Zeppelin 0.10.1, Alluxio 2.8.0, Hudi 0.10.1, Iceberg 0.13.1, and GooseFS 1.2.0. Renamed PrestoSQL as Trino in the new version and added support for Ranger. Monitoring metric alarms need to be configured according to Trino in the new version. | 2022-04-22 | Component VersionTrino Monitoring Metrics |
Enriched monitoring. | Launched the new version of the interactive features of the event list. Added event-related metrics such as node single-disk inode utilization, single-disk space utilization, single-disk IO utilization, all HBase HMasters standby, and all HDFS NameNodes standby. Added monitoring metrics of the HDFS-Data node, including the block count, used disk space, available disk space, and reserved disk space. | 2022-04-22 | |
Added support for container-based EMR clusters. | Added support for Spark deployment based on EKS in Beijing, Shanghai, Guangzhou, and Nanjing regions. | 2022-04-12 |
Update | Description | Release Date | Documentation |
Added the StarRocks cluster type. | Added the StarRocks cluster type and integrated open-source StarRocks. | 2022-03-11 | |
Added support for adding nodes without assigning ApplicationMasters by default. | Added support for adding nodes without assigning ApplicationMasters by default, ensuring that the running ApplicationMaster will not be terminated and the job can be performed normally. | 2022-03-08 | |
Added load-based scaling metrics. | Added load-based scaling metrics such as ContainerPending, AppPending, and AppRunning. | 2022-03-08 | |
Added support for setting node labels for added host resources. | Added support for setting YARN node labels for added host resources to increase the resource utilization efficiency. | 2022-03-08 | - |
Update | Description | Release Date | Documentation |
Released a Doris cluster version—Doris v1.2.0. | Released Doris v0.15. | 2022-01-21 | |
Added support for sharing component configurations. | Added support for sharing the components of an existing cluster with other clusters without deploying such components again. This makes it easier to manage multiple clusters with the same component configurations. | January 14, 2022 | |
Added monitoring metrics. | Added Kylin, Zeppelin, Oozie, Storm, Livy, and Kyuubi monitoring metrics.Added new CosRanger monitoring metrics. | - | |
Optimized log search. | Added support for more components and global regions and optimized log search interactions. | - |
Update | Description | Release Date | Documentation |
Added four use cases for the Hadoop cluster type. | Added the ZooKeeper, HBase, Presto, and Kudu use cases for the Hadoop cluster type to help you quickly create a cluster based on your business scenario. | 2021-12-17 | |
Launched a new purchase page. | Optimized the existing cluster creation process to support the placement group node dimension for unified resource management. | 2021-12-17 | |
Added support for system disk selection. | Added support for selecting the system disk type and size as needed. | 2021-12-17 | - |
Optimized the task center. | Added support for viewing the details of all tasks of the current cluster inside the cluster, and optimized the interaction path of the task center for easier viewing and use. | 2021-12-17 | - |
Launched diversified component operation features. | Added support for visually setting instruction-level operations of components such as HDFS and YARN. | 2021-12-07 | |
Added monitoring metrics. | Added Doris monitoring metrics.Adjusted the original HBase table load to HBase table-level monitoring. | 2021-12-07 | |
Upgraded the operating system. | Upgraded the operating systems of all EMR versions of the Hadoop type to TencentOS Server to provide a more stable, secure, and high-performance cloud native runtime environment.If you encounter any security issues related to the operating system of an existing cluster, contact us for assistance. | 2021-12-03 | Product Overview of TencentOS Server |
Update | Description | Release Date | Documentation |
Released a Hadoop cluster version—EMR v3.3.0. | Added support for HBase v2.3.5, Phoenix v5.1.2, Kudu v1.15.0, Hue v4.10.0, Hudi v0.8.0, Tez v0.10.1, Livy v0.8.0, Ganglia v3.7.2, Kyuubi v1.1.0, and LDAP v2.4.44. | September 28, 2021 | |
Added monitoring metrics. | Enriched Alluxio service monitoring metrics and added COSRanger monitoring metrics. | September 15, 2021 | |
Connected to Cloud Monitor's default alarms | Cloud Monitor supports default alarm policies for Elastic MapReduce metrics/events. | September 15, 2021 | - |
Update | Description | Release Date | Documentation |
Added support for YARN resource scheduling. | Added support for UI-based YARN resource scheduling configuration. | August 31, 2021 | |
Added support for user management. | Added support for visually managing Kerberos and Ranger users. | August 31, 2021 |
Update | Description | Release Date | Documentation |
Released a Hadoop cluster version—EMR v2.6.0. | Added support for Spark v3.0.2, Impala v3.4.0, GooseFS v1.0.0, OpenLDAP v2.4.44, Kyuubi v1.1.0, etc. | July 15, 2021 |
Update | Description | Release Date | Documentation |
Added support for YARN job query. | Added detailed metric statistics for YARN jobs. | June 24, 2021 | |
Added support for Impala query management. | Added detailed metric statistics for Impala query jobs. | June 24, 2021 | |
Added support for automatic scaling for the spot instance mode. | Added support for automatically adding compute nodes of the spot instance mode. | June 3, 2021 | |
Added support for graceful scale-in. | When a scale-in action is triggered, nodes that are executing tasks will not be released immediately. Instead, they will be released after completing the tasks. | June 3, 2021 | |
Added support for integrating Knox with Tez. | Added support for viewing Tez tasks via UI. | June 3, 2021 | |
Added availability zones. | Added support for Singapore Zone 3 and Tokyo Zone 2. | June 3, 2021 | - |
Added regions. | Added support for regions such as Frankfurt, Virginia, Bangkok, Mumbai, Tokyo, and Seoul. | June 3, 2021 | - |
Update | Description | Release Date | Documentation |
Released a Kafka cluster version—Kafka v1.0.0. | Added support for Kafka v1.1.1, KafkaManager v2.0.0.2, Knox v1.2.0, and ZooKeeper v3.6.1. | May 13, 2021 | |
Released a Doris cluster version—Doris v1.0.0. | Added support for Doris v0.13.0 and Knox v1.2.0. | May 13, 2021 |
Update | Description | Release Date | Documentation |
Released a Hadoop cluster version—EMR v3.2.0. | Added support for Hadoop v3.2.2, Spark v3.0.2, Presto v350, Flink v1.12.1, Alluxio v2.5.0, Ranger v2.1.0, Iceberg v0.11.0, and Hudi v0.7.0. | April 30, 2021 | |
Added the **Start/Stop Services** feature. | Added support for starting or stopping all services on a node. | April 27, 2021 | |
Released a Hadoop cluster version—EMR v2.5.1. | Added support for Alluxio v2.5.0 and Hudi v0.5.1. Alluxio supports COS Transparent-URI. | April 10, 2021 |
Update | Description | Release Date | Documentation |
Supported cluster restoration | You can renew monthly subscribed clusters in isolated status to restore them. | 2021-03-17 | |
Update | Description | Release Date | Documentation |
Released the EMR service in new regions on Tencent Cloud Chinese. | Added support for the Bangkok, Seoul, Tokyo, and Virginia regions on Tencent Cloud Chinese. | February 2, 2021 | - |
Update | Description | Release Date | Documentation |
Added the cluster script feature. | Added support for running a specified script on multiple nodes at a time for higher efficiency. | January 26, 2021 | |
Added support for cross-model configuration change. | You can select other models to change the node configuration when the current model is sold out. | January 26, 2021 | |
Added the auto scaling feature. | The auto scaling feature automatically adds or removes task nodes, helping you save costs while meeting the requirement for cluster computing power. | January 26, 2021 | |
Added monitoring metrics. | Added new monitoring metrics for the HDFS, Yarn, HBase, Hive, and Druid services. Added support for monitoring on the Kudu and Alluxio services. | January 13, 2021 | |
Released the EMR service in Singapore on the international version. | Added support for Singapore Zone 1 and Singapore Zone 2 on the international version. | January 13, 2021 | - |
Update | Description | Release Date | Documentation |
Released a Hadoop cluster version—EMR v3.1.0. | Added support for Impala v3.4.0, Flink v1.10.0, HBase v2.3.3, Phoenix v5.0.0, Alluxio v2.3.0, Kudu v1.13.0, and ZooKeeper v3.6.1. | December 14, 2020 |
Update | Description | Release Date | Documentation |
Released the EMR TianQiong edition. | Added support for Spark materialized views. | November 27, 2020 | |
Optimized monitoring and alarming. | Added support for setting alarms for disk monitoring metrics in Cloud Monitor (CM). Added support for customizing EMR monitoring dashboard in CM dashboard. Added support for subscribing to EMR event monitoring alarms in CM. | November 20, 2020 |
Update | Description | Release Date | Documentation |
Added support for Cloud Object Storage (COS) password-free access. | Added support for authorizing access to COS through roles. Authorized users do not need to enter an authorization key and private key. | 2020-10-26 | - |
Added new service inspection items to the inspection system. | Added the HDFS, Yarn, HBase, Hive, and ZooKeeper service inspection items, enhancing the health check of metrics. | 2020-10-13 | |
Added support for customizing event policies. | Added support for customizing event policies so you can identify cluster events more efficiently. | 2020-10-13 |
Update | Description | Release Date | Documentation |
Released a Hadoop cluster version—EMR v2.5.0. | Upgraded the Alluxio component to the stable version 2.3.0, which delivers better performance in the use cases where compute and storage are separated. | September 17, 2020 |
Update | Description | Release Date | Documentation |
Released a Hadoop cluster version—EMR v2.4.0. | Added the Kudu component and upgraded some existing components. | August 27, 2020 | |
Added support for data migration in ClickHouse clusters. | Improved cluster resource utilization for data security. | August 17, 2020 |
Update | Description | Release Date | Documentation |
Added support for custom configuration files. | Added support for custom configuration files, which improves the flexibility of configuration management. | July 29, 2020 | |
Optimized configuration item editing. | Added descriptions for configuration items and support for restoring them to defaults. | 2020-07-29 | - |
Update | Description | Release Date | Documentation |
Added support for Druid service monitoring and HBase Thrift role monitoring. | Improved troubleshooting efficiency. | June 15, 2020 | |
Released a Hadoop cluster version—EMR v2.3.0. | Added support for the TensorFlow and Jupyter Notebook components. | June 15, 2020 | |
Released ClickHouse v1.1.0 for ClickHouse clusters. | Upgraded the ClickHouse component version to the LTS version, and added support for the Superset component. | June 15, 2020 | - |
Added support for cluster events and cluster inspections. | Added support for recording major change events and exception events in clusters in the console for improved efficiency of cluster troubleshooting. Added support for one-time inspections and periodical inspections, making it easier to keep track of the health of your clusters and to deal with exceptions and risks in time. | June 4, 2020 |
Update | Description | Release Date | Documentation |
Optimized console interactions, UI, and operation paths. | Improved operation path hierarchy for easier service management. | May 15, 2020 | - |
Added support for service monitoring for ClickHouse clusters. | Made it easier to keep track of the operation status of ClickHouse clusters. | May 15, 2020 | |
Added support for monitoring status for role management. | Made it easier to keep track of the real-time status of role processes. | May 15, 2020 | - |
Update | Description | Release Date | Documentation |
Added new cluster types. | Added support for the ClickHouse and Druid clusters to provide more real-time query solutions. | April 15, 2020 | |
Optimized bootstrap actions. | Added support for the running occasions of bootstrap actions before a cluster starts. Added support for adjusting bootstrap actions after a cluster is created, so you can change your bootstrap actions based on business changes. | April 15, 2020 | - |
Optimized service restart policies. | Added support for setting service restart policies, so you can select a proper restart method and a policy for handling restart exceptions. | 2020-04-15 | - |
Update | Description | Release Date | Documentation |
Optimized the cluster monitoring page. | Optimized the cluster overview, service monitoring, and node monitoring pages for improved readability. Monitoring metrics now support customization and heat maps about nodes. | March 2020 | - |
Added support for log search. | Added support for filtering by log file, node IP, and time range, and viewing cluster log content. (Currently, this feature is supported only in Guangzhou region.) | 2020-03 | |
Released EMR v2.2.0. | Upgraded Hadoop to v2.8.5. Upgraded common components such as Spark, Hive, and HBase. Added the Hudi, Superset, Livy, Impala, Zeppelin, and Kylin components. | 2020-03 |
Update | Description | Release Date | Documentation |
Added support for sharing Hive metadatabase. | Added support for associating an external Hive metadatabase to store the Hive metadata of a new cluster, so multiple Hive clusters can share metadata. | February 2020 | |
Optimized cluster operation logs. | Added display items for cluster operation logs to increase the readability of operation logs. | February 2020 | - |
Released the international version. | Released the international version in Beijing, Shanghai, Guangzhou, and Mumbai regions. | 2020-02 | - |
Update | Description | Release Date | Documentation |
Added support for cloud disk encryption. | Added support for cloud disk encryption for Cloud Block Storage (CBS) users on the allowlist when creating an EMR cluster. | January 2020 | |
Added support for mounting cloud disks to a task node. | Added support for mounting cloud disks to a task node when creating or scaling out a cluster. | January 2020 | - |
Released EMR in Nanjing region. | Released EMR in Nanjing region. | 2020-01 | - |
Update | Description | Release Date | Documentation |
Released the feature of delivering group configuration. | Added support for delivering group configuration. If the configuration of a node is different from that of the configuration group to which the node belongs, the configuration of the configuration group can be delivered to the node. | December 2019 | - |
Released the feature of resource-level CAM authorization. | Added support for CAM authorization at the resource level. | December 2019 | - |
Released the feature of associating CHDFS. | Added support for associating CHDFS and reading/writing data on CHDFS. | December 2019 | |
Released the AMD model. | Released the AMD Standard SA2 model in Beijing, Shanghai, and Guangzhou regions. | 2019-12 | |
Added the cluster monitoring overview page. | Added the cluster monitoring overview page, which provides the views about the cluster, node, and service status. | December 2019 | |
Added support for selecting metric display granularity as needed on the service monitoring page. | Optimized the service monitoring page, so you can select a metric display granularity as needed. | December 2019 | - |
Added support for node service deployment and load status views on the node monitoring page. | Optimized the node monitoring page, which provides the views about node service deployment and load status. | December 2019 | - |
Update | Description | Release Date | Documentation |
Added support for node specification management. | Added support for setting the default specification of nodes based on their billing mode. The default specification is pay-as-you-go. | 2019-11 | |
Added support for the configuration of the ZooKeeper, Alluxio, and Flink components. | Added support for the configuration of the ZooKeeper, Alluxio, and Flink components. | November 2019 | - |
Released the feature of tagging clusters and nodes. | Added support for tagging clusters and nodes. | November 2019 | |
Released new models in Beijing, Shanghai, and Guangzhou regions. | Released the S5, M5, C3, and CN3 models in Beijing, Shanghai, and Guangzhou regions. | 2019-11 | - |
Update | Description | Release Date | Documentation |
Released EMR v3.0.0. | Released EMR v3.0.0 with updated versions of major components. | October 2019 |
Update | Description | Release Date | Documentation |
Added full support for TencentCloud API 3.0. | Added full support for TencentCloud API 3.0. Standardized the output/input parameters of certain existing v3.0 APIs. Added full support for v2.0 APIs in v3.0. | September 2019 | - |
Modified console configuration. | Disused the escape feature for special characters. | September 2019 | - |
Added support for CM alarm policy configuration. | Added support for configuring alarm policies in CM (in the Elastic MapReduce product category) for key metrics for node and service monitoring. | September 2019 | - |
Update | Description | Release Date | Documentation |
Released the software configuration feature. | Added support for software configuration, which enables you to create a cluster with custom component parameters. The feature of accessing external clusters was added as well. | August 2019 | |
Added support for configuring the remote login port when you purchase a cluster. | Added support for enabling or disabling the remote login port when you purchase a cluster. | August 2019 | - |
Added support for mounting multiple cloud disks to a new cluster. | Added support for mounting multiple cloud disks to a new cluster. | August 2019 | - |
Released the feature of scaling specified components. | Added support for scaling specified components. | August 2019 | - |
Added monitoring metrics. | Added new monitoring metrics for the Spark, Hive, Presto, and ZooKeeper components. | August 2019 | - |
Update | Description | Release Date | Documentation |
Released the feature of HBase table-level monitoring. | Added support for HBase table-level monitoring, which covers the number of read and write requests and storage of each table in HBase. | July 2019 | |
Released EMR in new regions. | Added support for the Singapore, Mumbai, and Chengdu regions. | July 2019 | - |
Released new models. | Released the Standard S4 and Standard Network-Optimized SN3ne models in Beijing, Shanghai, and Guangzhou regions. | 2019-07 | - |
Optimized the interactions of monitoring pages and added new monitoring metrics. | Optimized the interactions of monitoring pages and added new monitoring metrics. | July 2019 | - |
Optimized WebUI proxy address. | Optimized WebUI proxy address. | July 2019 | - |
Update | Description | Release Date | Documentation |
Released the feature of accessing external clusters. | Added support for accessing external clusters. | June 2019 | - |
Released the feature of setting bootstrap actions. | Added support for setting bootstrap actions. | June 2019 | |
Released the feature of delivering component parameter configuration to nodes. | Added support for delivering component parameter configuration to nodes. | June 2019 | - |
Released the feature of rolling back parameter configuration. | Added support for rolling back parameter configuration. | June 2019 |
Update | Description | Release Date | Documentation |
Released EMR v2.1.0. | Released EMR v2.1.0 with updated versions of main components. | May 2019 | |
Added support for Kerberos security clusters. | Added support for creating security clusters. The open source components in clusters are launched in Kerberos security mode. In this security environment, only authenticated clients can access the services (such as HDFS) of the clusters. | May 2019 | |
Optimized monitoring metrics. | Optimized the Node, HDFS, YARN, and HBase monitoring metrics. | May 2019 | |
Optimized the style of console. | Improved the style of console for a better interactive experience. | May 2019 | - |
Optimized CVM and TencentDB naming. | Optimized CVM and TencentDB naming with the EMR cluster serial number for easier locating of cluster information. | May 2019 | - |
Changed the setting of public IPs of master nodes to optional. | Changed the setting of public IPs of master nodes to optional. | May 2019 | - |
Released the feature of adjusting the number of common nodes. | Added support for adjusting the number of common nodes as needed. | May 2019 | - |
Update | Description | Release Date | Documentation |
Released new models. | Released the I3 model in Beijing, Shanghai, and Guangzhou regions. This model is included in the CVM allowlist, and you can purchase it only if you are in the I3 allowlist. | March 2019 | - |
Released EMR in a new region. | Made the purchase of EMR clusters available in the Silicon Valley region. | March 2019 | - |
Added support for router nodes. | Added support for router nodes, which are mainly used to relieve the load of master nodes and as task submitters. | March 2019 | |
Released the feature of adjusting node configuration. | Added support for adjusting node configuration. Nodes can be upgraded to a higher configuration. | March 2019 |
Update | Description | Release Date | Documentation |
Added new components to existing clusters. | Added support for adding new components to existing clusters. | January 2019 |
Was this page helpful?