tencent cloud

Data Lake Compute

Engine Kernel Version

PDF
Focus Mode
Font Size
Last updated: 2026-04-15 21:29:50
DLC offers different kernel versions for various application scenarios, and has made extensive optimizations in features and performance for the kernel. An overview of the kernel versions is as follows.
For scenarios mainly involving interactive queries, we recommend using the Presto Engine, the SparkSQL Engine, and the latest kernel versions.
For scenarios primarily using batch jobs, we recommend using the Spark Job Engine and the Spark 3.2 Kernel Version.
Note:
The Presto engine has been deprecated and is only available for existing users.
Engine types
Kernel Version
Description
Presto
SuperSQL-P 1.0
Based on the native Presto 0.242 version, it supports dynamic loading of data sources, Dymanic Filter enhancement, Iceberg V2 table, INSERT OVERWRITE of non-partitioned tables, and Hive UDF execution.
SparkSQL
SuperSQL-S 1.0
It is implemented based on the original Spark3.2 version and supports Iceberg 1.1.0, Hudi 0.12.0 and adaptive Shuffle Manager on this basis.
SuperSQL-S 3.5
It is implemented based on the native Spark3.5 version, and supports Iceberg 1.5.0 and adaptive Shuffle Manager on this basis.
The current beta version is backward compatible with various SQL and data governance tasks of SuperSQL-S 1.0, providing a performance improvement of more than 33% over the S1.0 version.
SparkBatch
Spark 3.5
It is implemented based on the native Spark3.5 version, and supports Iceberg 1.5.0, Python3 and adaptive Shuffle Manager on this basis.
The current beta version is backward compatible with various SQL, jar, pyspark and data governance tasks of Spark 3.2, with a performance improvement of more than 33% over Spark 3.2.
Spark 3.2
It is implemented based on the original Spark3.2 version, which supports Iceberg 1.1.0, Hudi 0.12.0, Python3, and adaptive Shuffle Manager.
Spark 2.4
It is implemented based on the native Spark2.4 version, and supports Iceberg 0.13.1, Python2 and Python3 on this basis.


Help and Support

Was this page helpful?

Help us improve! Rate your documentation experience in 5 mins.

Feedback