tencent cloud

Data Lake Compute

Release Notes
Product Introduction
Overview
Strengths
Use Cases
Purchase Guide
Billing Overview
Refund
Payment Overdue
Configuration Adjustment Fees
Getting Started
Complete Process for New User Activation
DLC Data Import Guide
Quick Start with Data Analytics in Data Lake Compute
Quick Start with Permission Management in Data Lake Compute
Quick Start with Partition Table
Enabling Data Optimization
Cross-Source Analysis of EMR Hive Data
Standard Engine Configuration Guide
Configuring Data Access Policy
Operation Guide
Console Operation Introduction
Development Guide
Runtime Environment
SparkJar Job Development Guide
PySpark Job Development Guide
Query Performance Optimization Guide
UDF Function Development Guide
System Restraints
Client Access
JDBC Access
TDLC Command Line Interface Tool Access
Third-party Software Linkage
Python Access
Practical Tutorial
Accessing DLC Data with Power BI
Table Creation Practice
Using Apache Airflow to Schedule DLC Engine to Submit Tasks
Direct Query of DLC Internal Storage with StarRocks
Spark cost optimization practice
DATA + AI
Using DLC to Analyze CLS Logs
Using Role SSO to Access DLC
Resource-Level Authentication Guide
Implementing Tencent Cloud TCHouse-D Read and Write Operations in DLC
DLC Native Table
SQL Statement
SuperSQL Statement
Overview of Standard Spark Statement
Overview of Standard Presto Statement
Reserved Words
API Documentation
History
Introduction
API Category
Making API Requests
Data Table APIs
Task APIs
Metadata APIs
Service Configuration APIs
Permission Management APIs
Database APIs
Data Source Connection APIs
Data Optimization APIs
Data Engine APIs
Resource Group for the Standard Engine APIs
Data Types
Error Codes
General Reference
Error Codes
Quotas and limits
Operation Guide on Connecting Third-Party Software to DLC
FAQs
FAQs on Permissions
FAQs on Engines
FAQs on Features
FAQs on Spark Jobs
DLC Policy
Privacy Policy
Data Privacy And Security Agreement
Service Level Agreement
Contact Us

Standard S1.1 (Native) Runtime Environment

PDF
Focus Mode
Font Size
Last updated: 2025-09-25 11:46:31

System Environment

OS:TencentOS Server 3.1 (Final)
Java:TencentKonaJDK 11.0.28+1
Scala:2.12.18
Python:3.9.20

Built-in dependencies in the image

Installed Java and Scala Libraries

activation-1.1.1.jar
aircompressor-0.27.jar
algebra_2.12-2.0.1.jar
aliyun-java-sdk-core-4.5.10.jar
aliyun-java-sdk-kms-2.11.0.jar
aliyun-java-sdk-ram-3.1.0.jar
aliyun-sdk-oss-3.13.0.jar
alluxio-core-client-ext-2.9.3-tq-1.1.9.jar
alluxio-shaded-client-2.10.0-20231107.094109-1.jar
amoro-format-mixed-spark-runtime-3.5-0.8.0.3.jar
annotations-17.0.0.jar
antlr4-runtime-4.9.3.jar
antlr-runtime-3.5.2.jar
aopalliance-repackaged-2.6.1.jar
argparse4j-0.7.0.jar
arpack-3.0.3.jar
arpack_combined_all-0.1.jar
arrow-format-12.0.1.jar
arrow-memory-core-12.0.1.jar
arrow-memory-netty-12.0.1.jar
arrow-vector-12.0.1.jar
audience-annotations-0.5.0.jar
avro-1.11.2.jar
avro-ipc-1.11.2.jar
avro-mapred-1.11.2.jar
aws-java-sdk-bundle-1.11.1026.jar
azure-data-lake-store-sdk-2.3.9.jar
azure-keyvault-core-1.0.0.jar
azure-storage-7.0.1.jar
blas-3.0.3.jar
bonecp-0.8.0.RELEASE.jar
breeze_2.12-2.1.0.jar
breeze-macros_2.12-2.1.0.jar
caffeine-2.8.0.jar
cats-kernel_2.12-2.1.1.jar
chdfs_hadoop_plugin_network-2.8.jar
checker-qual-2.10.0.jar
chill_2.12-0.10.0.jar
chill-java-0.10.0.jar
commons-cli-1.5.0.jar
commons-codec-1.16.1.jar
commons-collections-3.2.2.jar
commons-collections4-4.4.jar
commons-compiler-3.1.9.jar
commons-compress-1.23.0.jar
commons-crypto-1.1.0.jar
commons-dbcp-1.4.jar
commons-httpclient-3.0.1.jar
commons-io-2.16.1.jar
commons-lang-2.6.jar
commons-lang3-3.12.0.jar
commons-logging-1.1.3.jar
commons-math3-3.6.1.jar
commons-pool-1.5.4.jar
commons-pool2-2.11.1.jar
commons-text-1.10.0.jar
compress-lzf-1.1.2.jar
cos_api-bundle-5.6.244.4.jar
cosn-ranger-interface-1.0.3.jar
curator-client-2.13.0.jar
curator-framework-2.13.0.jar
curator-recipes-2.13.0.jar
datanucleus-api-jdo-4.2.4.jar
datanucleus-core-4.1.17.jar
datanucleus-rdbms-4.1.19.jar
datasketches-java-3.3.0.jar
datasketches-memory-2.1.0.jar
derby-10.14.2.0.jar
dlc-serde-1.0.1.jar
dlc-spark-lineage-spark35-1.0.2.jar
dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
error_prone_annotations-2.3.3.jar
file-level-sasm-3.5.1-dlc-merging-1.0.2.jar
flatbuffers-java-1.12.0.jar
gcs-connector-hadoop3-2.2.14-shaded.jar
geotools-wrapper-1.6.1-28.2.jar
gluten-velox-bundle-spark3.5_2.12-linux_amd64-1.5.0-SNAPSHOT.jar
goosefs-client-1.4.2.jar
gson-2.2.4.jar
guava-14.0.1.jar
hadoop-aliyun-3.3.2.jar
hadoop-annotations-3.3.2.jar
hadoop-aws-3.3.2.jar
hadoop-azure-3.3.2.jar
hadoop-azure-datalake-3.3.2.jar
hadoop-client-api-3.3.2.jar
hadoop-client-runtime-3.3.2.jar
hadoop-cloud-storage-3.3.2.jar
hadoop-cos-8.3.22-dlc-m315.jar
hadoop-lzo-0.4.20.jar
hadoop-openstack-3.3.2.jar
hadoop-shaded-guava-1.1.1.jar
hbase-client-2.3.5.jar
hbase-common-2.3.5.jar
hbase-protocol-shaded-2.3.5.jar
hbase-shaded-mapreduce-2.3.5.jar
hbase-shaded-miscellaneous-3.3.0.jar
hbase-shaded-netty-3.3.0.jar
hbase-shaded-protobuf-3.3.0.jar
hbase-spark-1.0.1-3.2.1-2261.jar
hbase-spark-protocol-1.0.1-3.2.1-2261.jar
hbase-spark-protocol-shaded-1.0.1-3.2.1-2261.jar
HikariCP-2.5.1.jar
hive-beeline-2.3.7-dlc-226.jar
hive-cli-2.3.7-dlc-226.jar
hive-common-2.3.7-dlc-226.jar
hive-exec-2.3.7-dlc-226-core.jar
hive-hcatalog-core-2.3.7-dlc-226.jar
hive-jdbc-2.3.7-dlc-226.jar
hive-llap-common-2.3.7-dlc-226.jar
hive-metastore-2.3.7-dlc-226.jar
hive-serde-2.3.7-dlc-226.jar
hive-service-rpc-3.1.3.jar
hive-shims-0.23-2.3.7-dlc-226.jar
hive-shims-2.3.7-dlc-226.jar
hive-shims-common-2.3.7-dlc-226.jar
hive-shims-scheduler-2.3.7-dlc-226.jar
hive-storage-api-2.8.1.jar
hk2-api-2.6.1.jar
hk2-locator-2.6.1.jar
hk2-utils-2.6.1.jar
htrace-core4-4.1.0-incubating.jar
httpclient-4.5.14.jar
httpcore-4.4.16.jar
iceberg-extend-f2.9.5.rc0.jar
iceberg-spark-runtime-3.5_2.12-1.5.0-t281.3-tencent.jar
ini4j-0.5.4.jar
istack-commons-runtime-3.0.8.jar
ivy-2.5.1.jar
jackson-annotations-2.15.2.jar
jackson-core-2.15.2.jar
jackson-core-asl-1.9.13.jar
jackson-databind-2.15.2.jar
jackson-dataformat-cbor-2.15.2.jar
jackson-dataformat-csv-2.10.5.jar
jackson-dataformat-yaml-2.15.2.jar
jackson-datatype-jdk8-2.10.5.jar
jackson-datatype-jsr310-2.15.2.jar
jackson-mapper-asl-1.9.13.jar
jackson-module-scala_2.12-2.15.2.jar
jakarta.annotation-api-1.3.5.jar
jakarta.inject-2.6.1.jar
jakarta.servlet-api-4.0.3.jar
jakarta.validation-api-2.0.2.jar
jakarta.ws.rs-api-2.1.6.jar
jakarta.xml.bind-api-2.3.2.jar
janino-3.1.9.jar
javassist-3.29.2-GA.jar
javax.jdo-3.2.0-m3.jar
javolution-5.5.1.jar
jaxb-api-2.2.11.jar
jaxb-runtime-2.3.2.jar
jcl-over-slf4j-2.0.7.jar
jdo-api-3.0.1.jar
jdom2-2.0.6.jar
jersey-client-2.40.jar
jersey-common-2.40.jar
jersey-container-servlet-2.40.jar
jersey-container-servlet-core-2.40.jar
jersey-hk2-2.40.jar
jersey-server-2.40.jar
jettison-1.1.jar
jetty-util-9.4.54.v20240208.jar
jetty-util-ajax-9.4.54.v20240208.jar
JLargeArrays-1.5.jar
jline-2.14.6.jar
job-level-sasm-3.5.1-dlc-merging-1.0.2.jar
joda-time-2.12.5.jar
jodd-core-3.5.2.jar
jopt-simple-5.0.4.jar
jpam-1.1.jar
json-1.8.jar
json4s-ast_2.12-3.7.0-M11.jar
json4s-core_2.12-3.7.0-M11.jar
json4s-jackson_2.12-3.7.0-M11.jar
json4s-scalap_2.12-3.7.0-M11.jar
json-serde-1.3.8-jar-with-dependencies.jar
jsr305-3.0.0.jar
jta-1.1.jar
JTransforms-3.1.jar
jul-to-slf4j-2.0.7.jar
kafka_2.12-2.8.0.jar
kafka-clients-2.8.0.jar
kafka-metadata-2.8.0.jar
kafka-raft-2.8.0.jar
kryo-shaded-4.0.2.jar
kubernetes-client-6.7.2.jar
kubernetes-client-api-6.7.2.jar
kubernetes-httpclient-okhttp-6.7.2.jar
kubernetes-model-admissionregistration-6.7.2.jar
kubernetes-model-apiextensions-6.7.2.jar
kubernetes-model-apps-6.7.2.jar
kubernetes-model-autoscaling-6.7.2.jar
kubernetes-model-batch-6.7.2.jar
kubernetes-model-certificates-6.7.2.jar
kubernetes-model-common-6.7.2.jar
kubernetes-model-coordination-6.7.2.jar
kubernetes-model-core-6.7.2.jar
kubernetes-model-discovery-6.7.2.jar
kubernetes-model-events-6.7.2.jar
kubernetes-model-extensions-6.7.2.jar
kubernetes-model-flowcontrol-6.7.2.jar
kubernetes-model-gatewayapi-6.7.2.jar
kubernetes-model-metrics-6.7.2.jar
kubernetes-model-networking-6.7.2.jar
kubernetes-model-node-6.7.2.jar
kubernetes-model-policy-6.7.2.jar
kubernetes-model-rbac-6.7.2.jar
kubernetes-model-resource-6.7.2.jar
kubernetes-model-scheduling-6.7.2.jar
kubernetes-model-storageclass-6.7.2.jar
kyuubi-spark-authz_2.12-1.7.0-f295.jar
kyuubi-spark-sql-engine_2.12-1.8.1-20250610.111909-40.jar
lakefs-cosn-client-t2.8.1.jar
lapack-3.0.3.jar
leveldbjni-all-1.8.jar
libfb303-0.9.3.jar
libthrift-0.12.0.jar
livy-api-v0.8.0-dlc-m315.jar
livy-core_2.12-v0.8.0-dlc-m315.jar
livy-repl_2.12-v0.8.0-dlc-m315.jar
livy-rsc-v0.8.0-dlc-m315.jar
log4j-1.2-api-2.20.0.jar
log4j-api-2.20.0.jar
log4j-core-2.20.0.jar
log4j-slf4j2-impl-2.20.0.jar
logging-interceptor-3.12.12.jar
lz4-java-1.8.0.jar
metrics-core-2.2.0.jar
metrics-core-4.2.19.jar
metrics-graphite-4.2.19.jar
metrics-jmx-4.2.19.jar
metrics-json-4.2.19.jar
metrics-jvm-4.2.19.jar
minlog-1.3.0.jar
mysql-connector-j-8.0.33.jar
netty-all-4.1.96.Final.jar
netty-buffer-4.1.96.Final.jar
netty-codec-4.1.96.Final.jar
netty-codec-http2-4.1.96.Final.jar
netty-codec-http-4.1.96.Final.jar
netty-codec-socks-4.1.96.Final.jar
netty-common-4.1.96.Final.jar
netty-handler-4.1.96.Final.jar
netty-handler-proxy-4.1.96.Final.jar
netty-resolver-4.1.96.Final.jar
netty-transport-4.1.96.Final.jar
netty-transport-classes-epoll-4.1.96.Final.jar
netty-transport-classes-kqueue-4.1.96.Final.jar
netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar
netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar
netty-transport-native-kqueue-4.1.96.Final-osx-aarch_64.jar
netty-transport-native-kqueue-4.1.96.Final-osx-x86_64.jar
netty-transport-native-unix-common-4.1.96.Final.jar
objenesis-3.3.jar
okhttp-3.12.12.jar
okio-1.17.6.jar
opencsv-2.3.jar
opentracing-api-0.33.0.jar
opentracing-noop-0.33.0.jar
opentracing-util-0.33.0.jar
orc-core-1.9.4-shaded-protobuf.jar
orc-mapreduce-1.9.4-shaded-protobuf.jar
orc-shims-1.9.4.jar
oro-2.0.8.jar
osgi-resource-locator-1.0.3.jar
paranamer-2.8.jar
parquet-column-1.13.1.jar
parquet-common-1.13.1.jar
parquet-encoding-1.13.1.jar
parquet-format-structures-1.13.1.jar
parquet-hadoop-1.13.1.jar
parquet-jackson-1.13.1.jar
pickle-1.3.jar
polaris-factory-shaded-3.3.7.jar
postgresql-42.2.19.jar
py4j-0.10.9.7.jar
RoaringBitmap-0.9.45.jar
rocksdbjni-8.3.2.jar
scala-collection-compat_2.12-2.7.0.jar
scala-compiler-2.12.18.jar
scala-java8-compat_2.12-0.9.1.jar
scala-library-2.12.18.jar
scala-logging_2.12-3.9.2.jar
scala-parser-combinators_2.12-2.3.0.jar
scala-reflect-2.12.18.jar
scala-xml_2.12-2.1.0.jar
sedona-spark-shaded-3.5_2.12-1.6.1-202408.jar
shims-0.9.45.jar
slf4j-api-2.0.7.jar
slf4j-log4j12-1.7.9.jar
snakeyaml-2.0.jar
snakeyaml-engine-2.6.jar
snappy-java-1.1.10.5.jar
spark-analysis-listener-common-1.0.1.jar
spark-analysis-listener-core-1.0.9.jar
spark-avro_2.12-3.5.3-dlc.jar
spark-catalog-plugins-release-dlc-3.5.3-m315.jar
spark-catalyst_2.12-3.5.3-dlc.jar
spark-common-utils_2.12-3.5.3-dlc.jar
spark-core_2.12-3.5.3-dlc.jar
spark-doris-connector-3.1_2.12-1.3.1-dlc-f280.jar
spark-graphx_2.12-3.5.3-dlc.jar
spark-hadoop-cloud_2.12-3.5.3-dlc.jar
spark-hive_2.12-3.5.3-dlc.jar
spark-hive-thriftserver_2.12-3.5.3-dlc.jar
spark-kubernetes_2.12-3.5.3-dlc.jar
spark-kvstore_2.12-3.5.3-dlc.jar
spark-launcher_2.12-3.5.3-dlc.jar
spark-mllib_2.12-3.5.3-dlc.jar
spark-mllib-local_2.12-3.5.3-dlc.jar
spark-network-common_2.12-3.5.3-dlc.jar
spark-network-shuffle_2.12-3.5.3-dlc.jar
spark-repl_2.12-3.5.3-dlc.jar
spark-sketch_2.12-3.5.3-dlc.jar
spark-sql_2.12-3.5.3-dlc.jar
spark-sql-api_2.12-3.5.3-dlc.jar
spark-sql-executor-1.0.1.jar
spark-sql-kafka-0-10_2.12-3.5.3-dlc.jar
spark-streaming_2.12-3.5.3-dlc.jar
spark-streaming-kafka-0-10_2.12-3.5.3-dlc.jar
spark-tags_2.12-3.5.3-dlc.jar
spark-token-provider-kafka-0-10_2.12-3.5.3-dlc.jar
spark-unsafe_2.12-3.5.3-dlc.jar
spire_2.12-0.17.0.jar
spire-macros_2.12-0.17.0.jar
spire-platform_2.12-0.17.0.jar
spire-util_2.12-0.17.0.jar
ST4-4.0.4.jar
stax-api-1.0.1.jar
stream-2.9.6.jar
super-csv-2.2.0.jar
task-level-sasm-3.5.1-dlc-merging-1.0.2.jar
tdsql-pg-connector-java8-1.1.3.jar
threeten-extra-1.7.1.jar
tink-1.9.0.jar
transaction-api-1.1.jar
univocity-parsers-2.9.1.jar
wildfly-openssl-1.0.7.Final.jar
xbean-asm9-shaded-4.23.jar
xz-1.9.jar
zjsonpatch-0.3.0.jar
zookeeper-3.6.3.jar
zookeeper-jute-3.6.3.jar
zstd-jni-1.5.5-4.jar

Installed Python Libraries

Package Version
---------------------------------- --------------
aiohappyeyeballs 2.6.1
aiohttp 3.11.2
aiosignal 1.4.0
alembic 1.16.5
anyio 4.10.0
argon2-cffi 25.1.0
argon2-cffi-bindings 25.1.0
arrow 1.3.0
asttokens 3.0.0
async-lru 2.0.5
async-timeout 5.0.1
attrs 25.3.0
babel 2.17.0
beautifulsoup4 4.13.5
bleach 6.2.0
blinker 1.9.0
cachetools 5.5.2
certifi 2025.8.3
cffi 2.0.0
charset-normalizer 3.4.3
click 8.1.8
cloudpickle 3.1.1
comm 0.2.3
confluent-kafka 2.11.1
contourpy 1.3.0
cos_python_sdk_v5 1.9.38
coscmd 1.9.0.6
crcmod 1.7
cycler 0.12.1
databricks-sdk 0.66.0
DateTime 5.5
debugpy 1.8.17
decorator 5.2.1
defusedxml 0.7.1
dlcmagic 1.0.8.post2
docker 7.1.0
exceptiongroup 1.3.0
executing 2.2.1
fastjsonschema 2.21.2
Flask 3.1.2
fonttools 4.60.0
fqdn 1.5.1
frozenlist 1.7.0
gitdb 4.0.12
GitPython 3.1.45
google-auth 2.40.3
graphene 3.4.3
graphql-core 3.2.6
graphql-relay 3.2.0
greenlet 3.2.4
grpcio 1.75.0
gunicorn 23.0.0
h11 0.16.0
httpcore 1.0.9
httpx 0.28.1
idna 3.10
importlib_metadata 8.7.0
importlib_resources 6.5.2
ipykernel 6.30.1
ipython 8.18.1
isoduration 20.11.0
itsdangerous 2.2.0
jedi 0.19.2
Jinja2 3.1.6
joblib 1.5.2
json5 0.12.1
jsonpointer 3.0.0
jsonschema 4.25.1
jsonschema-specifications 2025.9.1
jupyter_client 8.6.3
jupyter_core 5.8.1
jupyter-events 0.12.0
jupyter-lsp 2.2.6
jupyter_server 2.17.0
jupyter_server_terminals 0.5.3
jupyterlab 4.4.7
jupyterlab_pygments 0.3.0
jupyterlab_server 2.27.3
kiwisolver 1.4.7
lark 1.3.0
Mako 1.3.10
Markdown 3.9
MarkupSafe 3.0.2
matplotlib 3.9.4
matplotlib-inline 0.1.7
mistune 3.1.4
mlflow 2.17.2
mlflow-skinny 2.17.2
multidict 6.6.4
nbclient 0.10.2
nbconvert 7.16.6
nbformat 5.10.4
nest-asyncio 1.6.0
notebook 7.4.5
notebook_shim 0.2.4
numpy 1.24.2
opentelemetry-api 1.37.0
opentelemetry-sdk 1.37.0
opentelemetry-semantic-conventions 0.58b0
overrides 7.7.0
packaging 24.2
pandas 1.5.3
pandocfilters 1.5.1
parso 0.8.5
pexpect 4.9.0
pillow 11.3.0
pip 25.2
platformdirs 4.4.0
prettytable 3.16.0
prometheus_client 0.23.1
prompt_toolkit 3.0.52
propcache 0.3.2
protobuf 5.29.5
psutil 7.1.0
psycopg2-binary 2.9.5
ptyprocess 0.7.0
pure_eval 0.2.3
pyarrow 11.0.0
pyasn1 0.6.1
pyasn1_modules 0.4.2
pycparser 2.23
pycryptodome 3.23.0
Pygments 2.19.2
PyMySQL 1.0.2
pyparsing 3.2.5
python-dateutil 2.9.0.post0
python-json-logger 3.3.0
pytz 2025.2
PyYAML 6.0.2
pyzmq 27.1.0
referencing 0.36.2
requests 2.32.5
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rfc3987-syntax 1.1.0
rpds-py 0.27.1
rsa 4.9.1
scikit-learn 1.6.1
scipy 1.13.1
Send2Trash 1.8.3
setuptools 80.9.0
six 1.17.0
smmap 5.0.2
sniffio 1.3.1
soupsieve 2.8
SQLAlchemy 2.0.3
sqlparse 0.5.3
stack-data 0.6.3
tabulate 0.9.0
tencentcloud-dlc-udf 1.0.0
tencentcloud-dlc-udf-runtime 1.0.6
tencentcloud-dlc-utils 1.0.5
tencentcloud-sdk-python-common 3.0.1464
tencentcloud-sdk-python-ssm 3.0.1459
terminado 0.18.1
threadpoolctl 3.6.0
tinycss2 1.4.0
tomli 2.2.1
tornado 6.5.2
tqdm 4.67.1
traitlets 5.14.3
types-python-dateutil 2.9.0.20250822
typing_extensions 4.15.0
uri-template 1.3.0
urllib3 1.26.20
wcwidth 0.2.14
webcolors 24.11.1
webencodings 0.5.1
websocket-client 1.8.0
Werkzeug 3.1.3
xmltodict 1.0.2
yarl 1.20.1
zipp 3.23.0
zope.interface 8.0



Help and Support

Was this page helpful?

Help us improve! Rate your documentation experience in 5 mins.

Feedback