tencent cloud

数据湖计算

产品动态
产品简介
产品概述
产品优势
应用场景
购买指南
计费概述
退费说明
欠费说明
调整配置费用说明
快速入门
新用户开通全流程
DLC 数据导入指引
一分钟入门 DLC 数据分析
一分钟入门 DLC 权限管理
一分钟入门分区表
开启数据优化
跨源分析 EMR Hive 数据
标准引擎配置指引
配置数据访问策略
操作指南
控制台操作介绍
开发指南
运行环境
SparkJar 作业开发指南
PySpark 作业开发指南
查询性能优化指南
UDF 函数开发指南
系统约束
客户端访问
JDBC 访问
TDLC 命令行工具访问
第三方软件联动
Python 访问
实践教程
通过 Power BI 访问 DLC 数据操作指南
建表实践
使用 Apache Airflow 调度 DLC 引擎提交任务
StarRocks 直接查询 DLC 内部存储
Spark 计算成本优化实践
DATA + AI
使用 DLC 分析 CLS 日志
使用角色 SSO 访问 DLC
资源级鉴权指南
在 DLC 中实现 TCHouse-D 读写操作
DLC 原生表
SQL 语法
SuperSQL 语法
标准 Spark 语法概览
标准 Presto 语法概览
保留字
API 文档
History
Introduction
API Category
Making API Requests
Data Table APIs
Task APIs
Metadata APIs
Service Configuration APIs
Permission Management APIs
Database APIs
Data Source Connection APIs
Data Optimization APIs
Data Engine APIs
Resource Group for the Standard Engine APIs
Data Types
Error Codes
通用类参考
错误码
配额与限制
第三方软件连接DLC操作指南
常见问题
权限类常见问题
引擎类常见问题
功能类常见问题
Spark 作业类常见问题
DLC 政策
隐私协议
数据处理和安全协议
服务等级协议
联系我们

Standard S1.1 运行环境

PDF
聚焦模式
字号
最后更新时间: 2025-09-25 11:46:31

系统环境

OS:TencentOS Server 3.1 (Final)
Java:TencentKonaJDK 11.0.28+1
Scala:2.12.18
Python:3.9.20

镜像内置依赖库

已安装的 Java 和 Scala 库


activation-1.1.1.jar
aircompressor-0.27.jar
algebra_2.12-2.0.1.jar
aliyun-java-sdk-core-4.5.10.jar
aliyun-java-sdk-kms-2.11.0.jar
aliyun-java-sdk-ram-3.1.0.jar
aliyun-sdk-oss-3.13.0.jar
alluxio-core-client-ext-2.9.3-tq-1.1.9.jar
alluxio-shaded-client-2.10.0-20231107.094109-1.jar
amoro-format-mixed-spark-runtime-3.5-0.8.0.3.jar
annotations-17.0.0.jar
antlr4-runtime-4.9.3.jar
antlr-runtime-3.5.2.jar
aopalliance-repackaged-2.6.1.jar
argparse4j-0.7.0.jar
arpack-3.0.3.jar
arpack_combined_all-0.1.jar
arrow-format-12.0.1.jar
arrow-memory-core-12.0.1.jar
arrow-memory-netty-12.0.1.jar
arrow-vector-12.0.1.jar
audience-annotations-0.5.0.jar
avro-1.11.2.jar
avro-ipc-1.11.2.jar
avro-mapred-1.11.2.jar
aws-java-sdk-bundle-1.11.1026.jar
azure-data-lake-store-sdk-2.3.9.jar
azure-keyvault-core-1.0.0.jar
azure-storage-7.0.1.jar
blas-3.0.3.jar
bonecp-0.8.0.RELEASE.jar
breeze_2.12-2.1.0.jar
breeze-macros_2.12-2.1.0.jar
caffeine-2.8.0.jar
cats-kernel_2.12-2.1.1.jar
chdfs_hadoop_plugin_network-2.8.jar
checker-qual-2.10.0.jar
chill_2.12-0.10.0.jar
chill-java-0.10.0.jar
commons-cli-1.5.0.jar
commons-codec-1.16.1.jar
commons-collections-3.2.2.jar
commons-collections4-4.4.jar
commons-compiler-3.1.9.jar
commons-compress-1.23.0.jar
commons-crypto-1.1.0.jar
commons-dbcp-1.4.jar
commons-httpclient-3.0.1.jar
commons-io-2.16.1.jar
commons-lang-2.6.jar
commons-lang3-3.12.0.jar
commons-logging-1.1.3.jar
commons-math3-3.6.1.jar
commons-pool-1.5.4.jar
commons-pool2-2.11.1.jar
commons-text-1.10.0.jar
compress-lzf-1.1.2.jar
cos_api-bundle-5.6.244.4.jar
cosn-ranger-interface-1.0.3.jar
curator-client-2.13.0.jar
curator-framework-2.13.0.jar
curator-recipes-2.13.0.jar
datanucleus-api-jdo-4.2.4.jar
datanucleus-core-4.1.17.jar
datanucleus-rdbms-4.1.19.jar
datasketches-java-3.3.0.jar
datasketches-memory-2.1.0.jar
derby-10.14.2.0.jar
dlc-serde-1.0.1.jar
dlc-spark-lineage-spark35-1.0.2.jar
dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
error_prone_annotations-2.3.3.jar
file-level-sasm-3.5.1-dlc-merging-1.0.2.jar
flatbuffers-java-1.12.0.jar
gcs-connector-hadoop3-2.2.14-shaded.jar
geotools-wrapper-1.6.1-28.2.jar
goosefs-client-1.4.2.jar
gson-2.2.4.jar
guava-14.0.1.jar
hadoop-aliyun-3.3.2.jar
hadoop-annotations-3.3.2.jar
hadoop-aws-3.3.2.jar
hadoop-azure-3.3.2.jar
hadoop-azure-datalake-3.3.2.jar
hadoop-client-api-3.3.2.jar
hadoop-client-runtime-3.3.2.jar
hadoop-cloud-storage-3.3.2.jar
hadoop-cos-8.3.22-dlc-m315.jar
hadoop-lzo-0.4.20.jar
hadoop-openstack-3.3.2.jar
hadoop-shaded-guava-1.1.1.jar
hbase-client-2.3.5.jar
hbase-common-2.3.5.jar
hbase-protocol-shaded-2.3.5.jar
hbase-shaded-mapreduce-2.3.5.jar
hbase-shaded-miscellaneous-3.3.0.jar
hbase-shaded-netty-3.3.0.jar
hbase-shaded-protobuf-3.3.0.jar
hbase-spark-1.0.1-3.2.1-2261.jar
hbase-spark-protocol-1.0.1-3.2.1-2261.jar
hbase-spark-protocol-shaded-1.0.1-3.2.1-2261.jar
HikariCP-2.5.1.jar
hive-beeline-2.3.7-dlc-226.jar
hive-cli-2.3.7-dlc-226.jar
hive-common-2.3.7-dlc-226.jar
hive-exec-2.3.7-dlc-226-core.jar
hive-hcatalog-core-2.3.7-dlc-226.jar
hive-jdbc-2.3.7-dlc-226.jar
hive-llap-common-2.3.7-dlc-226.jar
hive-metastore-2.3.7-dlc-226.jar
hive-serde-2.3.7-dlc-226.jar
hive-service-rpc-3.1.3.jar
hive-shims-0.23-2.3.7-dlc-226.jar
hive-shims-2.3.7-dlc-226.jar
hive-shims-common-2.3.7-dlc-226.jar
hive-shims-scheduler-2.3.7-dlc-226.jar
hive-storage-api-2.8.1.jar
hk2-api-2.6.1.jar
hk2-locator-2.6.1.jar
hk2-utils-2.6.1.jar
htrace-core4-4.1.0-incubating.jar
httpclient-4.5.14.jar
httpcore-4.4.16.jar
iceberg-extend-f2.9.5.rc0.jar
iceberg-spark-runtime-3.5_2.12-1.5.0-t281.3-tencent.jar
ini4j-0.5.4.jar
istack-commons-runtime-3.0.8.jar
ivy-2.5.1.jar
jackson-annotations-2.15.2.jar
jackson-core-2.15.2.jar
jackson-core-asl-1.9.13.jar
jackson-databind-2.15.2.jar
jackson-dataformat-cbor-2.15.2.jar
jackson-dataformat-csv-2.10.5.jar
jackson-dataformat-yaml-2.15.2.jar
jackson-datatype-jdk8-2.10.5.jar
jackson-datatype-jsr310-2.15.2.jar
jackson-mapper-asl-1.9.13.jar
jackson-module-scala_2.12-2.15.2.jar
jakarta.annotation-api-1.3.5.jar
jakarta.inject-2.6.1.jar
jakarta.servlet-api-4.0.3.jar
jakarta.validation-api-2.0.2.jar
jakarta.ws.rs-api-2.1.6.jar
jakarta.xml.bind-api-2.3.2.jar
janino-3.1.9.jar
javassist-3.29.2-GA.jar
javax.jdo-3.2.0-m3.jar
javolution-5.5.1.jar
jaxb-api-2.2.11.jar
jaxb-runtime-2.3.2.jar
jcl-over-slf4j-2.0.7.jar
jdo-api-3.0.1.jar
jdom2-2.0.6.jar
jersey-client-2.40.jar
jersey-common-2.40.jar
jersey-container-servlet-2.40.jar
jersey-container-servlet-core-2.40.jar
jersey-hk2-2.40.jar
jersey-server-2.40.jar
jettison-1.1.jar
jetty-util-9.4.54.v20240208.jar
jetty-util-ajax-9.4.54.v20240208.jar
JLargeArrays-1.5.jar
jline-2.14.6.jar
job-level-sasm-3.5.1-dlc-merging-1.0.2.jar
joda-time-2.12.5.jar
jodd-core-3.5.2.jar
jopt-simple-5.0.4.jar
jpam-1.1.jar
json-1.8.jar
json4s-ast_2.12-3.7.0-M11.jar
json4s-core_2.12-3.7.0-M11.jar
json4s-jackson_2.12-3.7.0-M11.jar
json4s-scalap_2.12-3.7.0-M11.jar
json-serde-1.3.8-jar-with-dependencies.jar
jsr305-3.0.0.jar
jta-1.1.jar
JTransforms-3.1.jar
jul-to-slf4j-2.0.7.jar
kafka_2.12-2.8.0.jar
kafka-clients-2.8.0.jar
kafka-metadata-2.8.0.jar
kafka-raft-2.8.0.jar
kryo-shaded-4.0.2.jar
kubernetes-client-6.7.2.jar
kubernetes-client-api-6.7.2.jar
kubernetes-httpclient-okhttp-6.7.2.jar
kubernetes-model-admissionregistration-6.7.2.jar
kubernetes-model-apiextensions-6.7.2.jar
kubernetes-model-apps-6.7.2.jar
kubernetes-model-autoscaling-6.7.2.jar
kubernetes-model-batch-6.7.2.jar
kubernetes-model-certificates-6.7.2.jar
kubernetes-model-common-6.7.2.jar
kubernetes-model-coordination-6.7.2.jar
kubernetes-model-core-6.7.2.jar
kubernetes-model-discovery-6.7.2.jar
kubernetes-model-events-6.7.2.jar
kubernetes-model-extensions-6.7.2.jar
kubernetes-model-flowcontrol-6.7.2.jar
kubernetes-model-gatewayapi-6.7.2.jar
kubernetes-model-metrics-6.7.2.jar
kubernetes-model-networking-6.7.2.jar
kubernetes-model-node-6.7.2.jar
kubernetes-model-policy-6.7.2.jar
kubernetes-model-rbac-6.7.2.jar
kubernetes-model-resource-6.7.2.jar
kubernetes-model-scheduling-6.7.2.jar
kubernetes-model-storageclass-6.7.2.jar
kyuubi-spark-authz_2.12-1.7.0-f295.jar
kyuubi-spark-sql-engine_2.12-1.8.1-20250610.111909-40.jar
lakefs-cosn-client-t2.8.1.jar
lapack-3.0.3.jar
leveldbjni-all-1.8.jar
libfb303-0.9.3.jar
libthrift-0.12.0.jar
livy-api-v0.8.0-dlc-m315.jar
livy-core_2.12-v0.8.0-dlc-m315.jar
livy-repl_2.12-v0.8.0-dlc-m315.jar
livy-rsc-v0.8.0-dlc-m315.jar
log4j-1.2-api-2.20.0.jar
log4j-api-2.20.0.jar
log4j-core-2.20.0.jar
log4j-slf4j2-impl-2.20.0.jar
logging-interceptor-3.12.12.jar
lz4-java-1.8.0.jar
metrics-core-2.2.0.jar
metrics-core-4.2.19.jar
metrics-graphite-4.2.19.jar
metrics-jmx-4.2.19.jar
metrics-json-4.2.19.jar
metrics-jvm-4.2.19.jar
minlog-1.3.0.jar
mysql-connector-j-8.0.33.jar
netty-all-4.1.96.Final.jar
netty-buffer-4.1.96.Final.jar
netty-codec-4.1.96.Final.jar
netty-codec-http2-4.1.96.Final.jar
netty-codec-http-4.1.96.Final.jar
netty-codec-socks-4.1.96.Final.jar
netty-common-4.1.96.Final.jar
netty-handler-4.1.96.Final.jar
netty-handler-proxy-4.1.96.Final.jar
netty-resolver-4.1.96.Final.jar
netty-transport-4.1.96.Final.jar
netty-transport-classes-epoll-4.1.96.Final.jar
netty-transport-classes-kqueue-4.1.96.Final.jar
netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar
netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar
netty-transport-native-kqueue-4.1.96.Final-osx-aarch_64.jar
netty-transport-native-kqueue-4.1.96.Final-osx-x86_64.jar
netty-transport-native-unix-common-4.1.96.Final.jar
objenesis-3.3.jar
okhttp-3.12.12.jar
okio-1.17.6.jar
opencsv-2.3.jar
opentracing-api-0.33.0.jar
opentracing-noop-0.33.0.jar
opentracing-util-0.33.0.jar
orc-core-1.9.4-shaded-protobuf.jar
orc-mapreduce-1.9.4-shaded-protobuf.jar
orc-shims-1.9.4.jar
oro-2.0.8.jar
osgi-resource-locator-1.0.3.jar
paranamer-2.8.jar
parquet-column-1.13.1.jar
parquet-common-1.13.1.jar
parquet-encoding-1.13.1.jar
parquet-format-structures-1.13.1.jar
parquet-hadoop-1.13.1.jar
parquet-jackson-1.13.1.jar
pickle-1.3.jar
polaris-factory-shaded-3.3.7.jar
postgresql-42.2.19.jar
py4j-0.10.9.7.jar
RoaringBitmap-0.9.45.jar
rocksdbjni-8.3.2.jar
scala-collection-compat_2.12-2.7.0.jar
scala-compiler-2.12.18.jar
scala-java8-compat_2.12-0.9.1.jar
scala-library-2.12.18.jar
scala-logging_2.12-3.9.2.jar
scala-parser-combinators_2.12-2.3.0.jar
scala-reflect-2.12.18.jar
scala-xml_2.12-2.1.0.jar
sedona-spark-shaded-3.5_2.12-1.6.1-202408.jar
shims-0.9.45.jar
slf4j-api-2.0.7.jar
slf4j-log4j12-1.7.9.jar
snakeyaml-2.0.jar
snakeyaml-engine-2.6.jar
snappy-java-1.1.10.5.jar
spark-analysis-listener-common-1.0.1.jar
spark-analysis-listener-core-1.0.9.jar
spark-avro_2.12-3.5.3-dlc.jar
spark-catalog-plugins-release-dlc-3.5.3-m315.jar
spark-catalyst_2.12-3.5.3-dlc.jar
spark-common-utils_2.12-3.5.3-dlc.jar
spark-core_2.12-3.5.3-dlc.jar
spark-doris-connector-3.1_2.12-1.3.1-dlc-f280.jar
spark-graphx_2.12-3.5.3-dlc.jar
spark-hadoop-cloud_2.12-3.5.3-dlc.jar
spark-hive_2.12-3.5.3-dlc.jar
spark-hive-thriftserver_2.12-3.5.3-dlc.jar
spark-kubernetes_2.12-3.5.3-dlc.jar
spark-kvstore_2.12-3.5.3-dlc.jar
spark-launcher_2.12-3.5.3-dlc.jar
spark-mllib_2.12-3.5.3-dlc.jar
spark-mllib-local_2.12-3.5.3-dlc.jar
spark-network-common_2.12-3.5.3-dlc.jar
spark-network-shuffle_2.12-3.5.3-dlc.jar
spark-repl_2.12-3.5.3-dlc.jar
spark-sketch_2.12-3.5.3-dlc.jar
spark-sql_2.12-3.5.3-dlc.jar
spark-sql-api_2.12-3.5.3-dlc.jar
spark-sql-executor-1.0.1.jar
spark-sql-kafka-0-10_2.12-3.5.3-dlc.jar
spark-streaming_2.12-3.5.3-dlc.jar
spark-streaming-kafka-0-10_2.12-3.5.3-dlc.jar
spark-tags_2.12-3.5.3-dlc.jar
spark-token-provider-kafka-0-10_2.12-3.5.3-dlc.jar
spark-unsafe_2.12-3.5.3-dlc.jar
spire_2.12-0.17.0.jar
spire-macros_2.12-0.17.0.jar
spire-platform_2.12-0.17.0.jar
spire-util_2.12-0.17.0.jar
ST4-4.0.4.jar
stax-api-1.0.1.jar
stream-2.9.6.jar
super-csv-2.2.0.jar
task-level-sasm-3.5.1-dlc-merging-1.0.2.jar
tdsql-pg-connector-java8-1.1.3.jar
threeten-extra-1.7.1.jar
tink-1.9.0.jar
transaction-api-1.1.jar
univocity-parsers-2.9.1.jar
wildfly-openssl-1.0.7.Final.jar
xbean-asm9-shaded-4.23.jar
xz-1.9.jar
zjsonpatch-0.3.0.jar
zookeeper-3.6.3.jar
zookeeper-jute-3.6.3.jar
zstd-jni-1.5.5-4.jar

已安装的 Python 库

Package Version
---------------------------------- --------------
aiohappyeyeballs 2.6.1
aiohttp 3.11.2
aiosignal 1.4.0
alembic 1.16.5
anyio 4.10.0
argon2-cffi 25.1.0
argon2-cffi-bindings 25.1.0
arrow 1.3.0
asttokens 3.0.0
async-lru 2.0.5
async-timeout 5.0.1
attrs 25.3.0
babel 2.17.0
beautifulsoup4 4.13.5
bleach 6.2.0
blinker 1.9.0
cachetools 5.5.2
certifi 2025.8.3
cffi 2.0.0
charset-normalizer 3.4.3
click 8.1.8
cloudpickle 3.1.1
comm 0.2.3
confluent-kafka 2.11.1
contourpy 1.3.0
cos_python_sdk_v5 1.9.38
coscmd 1.9.0.6
crcmod 1.7
cycler 0.12.1
databricks-sdk 0.66.0
DateTime 5.5
debugpy 1.8.17
decorator 5.2.1
defusedxml 0.7.1
dlcmagic 1.0.8.post2
docker 7.1.0
exceptiongroup 1.3.0
executing 2.2.1
fastjsonschema 2.21.2
Flask 3.1.2
fonttools 4.60.0
fqdn 1.5.1
frozenlist 1.7.0
gitdb 4.0.12
GitPython 3.1.45
google-auth 2.40.3
graphene 3.4.3
graphql-core 3.2.6
graphql-relay 3.2.0
greenlet 3.2.4
grpcio 1.75.0
gunicorn 23.0.0
h11 0.16.0
httpcore 1.0.9
httpx 0.28.1
idna 3.10
importlib_metadata 8.7.0
importlib_resources 6.5.2
ipykernel 6.30.1
ipython 8.18.1
isoduration 20.11.0
itsdangerous 2.2.0
jedi 0.19.2
Jinja2 3.1.6
joblib 1.5.2
json5 0.12.1
jsonpointer 3.0.0
jsonschema 4.25.1
jsonschema-specifications 2025.9.1
jupyter_client 8.6.3
jupyter_core 5.8.1
jupyter-events 0.12.0
jupyter-lsp 2.2.6
jupyter_server 2.17.0
jupyter_server_terminals 0.5.3
jupyterlab 4.4.7
jupyterlab_pygments 0.3.0
jupyterlab_server 2.27.3
kiwisolver 1.4.7
lark 1.3.0
Mako 1.3.10
Markdown 3.9
MarkupSafe 3.0.2
matplotlib 3.9.4
matplotlib-inline 0.1.7
mistune 3.1.4
mlflow 2.17.2
mlflow-skinny 2.17.2
multidict 6.6.4
nbclient 0.10.2
nbconvert 7.16.6
nbformat 5.10.4
nest-asyncio 1.6.0
notebook 7.4.5
notebook_shim 0.2.4
numpy 1.24.2
opentelemetry-api 1.37.0
opentelemetry-sdk 1.37.0
opentelemetry-semantic-conventions 0.58b0
overrides 7.7.0
packaging 24.2
pandas 1.5.3
pandocfilters 1.5.1
parso 0.8.5
pexpect 4.9.0
pillow 11.3.0
pip 25.2
platformdirs 4.4.0
prettytable 3.16.0
prometheus_client 0.23.1
prompt_toolkit 3.0.52
propcache 0.3.2
protobuf 5.29.5
psutil 7.1.0
psycopg2-binary 2.9.5
ptyprocess 0.7.0
pure_eval 0.2.3
pyarrow 11.0.0
pyasn1 0.6.1
pyasn1_modules 0.4.2
pycparser 2.23
pycryptodome 3.23.0
Pygments 2.19.2
PyMySQL 1.0.2
pyparsing 3.2.5
python-dateutil 2.9.0.post0
python-json-logger 3.3.0
pytz 2025.2
PyYAML 6.0.2
pyzmq 27.1.0
referencing 0.36.2
requests 2.32.5
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rfc3987-syntax 1.1.0
rpds-py 0.27.1
rsa 4.9.1
scikit-learn 1.6.1
scipy 1.13.1
Send2Trash 1.8.3
setuptools 80.9.0
six 1.17.0
smmap 5.0.2
sniffio 1.3.1
soupsieve 2.8
SQLAlchemy 2.0.3
sqlparse 0.5.3
stack-data 0.6.3
tabulate 0.9.0
tencentcloud-dlc-udf 1.0.0
tencentcloud-dlc-udf-runtime 1.0.6
tencentcloud-dlc-utils 1.0.5
tencentcloud-sdk-python-common 3.0.1464
tencentcloud-sdk-python-ssm 3.0.1459
terminado 0.18.1
threadpoolctl 3.6.0
tinycss2 1.4.0
tomli 2.2.1
tornado 6.5.2
tqdm 4.67.1
traitlets 5.14.3
types-python-dateutil 2.9.0.20250822
typing_extensions 4.15.0
uri-template 1.3.0
urllib3 1.26.20
wcwidth 0.2.14
webcolors 24.11.1
webencodings 0.5.1
websocket-client 1.8.0
Werkzeug 3.1.3
xmltodict 1.0.2
yarl 1.20.1
zipp 3.23.0
zope.interface 8.0

帮助和支持

本页内容是否解决了您的问题?

填写满意度调查问卷,共创更好文档体验。

文档反馈