Table Types
TCIceberg tables are a batch-stream unified table format developed by Tencent Cloud based on Apache Iceberg. They include the native Apache Iceberg V1/V2 table versions, and extend upon them with a Mix version that supports near real-time lakehouse construction capabilities. All versions support the Apache Iceberg Rest API specification protocol and can be read from and written to using the Apache Iceberg Client: TCIceberg Table Version:
It supports the native Apache Iceberg V1/V2 versions and is fully compatible with Apache Iceberg syntax operations.
The TCIceberg extended Mix table version consists of two Iceberg tables: Base Store and Change Store. It supports reading streaming incremental data via CDC and provides Merge On Read read-time merging to ensure data latency in data analysis scenarios. Both tables can be read from and written to directly using the Apache Iceberg Client.
Table Data Management: TCIceberg table data is managed by TCLake, which includes metadata and data files. Users do not need to concern themselves with the underlying storage system. When a table is deleted, its metadata and data are deleted together.
Data Optimization: The data optimization service is managed by TCLake, including small file merging, expired snapshot cleanup, orphaned file cleanup, and more.
Creating a table
2. On the Data Catalog list page, select a LakeHouse catalog, click the catalog name, and go to the catalog details page.
3. In the Schema list, click the Schema name to go to the table list page.
4. In the table list, click Create Table.
5. Configure the following parameters and click OK.
Parameter | Description |
Table Name | Required. Must be unique within the same catalog. Cannot start with a number. Maximum length is 64 characters. Allowed characters: letters, digits, and underscores (_). |
Table Format | Select TCIceberg. |
Table Version | Required. V1/V2 are native Apache Iceberg versions. The Mix version is Tencent Cloud's extended batch-stream unified format, optimized for near real-time lakehouse scenarios. |
Description | Optional. |
Columns | Define the table columns, including column name, type, data type, primary key status, and description. |
Partitioning | Disabled by default. When enabled, you can define partition columns and transform strategies for the table. |
Custom Properties | |
Viewing a Table
1. Go to a LakeHouse Catalog. In the Schema list, click the Schema name to view the table list.
2. In the table list, click the table name to view its columns, partition columns, and properties.
3. Click the Data Optimization tab to configure a dedicated data optimization policy for the TCIceberg table.
4. Click the Version History tab to view the snapshot version history of the TCIceberg table.
Deleting a Table
Note:
After a TCIceberg table is deleted, the managed data is retained by default for 7 days and is automatically deleted after that period. Please proceed with caution.
1. In the Schema list, click the Schema name to view the table list.
2. In the table list, click Delete in the Actions column.
3. In the confirmation dialog, click OK.