1. On the Data Integration page, in the left sidebar, click Real-time Sync.
2. At the top of the Real-time Sync page, select Single Table Sync to create a new one (you can choose between form and canvas modes) and enter the configuration page.
3. click the left side to read, click to select TiDB node and configure node information.
4. You can refer to the table below for parameter configuration:
Parameters
Description
Type
TiDB
Data Source
Select the TiDB data source where the table to be synchronized is located
TiDB Database
Select TiDB database
TiDB Table
Select TiDB table
Read Mode
Supports full and incremental read modes
Data Source
Select the Kafka data source where the table to be synchronized is located
topic
Topic in Kafka data source
Serialization Format
Kafka message serialization format type
Message Types
append messages: Messages in Kafka come from append message stream, usually without a unique key. It is recommended to use the append write mode for the write node
upsert messages: Messages in Kafka come from the upsert message stream, usually with a unique key. Once set, messages can ensure Exactly-Once delivery. It is recommended to use the upsert write mode for the write node
Unique Key
In Upsert Write Mode, you need to set a unique key to ensure data order
Consumer Group ID
Please avoid this parameter conflicting with other consumer processes to ensure the correctness of the consumption offsets. If this parameter is not specified, the default is set to group.id=WeData_group_＄{task_id}
Advanced Settings
You can configure parameters according to business needs.
