1. On the DataInLong page, in the left sidebar, click Real-time Sync.
2. At the top of the Real-time Sync page, select Single Table Sync to create a new one (you can choose between form and canvas modes) and enter the configuration page.
3. Click the left Read, click Select Mongo Node and configure node information.
4. Parameter description:
Parameters
Description
Type
Select Mongodb
Data Source
Select the available Mongo Data Source for the project
Database
Supports selecting or manually entering the database name to be read
By default, the database bound to the data source is used as the default database. Other databases need to be manually entered.
If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the DataInLong network is connected.
Collection
Supports selecting or manually entering the collection name to be read
Read Mode
Full + Increment: Data synchronization is divided into full and increment phases. After the full phase is completed, the task enters the increment phase. The full phase will synchronize historical data in the database, and the incremental phase starts synchronizing from the binlog cdc location after the task starts.
Incremental: Synchronize data only from the binlog CDC checkpoint after the task starts.
Time Zone
Set the time zone for log timestamps, with Shanghai as the default.
Advanced Settings (optional)
You can configure parameters according to business needs.
5. Preview Data Fields, click Save.
Mongodb Whole Database Source Configuration
Mongodb Read Configuration Parameters Description
Parameters
Description
Data Source
Select the Mongo Data Source to be synchronized.
Source Table
According to business needs, select "All Databases, Collections", "Specified Table", "Specified Database":
All Databases, collections: Monitor all databases under the data source. Any new databases or tables added during the task run will be synchronized to the target end by default.
Specified Collection: Only synchronize the specified collection.
Specified Database: Monitor the specified database, synchronize all tables or tables that meet the criteria under the database.
Read Mode
Full + Incremental, Incremental.
Filter Operations
Provide various filtering operations, including Insert, Update, Delete, Delete collection, Delete database, Rename collection. After setting, data of the specified operation type will not be synchronized.
Data type conversion support
Read
The supported data types and their conversion relationships for MongoDB Reads are as follows:
