Kafka Connect currently supports two execution modes: standalone and distributed.
Starting Connect in Standalone Mode
Start Connect in standalone mode by running the following command:
bin/connect-standalone.sh config/connect-standalone.properties connector1.properties [connector2.properties ...]
Accessing TDMQ for CKafka (CKafka) is basically the same as accessing Apache Kafka, except that you need to change the value of bootstrap.servers to the IP address assigned when you apply for the instance.
Starting Connect in Distributed Mode
Start Connect in distributed mode by running the following command:
bin/connect-distributed.sh config/connect-distributed.properties
In this mode, Kafka Connect stores the offset, configuration, and task status information in Kafka topics, which are configured in the following fields in connect-distributed:
config.storage.topic
offset.storage.topic
status.storage.topic
These three topics need to be created manually to ensure that their properties meet the requirements of Connect.
config.storage.topic should have only one partition and multiple replicas and be in compact mode.
offset.storage.topic should have multiple partitions and replicas and be in compact mode.
status.storage.topic should have multiple partitions and replicas and be in compact mode.
Set bootstrap.servers to the IP address assigned when you apply for the instance.
Configure group.id to identify the Connect cluster, which should be differentiated from the consumer group.