DataHub offers data distribution capabilities. You can distribute CKafka data to CLS for business problem locating, metric monitoring, and security audit.
Prerequisites
Currently, this feature relies on the CLS service, which should be activated first.
2. Click Data Distribution on the left sidebar, select the region, and click Create Task.
3. Select Cloud Log Service (CLS) as the Target Type and click Next.
Task Name: It can only contain letters, digits, underscores, or symbols ("-" and ".").
CKafka Instance: Select the source CKafka instance.
Source Topic: Select the source topic. A data distribution task supports up to five source topics.
Starting Position: Select the topic offset of historical messages when dumping.
Logset: Select a logset. A logset is a project management unit in CLS and is used to distinguish between logs in different projects.
Log Topic: You can select Auto-create log topic or Select from existing log topics. One logset can contain multiple log topics, and one log topic corresponds to one type of applications or services. We recommend you collect similar logs on different machines into the same log topic.
Role Authorization: You need to grant permissions to a third-party role to access CLS.
2. Click Data Distribution on the left sidebar and click the ID of the target task to enter its basic information page.
3. At the top of the task details page, click Monitoring, select the resource to be viewed, and set the time range to view the corresponding monitoring data.
Restrictions and billing
The dump speed is subject to the limit of the peak bandwidth of the CKafka instance. If the consumption is too slow, check the peak bandwidth settings or increase the number of CKafka partitions.
The dump speed is subject to the size of a single CKafka file. A file exceeding 500 MB in size will be automatically split for multipart upload.
This feature is provided based on the SCF service that offers a free tier. For more information on the fees for excessive usage, see the billing rules of SCF.
Yes
No
Was this page helpful?