Kafka Data Subscription

Release Notes

Upgrading Existing LogListener Instances

Announcements

Release Notes and Announcements

User Guide

Overview

Features

Available Regions

Basic Resources

Log Collection

Metric Collection

Search and Analysis

Monitoring Alarm

Data Processing

Shipping and Consumption

Limits

Log Topic and Logset

Machine Group

Segment and Index

Topic Partition

Concepts

Product Introduction

Billing Overview

Product Pricing

Bill and Usage Query

Pay-As-You-Go Examples

Pay-as-You-Go

Billing

Cleaning up CLS resources

Cost Optimization

FAQs

Purchase Guide

Getting Started in 1 Minute

Getting Started Guide

Quickly Trying out CLS with Demo

Getting Started

Logset

Log Topic

Metric topic

Topic Usage Monitoring

Machine Group Management

Resource Management

Sub-Account Authorization

Authorizable Resource Types

Access Policy Templates

Accessing CLS with a Temporary Key

Permission Management

Collection Overview

Collection by LogListener

Collecting Text Log

Collecting Logs in Self-Built Kubernetes Cluster

Collecting TKE Kubernetes Cluster Logs

Collecting Syslog

Collecting Windows Event Logs

Collecting NGINX Access Logs

Subscribing to MySQL Binlogs

Uploading Log over Kafka

Using Kafka Data Subscription for Log Collection

Uploading Logs via Anonymous Write

Uploading Logs via Logback Appender

Uploading Logs via Log4j Appender

Uploading Log via SDK

Uploading Log via API

Network Probing Access Guide for iOS/Android Mobile Devices

FluentBit Log Upload

Logstash Log Upload

Importing Data

Tencent Cloud Service Log Access

Global Accelerator Log Upload

Importing Data from Elasticsearch

Metrics Reporting

Converting Logs to Metrics

Storage Class Overview

Log Transition

Data Encryption

Log Storage

Metric Storage Overview

Compatible with Prometheus API

Metric Pre-aggregation

Metric Storage

Overview of Search and Analysis

Syntax and Rules

Statistical Analysis (SQL)

Configuring Indexes

Reindexing

Multi-Topic Search

Context Search and Analysis

Custom Redirect

Downloading Log

Search and Analysis (Log Topic)

Syntax Rules

Search and Analysis (Metric Topic)

Chart Overview

Creating a Dashboard

Creating Statistical Charts

Filters and Variables

Interaction Event

Chart Time Configuration

Preset Dashboard

Subscribing to Dashboard

Dashboard

Scheduled SQL Analysis

Data Processing documents

Shipping Overview

CLS Service Role Authorization

Shipping to COS

Shipping to CKafka

Shipping to DLC

Shipping to Splunk

Log Consumption

Metric Topic Shipping

Monitoring Alarm Overview

Managing Alarm Policies

Channels to Receive Alarm Notifications

Managing Notification Groups

Alarm Notification Variable

Viewing Alarm Records

Alarm Silence

Overview of Cloud Insight

CLB Cloud Insight

CDN Cloud Insight

COS Cloud Insight

SCF Cloud Insight

TKE Cloud Insight

Cloud Insight

Using the Independent DataSight Console

Independent DataSight console

Operation guide of earlier LogListener versions

Troubleshooting earlier LogListener versions

 Historical Documentation 

Operation Guide

Collecting Windows Logs to CLS

Synchronizing Logs Across Accounts via Kafka Data Subscription

Collect/Query Host File Logs

Using SDK to Upload Logs

CLB Access Log Analysis

NGINX Access Log Analysis

CDN Access Log Analysis

COS Access Log Analysis

CCN Flow Log Analysis

TKE Event Log Analysis

TKE Audit Log Analysis

Migrating the ES data source of Grafana to the CLS data source

Setting Alarm Trigger Conditions by Time Period

Setting Interval-Valued Comparison and Periodically-Valued Comparison as Alarm Trigger Conditions

Alarm Integration with Third-Party Platforms Such As PagerDuty and Slack

Consumption of CLS Log with Flink

Using DLC (Hive) to Analyze CLS Log

Saving Product Use Costs

Practical Tutorial

Embedding CLS Console

CLS Connection to Grafana

Developer Guide

History

Introduction

API Category

Request Structure

Common Params

Signature v3

Signature

Responses

Making API Requests

DeleteTopic

DescribeTopics

CreateTopic

ModifyTopic

Topic Management APIs

CreateLogset

DeleteLogset

ModifyLogset

DescribeLogsets

Log Set Management APIs

CreateIndex

DeleteIndex

ModifyIndex

DescribeIndex

Index APIs

DescribePartitions

SplitPartition

MergePartition

Topic Partition APIs

CreateMachineGroup

DeleteMachineGroup

ModifyMachineGroup

DescribeMachineGroups

DescribeMachines

AddMachineGroupInfo

DeleteMachineGroupInfo

Machine Group APIs

CreateConfig

DeleteConfig

ModifyConfig

DescribeConfigs

ApplyConfigToMachineGroup

DeleteConfigFromMachineGroup

DescribeConfigMachineGroups

DescribeMachineGroupConfigs

Collection Configuration APIs

SearchLog

DescribeLogHistogram

Log APIs

API Documentation

Cloud Log Service

Limit	Description
Kafka Data Subscription Task	A single log topic can create up to 100 Kafka data subscription tasks.

Limit	Description
Kafka Topic	A single Kafka data subscription task can consume up to 100 Kafka topics.
Size of a Single Log	A single log cannot exceed 1 MB. When the size of a single log exceeds the limit, this log will be discarded.
Single Kafka Message	A single Kafka message can contain a maximum of one log. If it exceeds this limit, the entire message will be treated as a parsing-failed log.
Starting Position	Only the earliest and latest positions can be specified. Importing from a position at the specified time is not supported.

Limit	Description
Maximum Throughput per Task	The maximum throughput for a single task is limited to 240 MB/s.

tencent cloud

Configuration Limits

Collection Limits

Performance Limits