- Release Notes and Announcements
- User Guide
- Product Introduction
- Purchase Guide
- Getting Started
- Operation Guide
- Resource Management
- Permission Management
- Log Collection
- Collection Overview
- Collecting Logs in Self-Built Kubernetes Cluster
- Collecting Syslog
- Collection by LogListener
- Collecting Text Log
- Uploading Log over Kafka
- Uploading Logs via Anonymous Write
- Uploading Logs via Logback Appender
- Uploading Logs via Log4j Appender
- Uploading Log via SDK
- Uploading Log via API
- Importing Data
- Tencent Cloud Service Log Access
- Log Storage
- Search and Analysis
- Syntax and Rules
- Statistical Analysis (SQL)
- Quick Analysis
- SQL Syntax
- SQL Functions
- String Function
- Date and Time Functions
- IP Geographic Function
- URL Function
- Mathematical Calculation Functions
- Mathematical Statistical Function
- General Aggregate Function
- Geospatial Function
- Binary String Function
- Estimation Function
- Type Conversion Function
- Logical Function
- Operators
- Bitwise Operation
- Regular Expression Function
- Lambda Function
- Conditional Expressions
- Array Functions
- Interval-Valued Comparison and Periodicity-Valued Comparison Functions
- JSON Functions
- Window Functions
- Sampling Analysis
- Configuring Indexes
- Reindexing
- Context Search and Analysis
- Downloading Log
- Dashboard
- Data Processing documents
- Data Processing
- Creating Processing Task
- Viewing Data Processing Details
- Data Processing Functions
- Function Overview
- Key-Value Extraction Functions
- Enrichment Functions
- Flow Control
- Row Processing Functions
- Field Processing Functions
- Value Structuring Functions
- Regular Expression Processing Functions
- Time Value Processing Functions
- String Processing Functions
- Type Conversion Functions
- Logical and Mathematical Functions
- Encoding and Decoding Functions
- IP Parsing Functions
- Processing Cases
- Scheduled SQL Analysis
- SCF
- Data Processing
- Shipping and Consumption
- Monitoring Alarm
- Historical Documentation
- Best Practices
- Developer Guide
- API Documentation
- History
- Introduction
- API Category
- Making API Requests
- Topic Management APIs
- Log Set Management APIs
- Index APIs
- Topic Partition APIs
- Machine Group APIs
- Collection Configuration APIs
- Log APIs
- Metric APIs
- Alarm Policy APIs
- Data Processing APIs
- Kafka Protocol Consumption APIs
- CKafka Shipping Task APIs
- Kafka Data Subscription APIs
- COS Shipping Task APIs
- SCF Delivery Task APIs
- Scheduled SQL Analysis APIs
- COS Data Import Task APIs
- Data Types
- Error Codes
- FAQs
- CLS Service Level Agreement
- CLS Policy
- Contact Us
- Glossary
- Release Notes and Announcements
- User Guide
- Product Introduction
- Purchase Guide
- Getting Started
- Operation Guide
- Resource Management
- Permission Management
- Log Collection
- Collection Overview
- Collecting Logs in Self-Built Kubernetes Cluster
- Collecting Syslog
- Collection by LogListener
- Collecting Text Log
- Uploading Log over Kafka
- Uploading Logs via Anonymous Write
- Uploading Logs via Logback Appender
- Uploading Logs via Log4j Appender
- Uploading Log via SDK
- Uploading Log via API
- Importing Data
- Tencent Cloud Service Log Access
- Log Storage
- Search and Analysis
- Syntax and Rules
- Statistical Analysis (SQL)
- Quick Analysis
- SQL Syntax
- SQL Functions
- String Function
- Date and Time Functions
- IP Geographic Function
- URL Function
- Mathematical Calculation Functions
- Mathematical Statistical Function
- General Aggregate Function
- Geospatial Function
- Binary String Function
- Estimation Function
- Type Conversion Function
- Logical Function
- Operators
- Bitwise Operation
- Regular Expression Function
- Lambda Function
- Conditional Expressions
- Array Functions
- Interval-Valued Comparison and Periodicity-Valued Comparison Functions
- JSON Functions
- Window Functions
- Sampling Analysis
- Configuring Indexes
- Reindexing
- Context Search and Analysis
- Downloading Log
- Dashboard
- Data Processing documents
- Data Processing
- Creating Processing Task
- Viewing Data Processing Details
- Data Processing Functions
- Function Overview
- Key-Value Extraction Functions
- Enrichment Functions
- Flow Control
- Row Processing Functions
- Field Processing Functions
- Value Structuring Functions
- Regular Expression Processing Functions
- Time Value Processing Functions
- String Processing Functions
- Type Conversion Functions
- Logical and Mathematical Functions
- Encoding and Decoding Functions
- IP Parsing Functions
- Processing Cases
- Scheduled SQL Analysis
- SCF
- Data Processing
- Shipping and Consumption
- Monitoring Alarm
- Historical Documentation
- Best Practices
- Developer Guide
- API Documentation
- History
- Introduction
- API Category
- Making API Requests
- Topic Management APIs
- Log Set Management APIs
- Index APIs
- Topic Partition APIs
- Machine Group APIs
- Collection Configuration APIs
- Log APIs
- Metric APIs
- Alarm Policy APIs
- Data Processing APIs
- Kafka Protocol Consumption APIs
- CKafka Shipping Task APIs
- Kafka Data Subscription APIs
- COS Shipping Task APIs
- SCF Delivery Task APIs
- Scheduled SQL Analysis APIs
- COS Data Import Task APIs
- Data Types
- Error Codes
- FAQs
- CLS Service Level Agreement
- CLS Policy
- Contact Us
- Glossary
December 2022
Update | Description | Release Date | Documentation |
Optimized the log index failure policy | An index may fail to be created due to the abnormal raw log format or index configuration mismatch. CLS allows for storing raw logs separately for exception handling. This ensures that logs won't be lost. | 2022-12-31 | |
Added encoding/decoding and encryption functions to alarm notification variables | Base64/Base64URL/URL encoding and decoding, MD5/SHA1/SHA256/SHA512 encryption, and HMAC_MD5/HMAC_SHA1/HMAC_SHA256/HMAC_SHA512 encryption are supported for alarm notification variables to generate signature strings required for custom callback API authentication. | 2022-12-26 | |
Added data preview for shipping to CKafka/COS | The log data format to be shipped can be intuitively previewed in the console, increasing the efficiency. | 2022-12-25 | - |
Supported custom variables for the dashboard | Variable values can be set and applied to search statements, titles, and text in charts to batch modify statements. |
2022-12-08
|
November 2022
Update | Description | Release Date | Documentation |
Supported field configuration for dashboard charts | You can configure a personalized style for a single field in a chart, so as to make the dashboard more varied in style. | 2022/11/25 | - |
Supported multiple log topics for an alarm policy | Up to 20 log topics can be set for an alarm policy. It can be determined whether the trigger conditions are met separately for each log topic. Currently, selected log topics must be in the same region. | 2022/11/23 | |
Upgraded the dashboard filter | Static option input and alias configuration are supported in the dashboard filter drop-down list. In addition, filter by search statement is supported, including filter by range, NOT, full text, or fuzzy match, meeting different requirements. | 2022/11/20 | |
Added a function for data processing | The `ext_grok` function is added for data processing, which extracts the matched result value based on the Grok syntax, making it easier to extract a key-value pair with a regular expression when a processing function is used. | 2022/11/15 |
October 2022
Update | Description | Release Date | Documentation |
Supported custom redirect links in the dashboard | Another page can be redirected to by clicking a field in a chart. The URL to be redirected to can be a variable to cater to personalized needs. Currently, only tables are supported, with more chart types to come. | 2022-10-24 | |
Supported monitoring of log shipping tasks to CKafka | The traffic, number of lines, status, and latency of shipping tasks to CKafka can be monitored, so that users can stay on top of task details and better manage shipping tasks. | 2022-10-12 | - |
Supported log transition for STANDARD log topics | Log transition can be enabled for STANDARD log topics, so that legacy data can be transitioned to STANDARD_IA for long-term storage. The transitioned data will be billed by STANDARD_IA storage, which meets the requirements for real-time alarm analysis and low-cost storage. | 2022-10-11 | Log Transition |
Supported the interactive mode for search and analysis | Log search and analysis can be performed with a click to automatically generate statements including SQL, making it easier to learn statements. | 2022-10-10 | - |
Supported import and export for the dashboard | Dashboard files can be imported and exported to meet the requirements for cross-account dashboard migration and sharing. | 2022-10-09 | - |
September 2022
Update | Description | Release Date | Documentation |
Added log charts for dashboards | You can add and browse raw logs on the dashboard page. The analysis result and associated log content are displayed on the dashboard with no redirects needed, making operations easier. | 2022-09-30 | |
Supported LogListener for syslog collection | You can use LogListener to collect Linux syslog and quickly configure collection rules in the CLS console. | 2022-09-15 | |
Supported trigger by group in the alarm policy | If multiple results of the execution result meet the alarm trigger condition, the results will be grouped based on the group field, and an alarm will be triggered for each group. | 2022-09-06 |
August 2022
Update | Description | Release Date | Documentation |
Supported dashboard subscription via email | CLS allows users to subscribe to a dashboard and export it as an image. Daily, weekly, and monthly reports can be emailed to specified recipients regularly. This is suitable for scenarios where dashboards need to be published regularly and reduces costs. | 2022-08-29 | |
Supported data compression for consumption over Kafka | Consumption over Kafka supports data compression, which greatly reduces the read traffic volume and costs. | 2022-08-25 | |
Supported monitoring of shipping tasks to COS | The traffic, number of lines, status, and latency of shipping tasks to COS can be monitored, so that users can stay on top of task details and better manage shipping tasks. | 2022-08-23 | |
Added Parquet format for shipping to COS | CLS supports shipping log data in Parquet format to COS, which is suitable for big data computing and analysis scenarios where Hive is at downstream. | 2022-08-23 | |
Added random sampling mode for statistical log analysis | CLS supports random sampling and analysis of massive amounts of data in raw logs. Compared with full analysis, it can achieve an accuracy of over 95% and solve the problems of slowness and timeout in full analysis, meeting the requirements for statistical analysis in various business scenarios. | 2022-08-22 |
July 2022
Update | Description | Release Date | Documentation |
Added funnel chart to dashboards | Users can collect the statistics of business processes with single flow and path and then intuitively compare conversion rates in different stages. | 2022-07-20 | |
Released the scheduled SQL analysis feature | Search statements are executed based on custom cycles and times, and results are saved in new log topics. This greatly reduces the query failure rate and costs. | 2022-07-15 | |
Supported reporting data from mobile devices through the SDK | Log information such as network detection can be reported from mobile devices through the SDK for Android/iOS. | 2022-07-01 |
June 2022
Update | Description | Release Date | Documentation |
Supported custom chart time in dashboards | The chart time can be independent and doesn't change as the global time changes. In the dashboard, different charts can use different times to support more diversified comparisons. | 2022-06-30 | |
Added DSL functions for data processing | DSL functions are added for data processing, covering IP parsing, codec, and more scenarios. | 2022-06-30 | |
Released preset dashboards | CLS supports accessing the standard logs of multiple Tencent Cloud products and provides out-of-the-box log analysis dashboards for visual analysis. | 2022-06-27 | |
Upgraded notification content variables | More notification content variables are supported, which can be extracted, escaped, and formatted. | 2022-06-16 | |
Added the index recreation feature | After index configurations are modified, indexes can be recreated for historical log data, so that it can be searched for and analyzed based on new configurations. | 2022-06-10 |
May 2022
Update | Description | Release Date | Documentation |
Added demos for four Tencent Cloud products | Demos are added for CDN, FlowLog, TKE, and COS, helping users try out CLS features. | 2022-05-30 | |
Supported log upload over Kafka | Kafka configurations are added in the console, where Kafka output configurations are automatically generated based on the uploaded Kafka producer and account information. Users can copy existing configurations for quick upload. | 2022-05-30 |
April 2022
Update | Description | Release Date | Documentation |
Supported automatic unit conversion in dashboards | Chart units can be automatically converted. When a value meets the conversion factor, it will be automatically converted to the next higher unit, making data more readable. | 2022-04-30 | |
Supported trend comparison of sequence diagrams | Sequence diagrams support adding trend comparison curves of past cycles, enhancing the capabilities of comparative chart analysis. | 2022-04-30 | |
Consumption over Kafka in all regions | You can consume data to downstream big data components or data warehouses over the Kafka protocol, such as self-built Kafka clusters, ClickHouse, Hive, and Flink, as well as Tencent Cloud EMR and Oceanus. | 2022-04-20 | |
Use of SQL to collect and analyze historical data when the index configuration is modified | When the index configuration is modified, users can use SQL to collect and analyze historical data for existing fields in the original configuration (but not for new fields). | 2022-04-18 | - |
Metadata collection range selection for container collection | You can select one or more container metadata fields collected by default and configure whether to enable index. | 2022-04-13 | - |
Adding metadata/preset fields to full-text index | You can add metadata/preset fields to full-text index during index configuration for full-text search of such fields. | 2022-04-12 |
March 2022
Update | Description | Release Date | Documentation |
Word cloud in dashboard | The word cloud feature is launched to visualize text data and highlight frequent words. | 2022-03-15 | - |
February 2022
Update | Description | Release Date | Documentation |
CLS joining Grafana's official plugin market | The Grafana plugin for CLS can be installed with a few clicks. The plugin comes with multiple cloud product templates and can be used out-of-the-box. The plugin provides comprehensive analysis capabilities. | 2022-02-25 | |
Visual map reconstruction | Added support for filtering map display areas by scrolling the legend scope. Fixed the occasional overlap problem of legends. Optimized the color display of maps to separate regions without data. | 2022-02-20 | - |
January 2022
Update | Description | Release Date | Documentation |
Support for permanent retention of log topics | You can customize the log topic retention period to a value ranging from 1 to 3600 days or enable permanent retention. | 2022-01-25 | Specifications |
Launch of the index configuration import feature | You can import the index configuration rules of existing log topics with a few clicks to improve efficiency. | 2022-01-18 |
December 2021
Update | Description | Release Date | Documentation |
Support for log upload via Kafka | Supported Kafka protocol versions: 0.11.X-2.8 Supported data compression modes: Gzip, Snappy, lz4, zstd | 2021-12-27 | |
Updated TKE log collection | Log collection configuration supports `label !=` operations (exclude labels). Log collection configuration supports selecting multiple namespaces or excluding namespaces. Supports incremental log collection. Supports manual upgrade of LogListener. | 2021-12-21 | |
Supported viewing log topic usage in the Cloud Monitor dashboard | Usage metrics such as the log storage size and write traffic and corresponding alarms are delivered to the Cloud Monitor dashboard so that users can view the usage of log topics in a centralized manner. | 2021-12-17 | |
Optimized dashboard visual data configuration | Dashboard visual data configuration now supports the new features of displaying hidden fields and aggregating metrics by groups. | 2021-12-15 | - |
Support for importing COS data to CLS | You can import COS data to CLS for various purposes, such as search, analysis, and data processing and cleansing. | 2021-12-10 |
November 2021
Update | Description | Release Date | Documentation |
CLS feature experience demo available | For product trial and test scenarios, the free demo provides quick data access and feature templates to help you access content close to real-life scenarios easily and quickly. | 2021-11-30 | |
STANDARD_IA in beta testing in some regions | STANDARD_IA is a low-cost log storage solution to search and store massive infrequently accessed logs, meeting users' requirements for backtracking and archiving historical logs. The solution applies to scenarios where users do not have log statistical analysis requirements and logs need to be stored for a long time. (In the beta test period, the solution is available only in Beijing, Guangzhou, Shanghai, and Hong Kong, China.) | 2021-11-30 | |
Connecting self-built Kubernetes clusters to CLS | You can use the console to configure log collection rules to quickly connect self-built Kubernetes clusters to CLS, reducing learning and use costs. | 2021-11-26 | |
Data processing feature released | Data processing provides the capability to structure, filter, mask, distribute, and enrich log data, which provides the basis for structured data search, analysis, and dashboard display of log data. | 2021-11-22 | |
Support for logs uploaded via Kafka | CLS is compatible with Kafka to be compatible with open-source ecosystems. You only need to modify the write source of your existing system to achieve quick access and support various open-source collection components such as Logstash, Fluentd, and Filebeat. | 2021-11-15 | |
Support for downloading up to 50 million logs at a time | The number of raw logs that can be downloaded at a time is increased from 10 million to 50 million, and the limit on the number of download tasks is removed, significantly improving the log download speed. | 2021-11-08 |
October 2021
Update | Description | Release Date | Documentation |
Support for template variables in the dashboard | The data source variable and quick filter variable are added to the dashboard, allowing you to flexibly switch between log topics for multiple data sources in the same dashboard and quickly filter metric conditions. | 2021-10-19 |
September 2021
Update | Description | Release Date | Documentation |
Kafka real-time consumption | The Kafka consumption capability is now available in CLS. You can use the Kafka real-time consumption feature to export log data to specified applications efficiently and conveniently. | 2021-09-17 |
August 2021
Update | Description | Release Date | Documentation |
Brand-new monitoring alarm features | Updated features: Added custom alarm content templates Added the custom multi-dimensional analysis feature Added the feature of reporting alarms within one minute when exceptions occur | 2021-08-22 | |
Offline log solution in beta testing | Adopted the low-cost offline log storage solution to search and store massive infrequently accessed logs, requiring a total cost 80% lower than that of real-time log storage. The solution is now available in Beijing, Shanghai, Guangzhou, Nanjing, Chongqing, and Hong Kong, China. | 2021-08-18 | |
Released over 200 analytic functions | Over 200 SQL analytic functions are released in all regions to meet log data aggregate analysis in various scenarios to enhance CLS's data visualization capability. | 2021-08-12 | |
Log parsing based on custom formats | Added the LogListener advanced data processing feature to allow users to parse log files based on custom formats to implement the collection of logs in complex formats. | 2021-08-06 |
July 2021
Update | Description | Release Date | Documentation |
Full/Incremental collection policies | Added the feature to allow users to configure whether to use full or incremental log collection via LogListener, meeting users' requirement for shipping only new log data and significantly reducing users' write traffic costs. | 2021-07-22 | |
Optimized search error messages | Standardized error messages for higher readability of the search error information. | 2021-07-15 | |
Chinese text segmentation | Added the Chinese text segmentation feature to segment logs containing Chinese characters based on the Chinese syntax to facilitate log search. | 2021-07-08 |
June 2021
Update | Description | Release Date | Documentation |
Deploying LogListener instances on CVM instances in batches | Added the feature to allow users to deploy LogListener instances on CVM instances in batches for CVM log collection. With the feature, users do not need to manually install LogListener configuration anymore. | 2021-06-24 | - |
Map, Sankey, and other chart features released | Added the support for more data visualization charts, including bar charts, column charts, maps, and Sankey diagrams. | 2021-06-18 | - |
Search statement syntax error correction prompts | Added search syntax error prompts for the correction of Lucene syntax errors and spelling errors in index statistics fields, effectively improving the accuracy and efficiency of users' search analysis statements. | 2021-06-15 | - |
May 2021
Update | Description | Release Date | Documentation |
Dashboard 2.0 release | Released dashboard 2.0 UI: enhanced visualization and optimized the dashboard style. | 2021-05-31 | - |
LogListener download over a private network | Added the support for users to download the LogListener installation package via a private network address in different regions, avoiding security risks caused by connecting to a public network. | 2021-05-27 | |
Log topic traffic statistics | Added the feature of monitoring the traffic statistics of a single log topic, allowing users to view the traffic dynamics of a log topic. | 2021-05-20 | - |
Collection configuration import | Added the feature of importing existing log topic rules with a few clicks, improving log data access efficiency. | 2021-05-17 |
April 2021
Update | Description | Release Date | Documentation |
LogListener service log launch | Added the support for LogListener service logs. These logs record LogListener running status and collection monitoring log data. The logs are presented in a visualized view to provide important metric data. | 2021-04-26 |
March 2021
Update | Description | Release Date | Documentation |
Uploading parsing-failure logs | Added the support for uploading parsing-failure logs, using `LogParseFailure` as the key name (`Key`) and the raw log content as the key value (`Value`). | 2021-03-26 | - |
CLS newly available in Moscow and Thailand | CLS is now available in Moscow in Europe and Bangkok in Asia Pacific. | 2021-03-20 |
February 2021
Update | Description | Release Date | Documentation |
LogListener auto upgrade | Users can set a time period for agent auto upgrade or select specific machines to upgrade manually. | 2021-02-27 | |
Millisecond-precision logging | LogListener supports millisecond-precision timestamps for log collection. After time-based log collection is enabled, LogListener uploads logs with millisecond-precision UNIX timestamps. | 2021-02-20 | - |
Supported downloading millions of logs | CLS allows users to download up to millions of logs. Users can specify the quantity of logs they want to export by setting search criteria and time range. Logs can be exported in two formats: CSV and JSON. | 2021-02-14 | |
Context search | Added the feature for locating the current log, allowing users to quickly locate a target log and scroll to view the log context. Added the feature to highlight a number of strings, quickly marking the keywords that users use to search. Added the filter condition feature to allow users to quickly locate the log where a target character string resides. | 2021-02-06 |
December 2020
Update | Description | Release Date | Documentation |
Monitoring Alarm 2.0 release | CLS allows users to set alarm policies for log topics. When query and analysis results meet the trigger conditions specified, the users can receive alarm notifications and they can monitor the log data in real time. | 2020-12-15 | |
CLS connection to Grafana | CLS can be connected to Grafana to export CLS's raw log data and SQL aggregate analysis results for display in Grafana. | 2020-12-15 | |
Supported extracting multi-line logs with a regular expression | The extraction mode of multi-line - full regular expression is added to LogListener collection configuration rules for log collection. | 2020-12-15 | |
Released Search Page 2.0 | The time component supports millisecond precision, and a custom time can be input quickly, improving query efficiency. The original layout and table layout and whether to turn on line break features are added to log data display, enabling flexible switching. Preference settings are added to allow users to customize the number of logs for loading and the number of historical records, meeting diversified data browsing needs. | 2020-12-15 | - |
November 2020
Update | Description | Release Date | Documentation |
SQL statistical analysis fully available | CLS provides the SQL statistical analysis feature to help users aggregate and analyze log data and display the analysis results in charts. | 2020-11-24 | |
Supported shipping to SCF | CLS supports shipping data of log topics to SCF via the CLS's log trigger to meet log data ETL requirements. | 2020-11-20 | |
CLS working with TKE (event and audit center) | CLS and TKE jointly launched the cluster audit and event log center, which allows users to view audit logs and cluster events in real time through visual charts, improving the efficiency of container cluster OPS with ease. | 2020-11-03 |
October 2020
Update | Description | Release Date | Documentation |
Automatically splitting topic partitions | After the auto-split feature is enabled, CLS will automatically split a topic partition into a reasonable number of partitions based on the actual write situation if the topic partition continues to reach the corresponding write request or write traffic threshold. | 2020-10-25 | |
Quick Field Analysis 2.0 | Rebuilt version of quick field analysis: Users can view field statistics results more conveniently and quickly. Users can quickly modify and save display fields. Users can quickly change the display order of fields by dragging and dropping fields. | 2020-10-15 | - |
September 2020
Update | Description | Release Date | Documentation |
CLS newly available in Taipei and Seoul | CLS is now available in Taipei and Seoul. | 2020-09-27 | |
Search page supporting layout configuration | The search page provides access for LogListener collection configuration and index configuration. It allows users to quickly view server group status and index field information. | 2020-09-24 | - |
Full support for Lucene syntax | CLS fully supports Lucene syntax search. | 2020-09-18 | |
Release of free tiers | After the CLS service is commercialized, Tencent Cloud still provides a certain free tier for all users in each region. | 2020-09-12 |
Yes
No
Was this page helpful?