tencent cloud

Feedback

Real-time Logs

Last updated: 2021-11-24 14:55:24
    Notice:

    Field value "HTTP/3" for the HTTP protocol identifier in general logs will be in beta from September 13, 2021, which will not affect the CDN console and APIs. Please be noted that getting log data from offline log packages may require adjustment.

    QUIC access has been in beta. For more details, see QUIC.

    Features

    CDN can collect and publish access logs in real time, enabling fast retrieval and analysis of log data. You can quickly access comprehensive, stable, and reliable one-stop logging services such as log collection, log storage, and log search in the CDN console.

    Note:

    • Real-time Logs is now officially launched. You can log in to the console with a root account and activate it. Note that you need to complete authorization and activate the Cloud Log Service before first use.
    • Real-time Logs currently does not support log shipping in regions outside the Chinese mainland.
    • Real-time Logs can only be activated by a root account.
    • CDN and ECDN domain names cannot be added to the same log topic.

    Use Cases

    This feature can be used to view and analyze user access in real time.

    Concepts

    Logset

    A logset is a project management unit in the log service. It is used to distinguish between logs of different projects and corresponds to an item or application. The CDN logset has the following basic attributes:

    • Logset name: cdn_logset
    • Region: the region to which a logset belongs
    • Retention period: the retention period of data in the current logset
    • Creation time: logset creation time

    Log topic

    A log topic is the basic management unit in the log service. One logset can contain multiple log topics, and one log topic corresponds to one type of application or service. We recommend you collect similar logs on different machines into the same log topic. For example, if a business project has three types of logs: operation log, application log, and access log, you can create a log topic for each type of log.

    The log service system manages different log data based on different log topics. Each log topic can be configured with different data sources, index rules, and shipping rules. Therefore, a log topic is the basic unit for configuring and managing log data in the log service. You need to configure corresponding rules first after creating a log topic before you can perform log collection, search, analysis, and shipping.

    Log topic features include:

    • Collect logs to log topics.
    • Store and manage logs based on log topics.
    • Search and analyze logs by log topics.
    • Ship logs to other platforms based on log topics.
    • Download and consume logs from log topics.

    Directions

    Log in to the CDN console, click Log Service on the left sidebar, and open the Real-time Log tab to create real-time log shipping.

    Creating a log topic

    Click Create to create a log topic.

    Note:

    A logset can contain up to 500 log topics.

    Configuring a log topic

    Enter the name of the new log topic and select the domain names to be bound to this topic.

    Note:

    • The topic name must be unique.
    • A domain name can only be bound to one log topic.
    • The configuration will take effect in about 15 minutes.

    Managing a log topic

    After successfully configuring a log topic, you can manage it as needed. Specifically, you can stop/start shipping logs to the log topic, search for logs in the log topic, manage or delete the log topic.

    Stopping/Starting the log shipping

    You can manually stop or start shipping logs to a log topic.

    Note:

    • After the shipping to a log topic is stopped, no logs of the bound domain names will be shipped to it. Logs that have already been shipped to it will be retained. This operation will take effect in about 5-15 minutes.
    • After the shipping to a log topic is started, all logs of the bound domain names will be shipped to it. This operation will take effect in about 5-15 minutes.

    Searching logs

    You can search for logs by log topic. Select a desired log topic and click Search to access the log search page.

    • Time Range: you can search for log data recorded today, during a 24-hour interval (one of the last 7 days), and during the last 7 days.
    • Sort: you can sort logs in descending or ascending order by log time.
    • Search: you can search logs by full text, key values, or fuzzy keywords. For more information, see Legacy CLS Search Syntax. For more search and analysis features, please use Cloud Log Service.

    Management

    You can manage a created log topic and update the list of domain names bound to it.

    Note:

    The new configuration will take effect in 5 to 15 minutes.

    Deleting log topics

    You can delete log topics manually.

    Note:

    After a log topic is deleted, the log topic no longer accepts new log shipping of the bound domain names, and completely clears all logs it contains. This operation will take effect in about 5 to 15 minutes.

    Log data description

    Log Field Raw Log Type Log Service Type Description
    app_id Integer long Tencent Cloud account APPID
    client_ip String text Client IP
    file_size Integer long File size
    hit String text Cache hit/miss. Both hits on CDN edge servers and parent nodes are marked as hit
    host String text Domain name
    http_code Integer long HTTP status code
    isp String text ISP
    method String text HTTP method
    param String text Parameter carried in URL
    proto String text HTTP protocol identifier
    prov String text ISP province
    referer String text Referer information, i.e., HTTP source address
    request_range String text Range parameter, i.e., request range
    request_time Integer long Response time (in milliseconds), which refers to the time it takes for a node to return all packets to the client after receiving a request.
    request_port String long A port connecting the client and CDN nodes. This field will be displayed as - if the port does not exist.
    rsp_size Integer long Number of returned bytes
    time Integer long Request timestamp in UNIX format (in seconds)
    ua String text User-Agent information
    url String text Request path
    uuid String text Unique request ID
    version Integer long CDN real-time log version
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support