Shipping Original Log Text
Last updated: 2025-12-03 18:30:48
Overview
This document describes how to ship the collected raw log to COS. Currently, only logs collected in a single line, in multiple lines, or with certain separators are supported in this scenario.
Log Collection Format | Support for Raw Log Shipping |
Full text in a single line | |
Full text in multiple lines | |
Separator (CSV) format | It depends. For more information, see CSV format. Only space, tab, comma, semicolon, and vertical bar are supported as raw log separators. |
JSON format | No. |
Full regex | No. |
Directions
Log collected in a single line or multiple lines
For logs collected in a single line or multiple lines, you can configure parameters based on CSV shipping to implement raw log shipping.
1. Create a shipping task. For details, see Create a Shipping Task.
2. Set Format of Data to Ship to CSV, retain the
__CONTENT__ field, delete other fields, set Separator to Space, set Escape Character to None, set Invalid Field Filling to None, and disable Key in First Line.The parameters are described as follows:
Configuration Item | Description | Remarks |
Key | __CONTENT__ | For full text in a single line or multiple lines, __CONTENT__ is used as the default key, and the raw log is used as the value. When the raw log is shipped, only the __CONTENT__ field is retained. |
Separator | Space | Set Separator to Space for the full text in a single line or multiple lines. |
Escape Character | None | To prevent the raw log from being modified due to escape characters, set Escape Character to None. |
Invalid Field Filling | None | Set Invalid Field Filling to None. |
Key in First Line | Disabled | You don't need to add a description of the field name in the first line of the CSV file for raw log shipping. |
3. Click OK to see that the shipping task has been started.
Logs collected in CSV format
Note:
CSV shipping supports limited types of separators, including space, tab, comma, semicolon, and vertical bar. Therefore, you can ship log data in the raw format only when the separator in the raw log content is supported by CSV shipping.
1. Create a shipping task. For details, see Create a Shipping Task.
2. Select CSV as the delivery format and remove unnecessary CLS metadata fields.
The parameters are described as follows:
Configuration Item | Value | Description |
Key | Keys | Only the user field is retained. |
Separator | A value selected from the drop-down list | Select the separator of the raw log content. If separators are different, raw log shipping is not supported. Currently, only space, tab, comma, semicolon, and vertical bar are supported. |
Escape Character | None | To prevent the raw log from being modified due to escape characters, set Escape Character to None. |
Invalid Field Filling | None | Set Invalid Field Filling to None. |
Key in First Line | Disabled | You don't need to add a description of the field name in the first line of the CSV file for raw log shipping. |
3. Click OK to see that the shipping task has been started.
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No
Feedback