Real-Time Instance Ops
Last updated:2026-01-08 10:44:04
The real-time instance operation and maintenance page is used to view and manage instances generated by real-time tasks. It maintains instances through various features to ensure stable, efficient, and reliable data processing and running processes.
Use Limits
1. The system currently only retains instances within 4 months, and instances older than 4 months will be auto cleaned up.
2. Metric monitoring data is only supported on the latest version of Standard Spark Engine. To upgrade the engine, submit a DLC ticket.
Operation Steps
1. Log in to Tencent Cloud WeData Console.
2. Click in the project list of the left directory tree.
3. Select project, then click at the top to enter the Ops center module.
4. In the left directory tree, click Real-time Instance Ops.
Real-Time Instance Ops
Real-Time Instance List
Feature description:
Information | Description(Optional) |
Task name/ID | Task name: Click to navigate to the instance details page > Execution log. Copying is supported. Task ID: Used for backend query logs, troubleshoot problems, and other scenarios. Copying is supported. |
Execution Status | Real-time instance execution status includes 3 types: Running: The instance is running and the running process can be viewed in real time through logs. Success: The task instance ran successfully. Failure: The task instance run failed. List headers support filtering by execution status. |
Instance Type | This list only shows real-time instances, and the instance type is only real-time. |
Owner | The owner name of the real-time instance, clarifying the maintenance responsibility of the computing task instance, defaults to the creator of the computing task. |
Task type | The type of computing task to which the real-time instance belongs. |
Start Time | Execution start time for real-time instances after generation. Format: yyyy-MM-dd HH:mm:ss. |
End time. | End time of the real-time instance's execution. Format: yyyy-MM-dd HH:mm:ss. |
Execution Duration | Execution duration from start to end time of the real-time instance. |
folder | Displays the parent folder directory of the computing task to which the real-time instance belongs in the orchestration space, facilitating the identification and unified management of computational task instances. |
Execution Resource Group | Execution resource group used by the real-time instance. List headers support filtering by execution resource group name. |
Real-Time Instance Operation
Feature description:
Operation | Feature Description |
Terminate | Batch operations and single task operations are divided into. Batch operations require checking before the task name and reusing the feature button at the top. For single task operations, click the operation item in the Operation column of the task list. Only applicable to real-time instances in "running" state. After terminating an instance, the corresponding instance will be terminated and the execution status will be set to "failure". |
View Logs | Navigate to the real-time instance details page > Execution log page to view the running log of the real-time instance. |
Task Development | Navigate to the compute node configuration interface of the corresponding real-time instance in the orchestration space. This is a quick access channel for real-time instance operation and maintenance to the compute task node editing. |
Real-Time Instance Filtering
Feature description:
Operation | Description(Optional) |
Filter by task name/ID | Supports fuzzy matching by task name or task ID. |
Filter by start time | Filter the task list based on start time. |
Filter by owner | Filter by owner. |
Filter by folder | Filter computing tasks in the workspace based on folder name. Unfold multi-level directory and support multiple selections. |
Real-Time Instance Shortcut Actions
Feature description:
Operation | Description(Optional) |
Refreshing | Click the  |
Display column adjustment | Click the  |
Real-Time Instance Details Page
The real-time instance detail page collects the instance's execution logs, streaming monitoring metrics, operation records, SparkUI information, etc., helping users view and operate real-time instances.
Tab Page | Description(Optional) |
Execution Logs | View real-time instance running logs. Log support includes filtering by different log levels, refreshing, log line breaks, log download, and search by keyword. Logs show up to 30,000 entries from the start of execution. Download all logs to view. Click the SparkUI button to navigate to the SparkUI link and view engine performance metrics.  |
Metric Monitoring | Metric monitoring supports viewing KPIs during DLC Spark Streaming instance run, including: Driver memory percentage, input records per second, output records per second, data inflow delayed processing time, task backpressure ratio, task retry count, task runtime duration, state storage memory usage, state cache hit rate, total number of state lines, total time consumed for status updates, total time consumed for submission. Support filtering by preset time range or custom time range. Preset time ranges include: 5 minutes, 30 minutes, 1 hour, 3 hours, 12 hours, 24 hours, 2 days, 7 days. Custom time range supports selecting last 30 days. Metric monitoring time granularity supports display by 5-minute or 1-minute intervals.  |
Operation Record | View operation records of real-time instances, including the operator and operation time of termination operations.  |
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No
Feedback