tencent cloud

Tencent Cloud WeData

Release Notes
Dynamic Release Record (2026)
Product Introduction
Product Overview
Product Advantages
Product Architecture
Product Features
Application Scenarios
Purchase Guide
Billing Overview
Product Version Purchase Instructions
Execute Resource Purchase Description
Billing Modes
Overdue Policy
Refund
Preparations
Overview of Account and Permission Management
Add allowlist /security groups (Optional)
Sign in to WeData with Microsoft Entra ID (Azure AD) Single Sign-On (SSO)
Operation Guide
Console Operation
Project Management
Data Integration
Studio
Data Development
Data Analysis
Data Science
Data Governance (with Unity Semantics)
API Documentation
History
Introduction
API Category
Making API Requests
Smart Ops Related Interfaces
Project Management APIs
Resource Group APIs
Data Development APIs
Data Asset - Data Dictionary APIs
Data Development APIs
Ops Center APIs
Data Operations Related Interfaces
Data Exploration APIs
Asset APIs
Metadata Related Interfaces
Task Operations APIs
Data Security APIs
Instance Operation and Maintenance Related Interfaces
Data Map and Data Dictionary APIs
Data Quality Related Interfaces
DataInLong APIs
Platform Management APIs
Data Source Management APIs
Data Quality APIs
Platform Management APIs
Asset Data APIs
Data Source Management APIs
Data Types
Error Codes
WeData API 2025-08-06
Service Level Agreements
Related Agreement
Privacy Policy
Data Processing And Security Agreement
Contact Us
Glossary

Development and Ops System Tables

PDF
Mode fokus
Ukuran font
Terakhir diperbarui: 2025-12-29 14:54:11
This article introduces the system tables for development and Ops, which record data related to the development and Ops module under the account. You can use the system tables directly to view historical data or process table data for analysis scenarios.

Usage Requirements

To access system catalog, you must use DLC Data Source. Other data sources do not currently support system catalog capacity.
Access system catalog must use tc-catalog.

Existing System Table

Table name
Description(Optional)
Update Frequency
task
Contains the basic information of tasks in the orchestration space (development status).
Update every 5 minutes
task_schedule
Contains the scheduling info of tasks in the orchestration space (development status).
Update every 5 minutes
task_dependency
Contains the dependency relationship of tasks in the orchestration space (development status).
Update every 5 minutes
workflow
Contains the basic information of workflows in the orchestration space (development status).
Update every 5 minutes
task_run_record
Contains the run history of all instances in the Ops center.
Update every 5 minutes
parameter
Parameter table, including project parameter, workflow parameter, and task parameter. Workflow parameter and task parameter are in development status.
Update every 5 minutes

task

Table: system_catalog.wedata.task
Table structure:
Column Name
Data Type
Description(Optional)
project_id
string
Project ID
project_name
string
Project Name
task_id
string
Task ID
task_name
string
Task name
task_type
string
Task type
status
string
Task Status
owner
string
Task Owner
workflow_id
string
Associated workflow ID
workflow_name
string
Workflow name
schedule_frequency
string
Scheduling frequency
create_timestamp
timestamp_tz(6)
Task creation time.
last_update_timestamp
timestamp_tz(6)
Last update time.
last_update_user
string
Latest update user
data_source
string
Data Source
dlc_data_engine
string
DLC Data Engine
dlc_resource_group
string
DLC resource group
execution_resource_group
string
Execution Resource Group
Query Example:
#Retrieve tasks where the person in charge of a project is a specific user.
SELECT
task_id,
task_name,
task_type,
status,
workflow_name,
FROM
wedata.task
WHERE
project_id = 'your_project_id' -- Replace with your project ID
AND owner = 'your_owner_name'; -- Replace with your owner name

task_schedule

Table: system_catalog.wedata.task_schedule
Table structure:
Column Name
Data Type
Description(Optional)
project_id
string
Project ID
project_name
string
Project Name
task_id
string
Task ID
task_name
string
Task name
config_method
string
Workflow type of the task:
PERIODICALLY: Workflow Cycle
MANUALLY: Manual workflow
schedule_cycle_type
string
Scheduling configuration method:
COMMON: General Configuration
CRON_EXPRESSION: Use cron expression configuration
effective_start_time
timestamp_tz(6)
Effective time - Start time
effective_end_time
timestamp_tz(6)
Effective time - End time
schedule_frequency
string
Scheduling cycle
ONEOFF_CYCLE: one-time
YEAR_CYCLE: yearly
MONTH_CYCLE: monthly
WEEK_CYCLE: weekly
DAY_CYCLE: daily
HOUR_CYCLE: hourly
MINUTE_CYCLE: minute
CRONTAB_CYCLE: crontab expression type
delay_time
long
Scheduling delay time, unit: minutes
Minute-based task: 0 means no delay
Hourly task starts at 0 minutes per hour with a delay of several minutes to execute
Day, week, month, and annual tasks start at 0:00 with a delay of several minutes to execute.
execution_start_time
string
Execution time - Start time
execution_end_time
string
Execution time - End time
cycle_step
long
Scheduling frequency:
For example, minute-based tasks, 20 means scheduling every 20 minutes.
Day-based tasks, 1 means scheduling once a day
time_point
string
Specify scheduling time
Configure the specified running time for hourly scheduling task configuration
time_zone
string
Scheduling time zone
cron
string
cron expression, only for tasks with cron configuration mode
Query Example:
#Retrieve a list of tasks with a scheduling period of one day for a specific project.
SELECT
project_id,
project_name,
task_id,
task_name,
config_method,
schedule_cycle_type,
effective_start_time,
effective_end_time,
schedule_frequency
FROM
wedata.task_schedule
WHERE
project_id = 'your_project_id' -- Replace with your project ID
AND schedule_frequency = 'DAY_CYCLE';


task_dependency

Table: system_catalog.wedata.task_dependency
Table structure:
Column Name
Data Type
Description(Optional)
project_id
string
Project ID
project_name
string
Project Name
task_id
string
Task ID
task_name
string
Task name
dependency_project_id
string
Upstream task associated project ID
dependency_project_name
string
Upstream task associated project name
dependency_task_id
string
Upstream task ID
dependency_task_name
string
Upstream Task Name
Query Example:
#Get the direct upstream task of a certain task
SELECT
dependency_project_id AS upstream_project_id,
dependency_project_name AS upstream_project_name,
dependency_task_id AS upstream_task_id,
dependency_task_name AS upstream_task_name
FROM
wedata.task_dependency
WHERE
task_id = 'your_task_id'; -- Replace with your task ID


workflow

Table: system_catalog.wedata.workflow
Table structure:
Column Name
Data Type
Description(Optional)
project_id
string
Project ID
project_name
string
Project Name
workflow_id
string
Associated workflow ID
workflow_name
string
Workflow name
workflow_type
string
Workflow type: Workflow cycle/Manual workflow
folder
string
Workflow folder
create_time
timestamp_tz(6)
Workflow creation time
last_update_timestamp
timestamp_tz(6)
Last update time.
last_update_user
string
Latest updater
owner
string
Workflow Owner
Query Example:
#Retrieve the workflow list under a specific username
SELECT
workflow_id,
workflow_name,
workflow_type,
FROM
wedata.workflow
WHERE
owner = 'your_owner_name'; -- Replace with your owner name

task_run_record

Table: system_catalog.wedata.task_run_record
Table structure:
Column Name
Data Type
Description(Optional)
task_run_id
string
Task instance ID
task_id
string
Task ID
task_name
string
Task name
project_id
string
Task associated project ID
project_name
string
Task associated project name
workflow_id
string
Associated workflow ID
workflow_name
string
Workflow name
dp_data_dt
timestamp_tz(6)
Planned Scheduling Time
task_run_status
string
Instance State
run_min
string
Runtime
run_start_dttm
timestamp_tz(6)
Start time
run_end_dttm
timestamp_tz(6)
Running end time
run_log_url
string
Instance Details Page - Execution Log Product Link
task_run_error_msg
string
Critical Error Log
last_update_timestamp
timestamp_tz(6)
Last update time.
last_update_user
string
Latest updater
Query Example:
#Get the number of times each workflow's task instances have run in the past 7 days.
SELECT
workflow_name,
COUNT(task_run_id) AS instance_count
FROM
wedata.task_run_record
WHERE
run_start_dttm >= CURRENT_DATE - INTERVAL '7' DAY
GROUP BY
workflow_name;
#Retrieve the top 10 tasks by average runtime and return the task name and average runtime.
SELECT
task_name,
AVG(run_min) AS avg_run_min
FROM
wedata.task_run_record
WHERE
run_min IS NOT NULL
GROUP BY
task_name
ORDER BY
avg_run_min DESC
LIMIT 10;

parameter

Table: system_catalog.wedata.parameter
Table Structures
Column Name
Data Type
Description(Optional)
name
string
Project/Task/Workflow Name
id
string
Project/Task/Workflow ID
level
string
Parameter Level:
TASK: task level
PROJECT: project level
WORKFLOW: workflow level
param_name
string
Parameter Name
param_value_dev
string
Parameter Value in Development Status
param_value_prod
string
Parameter Value in Production Status
Query Example:
#Get the actual parameters and corresponding values ​​used in a task.
WITH task_params AS (
SELECT
p.param_name,
p.param_value_dev AS dev_value,
p.param_value_prod AS prod_value,
'TASK' AS param_level
FROM
wedata.parameter p
JOIN
wedata.task t ON p.id = t.task_id
WHERE
t.task_id = 'task_id' -- Replace with your task ID
AND p.level = 'TASK'
),
workflow_params AS (
SELECT
p.param_name,
p.param_value_dev AS dev_value,
p.param_value_prod AS prod_value,
'WORKFLOW' AS param_level
FROM
wedata.parameter p
JOIN
wedata.task t ON p.id = t.workflow_id
WHERE
t.task_id = 'task_id' -- Replace with your task ID
AND p.level = 'WORKFLOW'
),
project_params AS (
SELECT
p.param_name,
p.param_value_dev AS dev_value,
p.param_value_prod AS prod_value,
'PROJECT' AS param_level
FROM
wedata.parameter p
JOIN
wedata.task t ON p.id = t.project_id
WHERE
t.task_id = 'task_id' -- Replace with your task ID
AND p.level = 'PROJECT'
),
all_params AS (
SELECT * FROM task_params
UNION ALL
SELECT * FROM workflow_params
UNION ALL
SELECT * FROM project_params
)
SELECT
param_name,
dev_value,
prod_value,
param_level
FROM (
SELECT
param_name,
dev_value,
prod_value,
param_level,
ROW_NUMBER() OVER (
PARTITION BY param_name
ORDER BY CASE
WHEN param_level = 'TASK' THEN 1
WHEN param_level = 'WORKFLOW' THEN 2
WHEN param_level = 'PROJECT' THEN 3
END
) AS rn
FROM
all_params
) ranked_params
WHERE
rn = 1;

Bantuan dan Dukungan

Apakah halaman ini membantu?

masukan