Based on an optimized quality scoring system, the quality report provides detailed information on data quality scores in each dimension, including overall quality score, dimension quality score, table quality score details, and rule trigger details. It supports user customization of the statistical scope (statistical date, data source, database, data table) and allows choosing a scoring mode that meets business requirements to generate the quality report, with one-click sharing and export report features.
Note:
The quality report data supports auto-update by the system (every midnight at 1:00 AM), as well as manual triggering of recalculation after users modify dimension weight. The update method and last update time will be prompted.
Scoring Logic
The quality scores in the quality report are calculated based on the selected scoring mode, with rule quality score as the foundation. The calculation follows the filter range (statistical date, data source, database, data table) and dimension scope customized by users, thereby forming table quality score, library quality score, dimension quality score, and overall quality score.
Quality Score Dimension
Scoring Mode
Calculation Formula
rule quality score
-
pass rate of this rule (number of execution passing the rule / total number of executions) x 100
table quality score
calculating based on the weight across all dimensions
∑(AVG(rule quality score of associating tables in the same dimension) * dimension weight) / ∑dimension weight
calculate based on configured dimension weight
∑(AVG(rule quality score of associating tables in the same dimension) * dimension weight) / ∑dimension weight of configured rules
calculate without dimension weight
AVG(rule quality score of associating tables)
library quality score
-
SUM(table quality score) / tables involved in detection within the specified range
dimension quality score
-
SUM(table quality score of same dimension) / tables involved in detection in this dimension
overall quality score
-
SUM(table quality score) / tables involved in detection within the specified range
Note:
The rules for associating tables include table-level rules and related rules for field configuration within the table. For databases, dimensions, and overall quality score, the calculation formula is the same under different scoring modes, but the table quality scores used for calculation differ.
Details
Overall quality score
Provides global quality score data, where users can view the trend chart of the last 7 or 30 days and the Average Overall Quality Score Within the Cycle.
Dimension quality score
Displays the scores of six major dimensions: Accuracy, Uniqueness, Integrity, Consistency, Timeliness, and Validity. It supports user-defined scoring weights for each dimension, weight setter, weight update time, and the number of evaluation forms. All this information will be recorded and displayed.
Note:
1. Only project administrators have permission to modify dimension weight, which takes effect the next day by default. Users can also select to take effect immediately and manually trigger recalculation. It supports the use of modified dimension weight values to recalculate historical scores within the last 60 days.
2. Dimension weight is global. When the first two scoring modes (full-dimensional, configured rule dimension) are selected, modification will affect all scores including overall quality score, dimension quality score, library quality score, and table quality score once it takes effect.
3. The report recalculation status will prompt simultaneously. When the quality score is in the process of recalculation, the entry to modify dimension weight will be grayed out until the recalculation is completed, supporting the operation to modify dimension weight again.
Table Quality Score Details
Supports viewing the database and Table Quality Score Details.
Click the specific table name to redirect to the Ops management interface of the table, where users can view the execution status of related quality tasks.
Click the specific table quality score to view the associated rule detail, rule quality score, and Detection Pass Situation. Users can quickly locate problems.
Supports viewing the historical trend of table quality scores.
Rule trigger details
Supports viewing the rule-triggered detailed table in the quality report (including only instances where the rule "Detection results abnormal" is triggered), which summarizes when/which data table/corresponding quality monitoring and rule were triggered ("triggered" means it actually meets the configured rule conditions):
Click the "View instance" button to view the corresponding instance execution record.
