tencent cloud

Audio/Video Moderation
Download PDF
Last updated: 2023-10-13 17:30:08
Audio/Video Moderation
Last updated: 2023-10-13 17:30:08
Download PDF
Audio/Video content moderation is an offline task that intelligently moderates audio/video content with the aid of AI. The task execution results include confidence score, moderation suggestion, and suspected audio/video segments. According to the suggestion, you can decide whether to allow an audio/video to be published, effectively avoiding potential legal risks and damage to your brand’s reputation.
VOD can perform content moderation on images, text in images, speech, and sounds. Supported moderation labels include porn, terrorism, and moaning.
Content Type
Moderation Label
Images
Pornographic (Porn)
Terrorist (Terror)
Sounds
Moaning (Moan)
Speech (ASR)
Pornographic (Porn)
Terrorist (Terror)
Text in images (OCR)
Pornographic (Porn)
Terrorist (Terror)
The table below lists some of the fields in moderation results:
Field
Type
Description
Confidence
Float
The moderation score (0-100). The higher the score, the more likely the content is non-compliant.
Suggestion
String
The suggestion. Valid values: pass, review, block.
pass: The probability of the content being non-compliant is low. We recommend you allow the content to pass.
review: The probability of the content being non-compliant is high. Manual verification is recommended.
block: There’s a high chance that the content is non-compliant. We recommend you block the content.
Form
String
The moderated content type. Valid values:
Image
Voice
OCR
ASR
Label
String
The moderation label. Valid values:
Porn
Terror
Moan

Audio/Video Moderation Template

An audio/video moderation template represents a set of moderation parameters. You can use a template to specify which of the following moderation labels to use:
Pornographic (Porn)
Terrorist (Terror)
Moaning (moan)
VOD provides preset audio/video moderation templates for common parameter combinations. You can also use a server API to create and manage custom templates.

Initiating a Moderation Task

You can initiate an audio/video moderation task by calling a server API, via the console, or by specifying the task when uploading videos. For details, see Task Initiation.
You can initiate an audio/video moderation task in these ways:
Call the server-side API ReviewAudioVideo.
Initiate a task in the console. For detailed directions, see Audio/Video Moderation.
Specify a task when uploading audio/video from server: Create a task flow with moderation enabled in the console. Then, when calling ApplyUpload to upload audio/video, set procedure to the name of the task flow.
Specify a task when uploading audio/video from client: Create a task flow with moderation enabled in the console. Then, when generating the signature for upload from client, set procedure to the name of the task flow.
Specify a task when uploading audio/video from the console: In the console, create a task flow with moderation enabled. Then, when uploading audio/video files, choose Auto-processing after upload and select the task flow created.

Getting the Result

After initiating a moderation task, you can either wait for the ReviewAudioVideoComplete notification asynchronously or perform a task query synchronously to get the task execution result. Below is an example of the notification in normal callback mode (the fields with null value are omitted):
{
    "EventType": "ReviewAudioVideoComplete",
    "ReviewAudioVideoCompleteEvent": {
        "TaskId": "125xxxx-ReviewAudioVideo-07edbc78ba20563cdf2362cffbf4aa0ct",
        "Status": "FINISH",
        "ErrCodeExt": "",
        "Message": "SUCCESS",
        "Input":{
            "FileId": "387702130626135215"
        },
        "Output": {
            "Suggestion": "block",
            "Label": "Porn",
            "Form": "Image",
            "SegmentSet":[
                {
                    "StartTimeOffset": 0,
                    "EndTimeOffset": 1,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163480.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:16.039Z"
                },
                {
                    "StartTimeOffset": 1,
                    "EndTimeOffset": 2,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163481.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:17.039Z"
                },
                {
                    "StartTimeOffset": 2,
                    "EndTimeOffset": 3,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163482.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:18.039Z"
                },
                {
                    "StartTimeOffset": 3,
                    "EndTimeOffset": 4,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163483.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:19.039Z"
                },
                {
                    "StartTimeOffset": 4,
                    "EndTimeOffset": 5,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163484.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:20.039Z"
                },
                {
                    "StartTimeOffset": 5,
                    "EndTimeOffset": 6,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163485.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:21.039Z"
                },
                {
                    "StartTimeOffset": 6,
                    "EndTimeOffset": 7,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163486.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:22.039Z"
                },
                {
                    "StartTimeOffset": 7,
                    "EndTimeOffset": 8,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163487.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:23.039Z"
                },
                {
                    "StartTimeOffset": 8,
                    "EndTimeOffset": 9,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163488.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:24.039Z"
                },
                {
                    "StartTimeOffset": 9,
                    "EndTimeOffset": 10,
                    "Confidence": 99,
                    "Suggestion": "block",
                    "Label": "Porn",
                    "SubLabel": "SexyBehavior",
                    "Form": "Image",
                    "AreaCoordSet": [],
                    "Text": "",
                    "KeywordSet": [],
                    "Url": "https://251000800.vod2.myqcloud.com/1a168d62vodcq251000800/result/vod/w-video-Y7uETQ0Oqj4SY3Fh/screenshot_0_1638163489.jpg",
                    "PicUrlExpireTime": "2023-01-16T03:06:25.039Z"
                }
            ],
            "SegmentSetFileUrl": "http://251000800.vod2.myqcloud.com/a8800b40vodtranssgp251000800/0f9bd2b0-34a8-4642-f481-001894d93019.txt",
            "SegmentSetFileUrlExpireTime": "2022-10-12T07:01:07.695Z"
        },
        "SessionContext": "",
        "SessionId": ""
    }
}
In the above callback, ReviewAudioVideoCompleteEvent.Output is the audio/video moderation result; Output.Suggestion=block indicates that VOD suggests you block the content; Output.Label=Porn and Output.Form=Image indicate that the mostly likely violation is pornographic content in images.
An audio/video clip may include multiple suspected segments. Output.SegmentSet lists only the first 10. You can view the information of all suspected segments by visiting Output.SegmentSetFileUrl within the validity period.
StartTimeOffset and EndTimeOffset are the start and end time of a suspected segment, and SubLabel indicates the type of violation.
If text in images or speech is moderated:
Text is the full text recognized.
KeywordSet is the list of non-compliant words hit.
If images (people and objects) or text in images are moderated:
AreaCoordSet is the coordinates of the suspected object.
Url is the URL of the suspected image.
PicUrlExpireTime is the expiration time of Url.
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback