tencent cloud

Media Processing Service

Release Notes and Announcements
Release Notes
Announcements
Product Introduction
Overview
Features
Strengths
Use Cases
Purchase Guide
Billing Overview
Purchase Instructions
Top Up and Purchase
Overdue Payments
Refund
Getting Started
Console Guide
Overview
Creating Tasks
Tasks
Orchestrations
Templates
Resource Packs
Video Evaluation
AIGC Content Generation
Terminal SDK
Subtitle Editing Tool
Usage Statistics
Cloud Access Management Sample
Integration Tutorials
Audio/Video Transcoding Integration
Audio/Video Enhancement Integration
Audio Separation Integration
Integration of Digital and Visible Watermarks
Media AI Integration Tutorial
Media Quality Inspection Integration
Terminal SDK integration
MPS Live Stream Recording integration
DRM integration
Other tutorials
Application Scenario and Practical Tutorial
Image Quality Improvement Scenario
Audio/Video Cost Optimization Scenario
Short Drama Translation Scenario
AI-Generated Content Scenario
Online Education Scenarios
API Documentation
History
Introduction
API Category
Making API Requests
Processing Task Initiation APIs
Task Management APIs
Transcoding and Enhancement Template APIs
Watermark Template APIs
Screenshot Template APIs
Media AI Template APIs
Media AI—Hotword Lexicon APIs
Media AI—Sample Management APIs
Media Quality Inspection Template APIs
Live Streaming Recording Template APIs
Orchestration Management APIs
Data Statistics APIs
StreamLink—Security Group Management APIs
Other APIs
Image Processing Template APIs
AI Generation APIs
Other APIs
Data Types
Error Codes
Other Documents
WebSocket Protocol for Recognition
FAQs
Basics
Account Authorization
Task Configuration
Task Initiation
Task Result Viewing
Related Agreement
Service Level Agreement
Privacy Policy
Data Processing And Security Agreement
Contact Us
Glossary

Short Drama Translation Scenario

PDF
Focus Mode
Font Size
Last updated: 2025-03-21 15:25:03

Overview

Tencent Cloud's media processing products provide solutions for short dramas' global expansion, aiming to help creators and producers introduce them to international markets. This document introduces the functionalities and usage methods to achieve internationalization and localization of short dramas quickly.
Left: Original video with CN text and Chinese voice; Right: Generated multilingual subtitles and speech after processing; Note: Image generated by Tencent Yuanbao AI
Left: Original video with CN text and Chinese voice; Right: Generated multilingual subtitles and speech after processing; Note: Image generated by Tencent Yuanbao AI


Requirements for Short Drama Clients

The challenges faced in the promotion of a vast array of videos include inefficient manual processing, the necessity to automatically recognize and generate multilingual subtitles, the erasure or replacement of items within the video, as well as substituting the original language dialogue with the target market language and re-dubbing to enhance the viewing experience.

Our Solutions

Short dramas seeking international exposure urgently require solutions for subtitle translation, dubbing conversion, and multilingual translation. We offer a comprehensive one-stop solution for the translation and production of short dramas.

Feature
Description
One-Stop Short Drama Translation and Production (Subtitle Removal + Voiceover & Translation + Audio Synthesis & Replacement)
This feature offers a comprehensive solution for original subtitle erasure, subtitle & voice translation, and multilingual subtitle & voice replacement. Utilizing this capability, the input video will be processed in the following sequential steps:
1. Identify the subtitles within the original video's visuals, followed by their erasure.
2. Recognize the original video's audio to generate subtitle files, which are then translated. The translated subtitles are subsequently:
2.1. Rendered onto the original video's subtitle positions.
2.2. Used to replace the original video's soundtrack through voice synthesis.
3. Synthesize a new video.
Example
Left chart: Original Chinese short video; Right chart: The processed output video has English subtitles and English dubbing.
Left chart: Original Chinese short video; Right chart: The processed output video has English subtitles and English dubbing.

Distinct capabilities can also be integrated independently, as detailed below:
Feature
Description
Erasure of watermarks, logos, subtitles
Remove watermarks, logos, subtitles, and other elements from videos, including blurring and seamless removal options. Supports erasing many common watermarks and offers custom training for others at an additional cost.
Facial and License Plate Sensitive Information Blurring/Mosaic
Apply blurring or mosaic effects to sensitive information such as faces and license plates within video frames.
Human voice and background sound separation
Separation of human voice and background sound.
Text recognition
Recognizes text in a video, including vertically oriented text, and automatically extracts keywords from the text.
Speech recognition
Quickly recognizes the speech in a video and converts it to text based on deep learning. You can specify custom keywords and locate the time points in the video at which the keywords are spoken.
Subtitle Translation
Translate original subtitles to generate multilingual subtitles, catering to the needs of audiences from diverse linguistic backgrounds. Supports the configuration of a terminology database to enhance translation accuracy.
Incorporating Subtitles into Videos
Automatically generated subtitle files are embedded into videos through transcoding, allowing for customization of style, font, size, color, and background color.。
Text-to-Speech Conversion
Extract subtitle files to create new multilingual audio files.
Replace the original video's audio track
Replace the original video audio with generated multilingual audio to enhance the viewing experience for local audiences.
Digital Rights Management (DRM)
For copyrighted content, we offer support for commercial DRM and HLS private encryption. Currently, we support DRM encryption formats including FairPlay and Widevine.




Help and Support

Was this page helpful?

Help us improve! Rate your documentation experience in 5 mins.

Feedback