Note:
The current feature is in grayscale. If the usage portal is not displayed in the console, submit a ticket to contact us for a fix. Product Introduction
Data Engineering - Workflow Service, deeply refined based on Serverless architecture, supports efficient elastic scheduling of large-scale workflows by optimizing the performance and deployment parameters of the open-source Argo Workflow engine, eliminating the need for businesses to sustain Ops work. The service includes a built-in Argo-Function native plugin, enabling direct orchestration and scheduling of SCF in the Workflow without requiring resident resources. Resources are released immediately after function execution, achieving efficient optimization of business costs.
Applicable Scenarios
Workflow orchestration, as a core component in the cloud native domain, is widely used in autonomous driving, scientific computing, LLM fine-tuning, and other fields. It enables running compute-intensive jobs related to large-scale data processing in a short time frame, suitable for machine learning, AI inference, data batch processing, and other scenarios.
Advantages
Tencent Cloud SCF has created a managed Workflow product based on open-source Argo Workflow. Through standardized encapsulation and deep integration with cloud-native capabilities, it provides enterprises with a workflow management solution that combines flexibility and security. Built on Serverless architecture principles, it offers fully managed operations to address three core pain points businesses face in workflow orchestration:
1. Infrastructure management burden: no need to worry about Kubernetes cluster deployment, node maintenance, version upgrade and other underlying tasks. The platform automatically performs Argo cluster creation, scaling, and Ops monitoring.
2. Multi-scenario adaptation complexity: geographical distribution, namespace isolation, and fine-grained permission control meet the resource isolation and collaboration needs of multiple teams in various environments.
3. Cloud service integration threshold: On the basis of native container orchestration, it deeply integrates with SCF, features built-in function invocation plug-ins, supports direct function calls in the workflow, and implements a hybrid orchestration pattern of "function + container".
Usage Process