Product Introduction

What's Batch?

Scenarios

Strengths

Glossary

Quota & Limits

Data Security

Purchase Guide

Getting Started

Preparation

Using CLI - Submit a Job

Using CLI - Compute Environment

Configuring a Job

Using Console

Console User Guide

Task Template Management

Job Management

User Guide

How to create images usable by BatchCompute

Windows Custom Images

Environment Variables

Entering COS & CFS Paths

Event Notice & Callback

Cloud Access Management

Command Line Interface

Preparation

Quick Start

Running Remote Package

Mapping Remote Storage

Use Cases

Building Cluster Using Compute Environment

Example: 3ds Max 2018 Rendering

Example: Deep Learning

API Documentation

History

Introduction

API Category

Making API Requests

Compute Environment APIs

Configuration Viewing-related APIs

Task Template-related APIs

Job-related APIs

Data Types

Error Codes

SDK Documentation

Instructions

FAQs

Glossary

Entering COS & CFS Paths

PDF

Focus Mode

Font Size

Last updated: 2024-01-13 11:19:29

Overview
You need to enter COS and CFS paths for execution logs (StdOut and StdErr) and remote storage mappings in BatchCompute, which is slightly different from access to COS buckets or files in HTTP mode.
COS Path Description
Only endpoints in COS XML API format
For BatchCompute paths, only endpoints in the XML API format are supported as shown below:
﻿
﻿
Prefixed with cos://
The obtained COS endpoint is as shown below:
﻿

Prefix BatchCompute paths with cos:// and suffix them with /.
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/
Mounting subdirectory
Add subdirectories to a bucket path as common file directories. The following figure shows the subdirectories created in the bucket.
﻿

For directory mounting, the COS paths are as follows:
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/logs/
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/input/
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/output/
Supporting intra-region buckets
COS has regional attributes. Data transfer between the storage server and Cloud Virtual Machine (CVM) is efficient only when your BatchCompute job and COS bucket are in the same region.
CFS Path Description
In remote storage mappings, you can configure CFS/NAS paths to automatically mount to a local path as shown below:
﻿
﻿
Prefixed with cfs:// or nfs://
An example of an obtained CFS path is 10.66.xxx.xxx. Prefix a BatchCompute path with cfs:// or nfs://.
Note：
Suffix the path with / and ensure that your CFS/NAS and BatchCompute job are on the same network.
cfs://10.66.xxx.xxx/ 
﻿