Creating a Data Settlement One-Time Task
Create a one-time data settlement task to execute once between the GooseFSx directory and the COS storage bucket.
Prerequisites
Operation Steps
2. Select a region, select the target GooseFSx instance. You can quickly find the target instance by Availability Zone, Status, Type, or search for the target instance by name keyword fuzzy matching.
3. Click the instance ID or Manage, select Data Flow > Data Settlement.
4. Under the single task tab, click Create One-time Task. In the pop-up dialog box, configure as follows:
Task name: Enter an easy-to-identify name, modifiable after creation.
GooseFSx directory: Select from directories that have established data flow rules with COS. Go to the data flow rules page to create.
Dataset: Specifies the flow of certain data in a GooseFSx directory. The GooseFSx directory can be specified by directory (a subdirectory or the entire directory) or by manifest (certain files). The data flow maintains a one-to-one correspondence between the data in the GooseFSx directory and the data in the COS storage bucket. The dataset also specifies the corresponding data flow of the COS storage bucket. For details, ,see Managing GooseFSx Data Pre-Warming. Task type:
Data settlement: Settle specified data in a GooseFSx directory to a COS storage bucket. Suitable for storing a piece of data in COS or distributing via the Internet, among other scenarios.
Data settlement and delete local data: Settle specified data in a GooseFSx directory to a COS storage bucket and delete the specified data in the GooseFSx directory. Suitable for data cooling and other scenarios.
Data settlement and eliminate local data but reserve metadata: Settle specified data in a GooseFSx directory to a COS storage bucket and eliminate the specified data in the GooseFSx directory while retaining metadata. Suitable for scenarios such as GooseFSx building a global namespace.
5. Click Confirm, and backend automation will execute data settlement.
Note:
GooseFSx directories in Lazy-load mode (auto mode L) do not currently support data settlement for single tasks.
Note: If the data flow mode of the GooseFSx directory is manual mode, data settlement is unsupported, and local data is eliminated while metadata is reserved.
Deleting a Data Settlement One-Time Task
Note:
You can delete completed or pending execution one-time tasks for data settlement. Note:
Delete the completed data settlement one-time task, you cannot query the task's relevant information.
Delete the pending execution data settlement one-time task, which cancels the task.
Deletion is not supported for executing one-time data settlement tasks.
Prerequisites
Operation Steps
2. Select a region, select the target GooseFSx instance. You can quickly find the target instance by Availability Zone, Status, Type, or search for the target instance by name keyword fuzzy matching.
3. Click the instance ID or Manage, select Data Flow > Data Settlement.
4. In the single task list, select the target task, or filter the target task by conditional filtering; or check multiple tasks and execute delete in batches.
Querying Data Settlement One-Time Tasks
Prerequisites
Operation Steps
2. Select the region, select the target GooseFSx instance. You can quickly find the target instance by Availability Zone, Status, Type, or search for the target instance by name keyword fuzzy matching.
3. Click the instance ID or Manage, select Data Flow > Data Settlement.
4. In the single task list, select the target task, or filter the target task by conditional filtering, click Details to view the task details.
Replicating Data Settlement One-Time Task
Prerequisites
Operation Steps
2. Select a region, select the target GooseFSx instance. You can quickly find the target instance by Availability Zone, Status, Type, or perform a keyword fuzzy matching search by name.
3. Click the instance ID or Manage, select Data Flow > Data Settlement.
4. In the single task list, select the target task, or filter the target task by conditions, click Copy Task to perform.
5. In the pop-up dialog box, you can modify the copied task.
Creating a Data Settlement Periodic Task
Periodic task, automatically triggered to execute periodically, such as settling data from GooseFSx to COS every 1-hour interval, suitable for syncing data to COS promptly in other scenarios.
In the periodic task list, you can see created periodic tasks and perform management operations such as add/delete/query.
Settlement tasks triggered by periodic tasks will appear in the one-time task list, all named after the periodic task name and distinguished by task ID.
Prerequisites
Operation Steps
2. Select the region and target GooseFSx instance. You can quickly find the target instance by Availability Zone, Status, Type, or perform a keyword fuzzy matching search by name.
3. Click the instance ID or Manage, select Data Flow > Data Settlement.
4. Under the periodic task tab, click Create Periodic Task. In the pop-up dialog box, configure as follows:
Task Name: Enter an easy-to-identify name.
Trigger cycle:
per hour: execute once per interval of one hour.
per day: execute once per interval of one day.
Weekly: Execute once every other week.
per month: execute once per interval of one month.
GooseFSx directory: Select from directories that have established data flow rules with COS. Go to the instance details page to create.
Target path: Specify the directory path for settlement, such as a GooseFSx directory or a certain subdirectory under the GooseFSx directory.
Task type:
Data settlement: Settle specified data in a GooseFSx directory to a COS storage bucket. Suitable for storing a piece of data in COS or distributing via the Internet, among other scenarios.
Data settlement and delete local data: Settle specified data in a GooseFSx directory to a COS storage bucket and delete the specified data in the GooseFSx directory. Suitable for data cooling and other scenarios.
Data settlement and elimination of local data while retaining metadata: settle specified data in the GooseFSx directory to a COS storage bucket, eliminate specified data in the GooseFSx directory, and retain metadata. Suitable for scenarios such as building a global namespace with GooseFSx.
5. Click OK.
Note:
If the data flow mode of the GooseFSx directory is Lazy-load (auto mode L), the task type does not currently support data settlement or deleting local data.
Note: If the data flow mode of the GooseFSx directory is manual mode, the task type does not support data settlement, and local data is eliminated while metadata is reserved.