tencent cloud

Elastic MapReduce

  • Release Notes and Announcements
  • Product Introduction
  • Purchase Guide
    • EMR on CVM Billing Instructions
    • EMR on TKE Billing Instructions
    • EMR Serverless HBase Billing Instructions
    • EMR Serverless TCBase Billing Overview
  • Getting Started
  • EMR on CVM Operation Guide
    • Planning Cluster
    • Administrative rights
    • Configuring Cluster
    • Managing Cluster
    • Managing Service
    • Monitoring and Alarms
    • TCInsight
  • EMR on TKE Operation Guide
  • EMR Serverless HBase Operation Guide
  • EMR Serverless TCBase Operation Guide
  • EMR Development Guide
    • Hadoop Development Guide
    • Spark Development Guide
    • Hbase Development Guide
    • Phoenix on Hbase Development Guide
    • Hive Development Guide
    • Presto Development Guide
    • Sqoop Development Guide
    • Hue Development Guide
    • Oozie Development Guide
    • Flume Development Guide
    • Kerberos Development Guide
    • Knox Development Guide
    • Alluxio Development Guide
    • Kylin Development Guide
    • Livy Development Guide
    • Kyuubi Development Guide
    • Zeppelin Development Guide
    • Hudi Development Guide
    • Superset Development Guide
    • Impala Development Guide
    • Druid Development Guide
    • TensorFlow Development Guide
    • Kudu Development Guide
    • Ranger Development Guide
    • Kafka Development Guide
    • StarRocks Development Guide
    • Flink Development Guide
    • JupyterLab Development Guide
    • MLflow Development Guide
  • Practical Tutorial
    • Practice of EMR on CVM Ops
    • Data Migration
    • Practical Tutorial on Custom Scaling
  • API Documentation
    • History
    • Introduction
    • API Category
    • Making API Requests
    • Cluster Resource Management APIs
    • Cluster Services APIs
    • User Management APIs
    • Information Query APIs
    • Scaling APIs
    • Configuration APIs
    • Other APIs
    • Cluster Lifecycle APIs
    • Serverless HBase APIs
    • YARN Resource Scheduling APIs
    • Data Types
    • Error Codes
  • FAQs
    • EMR on CVM
  • Service Level Agreement
  • Contact Us
문서Elastic MapReduceEMR Development GuideAlluxio Development GuideMounting File System to Unified Alluxio File System

Mounting File System to Unified Alluxio File System

Download
포커스 모드
폰트 크기
마지막 업데이트 시간: 2025-01-03 14:56:32

Background

Alluxio provides a unified namespace mechanism that allows other file systems to be mounted to the file system of Alluxio. In addition, it allows upper-layer applications to use the unified namespace to access data scattered across different systems.

Mounting COS

Sample: Mounting a COS bucket to an Alluxio directory
bin/alluxio fs mount --option fs.cos.access.key=<COS_SECRET_ID> \\
--option fs.cos.secret.key=<COS_SECRET_KEY> \\
--option fs.cos.region=<COS_REGION> \\
--option fs.cos.app.id=<COS_APP_ID> \\
/cos cos://<COS_BUCKET>/
Configure the COS information in each --option.
Configuration Item
Description
fs.cos.access.key
The COS secret ID
fs.cos.secret.key
The COS secret key
fs.cos.region
The COS region name, such as ap-beijing
fs.cos.app.id
Your AppID
COS_BUCKET
The COS bucket name without the AppID suffix
This command mounts the COS directory specified by cos://bucket/xxx to the /cos directory in Alluxio.

Mounting HDFS

Sample: Mounting an HDFS directory to an Alluxio directory
`bin/alluxio fs mount /hdfs hdfs://data`
This command mounts the /data directory of HDFS to the /hdfs subdirectory of Alluxio. After the mount is successful, the mounted content can be viewed by running the alluxio fs ls command.

Mounting CHDFS

Sample: Mounting CHDFS to Alluxio through mount
Note
This is supported only for EMR 2.5.0 or later + Alluxio 2.3.0 or later.
alluxio fs mount \\
--option alluxio.underfs.hdfs.configuration=/usr/local/service/hadoop/etc/hadoop/core-site.xml \\
/chdfs ofs://f4modr7kmvw-wMqw.chdfs.ap-chongqing.myqcloud.com

도움말 및 지원

문제 해결에 도움이 되었나요?

피드백