File System URL Schemes
The C3 AI File System represents a URL as a FileUrl. A FileUrl is an implementation of a URL that is valid in the local and cloud storage of the C3 AI File System.
The example FileUrl gcs://datasets/WindTurbine_1000assets/inbox/ has three parts:
gcs://: Schemedatasets/: MountWindTurbine_1000assets/inbox/: Relative path
You can use mounts to point to a directory that contains files or connect to remote file systems. To learn more about C3 AI File System mounts, see Work With File Systems.
About file system URL schemes
The FileUrl scheme is the string that identifies the kind of file system and the protocol that accesses and manages its files. For example, the c3fs:// scheme is for the C3 AI File System and the s3:// scheme is for Amazon S3.
See the FileSystemConfig Type for valid schemes in the C3 Agentic AI Platform.
The following table describes each scheme, its corresponding file system, and when to use it:
| File System Scheme | Corresponding File System | When to Use |
|---|---|---|
c3fs | C3 Agentic AI Platform | Locally access and manage files in the root C3 AI directory. |
file | Local File System | Requires C3.ClusterAdmin. Access files on the local machine where the C3 AI server is running to prototype or work with files stored locally on the server. |
s3 | Amazon S3 | Access files from Amazon S3 buckets, which suits scalable cloud storage, especially for large datasets or distributed applications. |
azure | Azure Blob Storage | Interact with Azure Blob containers to store unstructured data such as images, videos, or logs in the cloud. |
gcs | Google Cloud Storage | Manage files in Google Cloud Storage for applications hosted on Google Cloud. |
gdrive | Google Drive | Integrate with Google Drive file storage for applications that integrate with Google Workspace or for personal file sharing. |
hdfs | Hadoop Distributed File System | Use in big data workflows with Hadoop clusters for distributed computing environments, such as Apache Hadoop or Apache Spark. |
http | HTTP | Access files on the Web over HTTP to access publicly available files or APIs that do not require authentication. |
https | HTTPS | Access files on the Web over HTTPS to securely access files or APIs, especially when working with sensitive data. |
tmp | Temporary File System | Create temporary files for short-term storage to process or cache data temporarily. |
msgraph | Microsoft Graph API (OneDrive/SharePoint) | Interact with files in OneDrive or SharePoint using Microsoft Graph API. |
| <!-- | meta | C3 Agentic AI Platform (Package) |
adl | Azure Data Lake | Work with files in Azure Data Lake Storage, which suits big data analytics and processing using Azure services. |
github | GitHub | Access files directly from GitHub repositories for version-controlled file access. |
Configure the default file system
To view the default file system configuration, run the following code in the C3 AI Console:
FileSystem.inst().config();This code returns the configuration of the default file system, including its scheme and its mounts.
To set the default file system connection, see Work With File Systems.