S3 Output Node
The S3 Output node enables you to export dataframes from Visual Notebooks to CSV files in Amazon Web Services (AWS) S3 object storage. This node provides flexible configuration options for file formatting and storage organization.
Prerequisites
Before using the S3 node, you need to create AWS access credentials. Follow these steps to generate the required access key and secret key:
- Log into your AWS account
- Click your account name/number in the top right corner
- Select Security credentials
- Expand the Access keys (access key ID and secret access key) section
- Click Create New Access Key
- Download the key file
- Add the credentials to Visual Notebooks:
- Add an S3 node to your workspace
- Click the gear icon next to Credential
- Click the plus icon to add new credentials
- Enter a name for the credentials
- Enter the access key and secret key from your downloaded file
For more information about AWS credentials, see the AWS documentation.
Configuration
| Field | Description |
|---|---|
| Name | Node name displayed in the workspace Optional - Defaults to S3 |
| Credential | Authentication information for AWS S3 Required Select a saved credential or click the gear icon to manage credentials |
| Bucket | Target S3 bucket Required Must be an existing bucket name See S3 bucket documentation |
| Prefix | S3 storage prefix path Optional - Defaults to / See S3 prefix documentation |
| File | Output CSV filename Optional - Defaults to auto-generated name |
| Delimiter | Value separator character Optional - Defaults to comma (,) Options: comma, pipe, colon, semicolon, tab, space |
| Quote | Character to enclose values Optional - Defaults to single quote (') Delimiters within quotes are treated as text |
| Has Header | Include column names as CSV header Optional - Defaults to enabled |
Node Inputs and Outputs
| Type | Description |
|---|---|
| Input | Visual Notebooks dataframe |
| Output | None - Data is exported to S3 |
Usage Example
- Connect the S3 node to any node that produces a dataframe output
- Configure the node:
- Select your AWS credentials
- Specify the target bucket
- Set the desired file name and options
- Run the node to export your data
While the node doesn't produce a visible output in Visual Notebooks, it successfully exports your data to the specified S3 location.
Figure 1: Configuring the S3 Output node for data export