Skip to main content
Amazon S3 can store synced data as Parquet files. Each sync run writes a Parquet file (or multiple part files) to the specified bucket and prefix.

​
Prerequisites

You need an S3 bucket and an IAM user with s3:PutObject and s3:DeleteObject permissions on the destination bucket/prefix.

​
Connection Setup

1

​
1. Bucket

Enter the S3 bucket name.
2

​
2. Region

Enter the AWS region (e.g. us-east-1).
3

​
3. Prefix

Enter the path prefix for the output files (e.g. syncs/pipeline_123/). Files are named with a part number suffix.
4

​
4. Credentials

Enter the AWS access key ID and secret access key. The IAM user must have s3:PutObject and s3:DeleteObject on the bucket/prefix.

​
Write Behaviour

Each sync run produces one or more Parquet files. The destination does not support append or upsert in the traditional sense; each run creates new files. Use a data lake or query engine (e.g. Athena, DuckDB) to query the files.