Skip to main content
The File connector reads from a publicly accessible URL. Use it to sync data from files hosted on HTTPS or S3. Supported formats: CSV, JSON, JSONL, Parquet, and Avro.

Prerequisites

The file must be publicly accessible via HTTPS or S3. For S3, ensure the bucket policy or object ACL allows public read, or use pre-signed URLs if supported.

Connection Setup

1

1. URL

Enter the full URL to the file (e.g. https://example.com/data.csv or an S3 URL). The URL must be accessible without authentication.
2

2. Provider

Select the storage type: HTTPS or S3. For S3, you may need to provide credentials if the file is not public.

Supported File Formats

  • CSV
  • JSON
  • JSONL (newline-delimited JSON)
  • Parquet
  • Avro

Available Streams

A single file typically maps to one stream. The schema is inferred from the file format.

Supported Sync Modes

  • Full sync — Reads the file on every run. Use for files that are replaced entirely (e.g. daily exports).