Stream into Amazon S3 CSV with your free account

The Amazon S3 CSV connector exports Flow collection data as compressed CSV files into your S3 bucket, offering a reliable and scalable way to persist real-time updates in an analytics-friendly format.

• Delta-based materialization: Writes only changed records (delta updates) from Flow collections as CSV files, efficiently keeping your data lake up to date.
• Configurable batching: Aggregates changes in Flow and uploads them to S3 at a defined interval, with support for custom file size limits.
• Flexible authentication: Supports both AWS access keys and IAM roles for secure access management.
• Structured file naming: Automatically organizes files with versioned, lexically sortable naming for easy tracking and replay.
• Customizable storage paths: Lets you define prefixes and per-collection paths for better data organization.
• Compatible and extensible: Can also connect to S3-compatible APIs using a custom endpoint if needed.

💡 Tip: Use shorter upload intervals for near-real-time analytics, or increase them to reduce storage and API costs when dealing with large batch updates.