Move your data from HTTP File (REST) with your free account

The HTTP File capture connector in Estuary captures data from files hosted at HTTP endpoints and loads it into Estuary collections. It automatically detects supported file formats and compression methods in most cases, making it useful for ingesting externally hosted datasets, exports, logs, and other file-based data.

• Capture files directly from HTTP or HTTPS URLs
• Supports Avro, CSV, JSON, Protobuf, and W3C Extended Log formats
• Supports ZIP, GZIP, and ZSTD compression
• Automatic file format and compression detection
• Custom parser configuration for formats such as CSV when automatic detection needs to be overridden
• Capture from multiple HTTP URLs within a single capture task using multiple bindings
• Optional username/password authentication and custom HTTP headers for protected endpoints

The HTTP endpoint must support HEAD requests and return a Last-Modified header so the connector can identify changes to the hosted file.