Move your data from Google PubSub with your free account

The Google Cloud Pub/Sub capture connector in Estuary continuously captures JSON messages from Pub/Sub topics into Estuary collections. During setup, Estuary discovers the topics available in your Google Cloud project, and each enabled topic is mapped to a collection through its own Pub/Sub subscription.

• Real-time message capture from Google Cloud Pub/Sub topics
• Automatic topic discovery for topics accessible to the configured service account
• Automatic subscription creation for each enabled Pub/Sub topic
• Durable message processing, with messages acknowledged only after they are committed to an Estuary collection
• JSON message support for capturing structured event and streaming data
• Google Cloud service account authentication for secure access to Pub/Sub resources

The connector uses Pub/Sub subscriptions configured for exactly-once delivery, but capture should still be treated as at-least-once because a message can occasionally be captured more than once if the connector restarts after committing it but before acknowledging it to Pub/Sub. Standard Estuary materializations automatically deduplicate these documents based on document ID.