Create a Webhook-to-Snowflake Data Pipeline
Create a complete data pipeline in 3 minutes that captures Square (or any other platform's) webhooks and materializes to Snowflake. With Estuary, you can create endpoints to receive webhook data without setting up and maintaining your own server. Try it out for free at → https://dashboard.estuary.dev/register
Ready for more?
- See our site: https://estuary.dev/
- Learn more about webhooks: https://estuary.dev/blog/webhook-setup/
- Read our webhook capture docs: https://docs.estuary.dev/reference/Connectors/capture-connectors/http-ingest/
- Or our Snowflake materialization docs: https://docs.estuary.dev/reference/Connectors/materialization-connectors/Snowflake/
0:00 Intro
0:19 Set up webhook capture
1:17 Configure webhook in Square
2:06 Create Snowflake materialization
2:48 Outro
More videos

Save Webhook Data to Databricks in Real Time
Learn how to stream incoming webhook data to Databricks without setting up and maintaining your own server for webhook captures. Follow along with our 3-minute demo and try out Estuary for free → https://dashboard.estuary.dev/register Learn more from our: - Website: https://estuary.dev/ - Webhook capture docs: https://docs.estuary.dev/reference/Connectors/capture-connectors/http-ingest/ - Databricks materialization docs: https://docs.estuary.dev/reference/Connectors/materialization-connectors/databricks/ - Blog article on webhook setup: https://estuary.dev/blog/webhook-setup/ 0:00 Intro 0:19 Set up webhook capture 1:19 Configure webhook in Square 2:08 Create Databricks materialization 2:43 Outro

How CDC Works in Estuary: Source to Destination Explained
Change data capture (CDC) reads every insert, update and delete from your database's log and streams it to your destinations. Here's how Estuary does it, from source to destination. We follow one order placed by Will through an Estuary pipeline: from the moment it's written to a Postgres database, through captures, collections and materializations, to the moment it lands in a warehouse, search index or AI model. You'll learn: - How log-based CDC reads the write-ahead log (WAL) as a second reader, with no extra load on your production database - How the initial snapshot and live WAL streaming run in parallel, so existing rows and new changes both arrive - Why polling-based methods miss deletes, and why log-based CDC doesn't - How schema validation works, and how Estuary adapts to schema changes and pauses only for breaking ones - What collections are: a data lake and a real-time stream at the same time - How collection keys keep a full history of every change - How derivations create new collections with stateless or stateful transformations - How materializations deliver data to each destination at its own speed, from real-time to scheduled batches - How read, reduce, write cycles and reduction strategies work, with last-write-wins as the default - How exactly-once delivery keeps data correct, even if something crashes mid-write This is Episode 1 of our series on how Estuary works under the hood. Chapters 0:00 What happens to data between source and destination? 1:00 What is a capture? 1:49 How log-based CDC reads the write-ahead log (WAL) 2:12 Initial backfill: snapshot and WAL in parallel 2:44 Why polling misses deletes 3:09 JSON documents and schema validation 3:31 How Estuary handles schema changes 4:07 What is a collection? 4:52 Collection keys and change history 5:25 Derivations: stateless and stateful transformations 6:23 What is a materialization? 7:23 Choosing sync speed per destination 7:43 Automatic batching to protect destinations 8:06 Read, reduce, write and reduction strategies 8:36 Exactly-once delivery 9:00 Key takeaways Links Try Estuary free: https://dashboard.estuary.dev/register Estuary docs: https://docs.estuary.dev Schema evolution guide: https://docs.estuary.dev/guides/schema-evolution/ #ChangeDataCapture #CDC #DataEngineering

SQL Server CDC to Snowflake + ClickHouse in Real Time (Fan-Out Demo)
See how to capture SQL Server change data once and fan it out to Snowflake, ClickHouse, and other destinations without creating duplicate source pipelines. In this DBTA roundtable webinar, Estuary demonstrates a capture-once, fan-out architecture using change data capture (CDC). The demo starts with an existing SQL Server to Snowflake pipeline for scheduled BI workloads, then adds ClickHouse as a real-time destination using the same captured collections—without re-reading the SQL Server source. You’ll see how Estuary handles durable collections, batch vs. real-time sync schedules, backfills, schema mapping, merge vs. delta updates, and exactly-once delivery. ⏱️ Chapters 0:00 Introduction 2:08 Capture once, fan out architecture 2:53 Why multiple destinations add complexity 3:44 How the fan-out pattern works 6:40 SQL Server to Snowflake demo 8:37 Sources, collections & destinations 10:11 Inspecting CDC records 13:59 Snowflake pipeline 15:39 Adding ClickHouse for real-time workloads 18:16 ClickHouse ingestion options 18:53 Configuring the ClickHouse connector 20:38 Real-time vs. batch sync 25:14 Publishing & initial backfill 28:59 Real-time data in ClickHouse 30:27 Fan-out architecture complete 31:09 More destinations & migration use cases 32:29 Q&A: transforms, latency & deduplication 🔑 What you'll learn * How to capture CDC data once and serve multiple destinations * How Snowflake and ClickHouse can consume the same data at different frequencies * How to add destinations without re-reading the source database * How Estuary handles backfills, CDC updates, and exactly-once delivery 🔗 Try Estuary free: https://dashboard.estuary.dev/register 📚 Docs: https://docs.estuary.dev #ChangeDataCapture #ClickHouse #Snowflake #DataEngineering #RealTimeData

Right-time Data Integration for Snowflake
Hosted by: Dani & Ben Rogojan (Seattle Data Guy) Choosing the right ingestion strategy for Snowflake can dramatically influence your latency, cost, and operational overhead. In this live 1-hour session, Dani and Ben Rogojan will break down the modern ingestion landscape and help you understand when batch, micro-batch, serverless, or real-time streaming pipelines make the most sense. This webinar is designed for data engineers, architects, and Snowflake users who want a clearer framework for making ingestion decisions, without the guesswork.

Estuary 101: How To Build Right-Time Data Pipelines
Join hosts Dani and Zulf for a fast-paced walkthrough of how to design and ship right-time data pipelines with Estuary. In this session, you’ll get: - Context: What “right-time” really means, where Estuary fits among batch vs. streaming and managed vs. self-hosted options, and why unified ingestion reduces cost and complexity. - Live End-to-End Demo: Connect CDC sources, apply declarative transformations, and materialize data simultaneously into a warehouse, analytical engines, and object storage—plus a look at observability, error recovery, and real-world scenarios like schema drift and backfills. - Live Q&A: Ask about your specific stack, pipeline designs, and how to scale Estuary for enterprise workloads. Perfect for data and analytics engineers, architects, and platform owners who want fresher data with fewer moving parts.

How to Stream Data into Snowflake
Ingest data into a Snowflake warehouse using real-time Snowpipe Streaming or using batch COPY INTO commands. Estuary makes Snowflake integration simple with pre-built no-code connectors. Following along? Find the copy/pasteable commands in Estuary’s Snowflake docs: https://docs.estuary.dev/reference/Connectors/materialization-connectors/Snowflake/ - Set up your first data pipeline for free at Estuary: https://dashboard.estuary.dev/register/?utm_source=youtube&utm_medium=social&utm_campaign=snowflake_ingestion - Learn more about Estuary’s Snowflake capabilities: https://estuary.dev/solutions/technology/real-time-snowflake-streaming/ - Read the complete guide to Snowpipe Streaming: https://estuary.dev/blog/snowpipe-streaming-fast-snowflake-ingestion/ - Discover how Snowflake fared in Estuary’s Data Warehouse Benchmark: https://estuary.dev/data-warehouse-benchmark-report/ - Download Snowflake Ingestion Playbook: https://estuary.dev/snowflake-ingestion-whitepaper/ FAQ 1. What is the fastest way to load data into Snowflake? Snowpipe Streaming with row-based ingestion. In Estuary, you can enable it per table using Delta Updates. 2. Why use key pair authentication for Snowflake? It provides strong security, short-lived tokens, and is Snowflake’s recommended approach for service integrations like Estuary. 3. Can I mix real-time and batch ingestion in the same pipeline? Yes. With Estuary’s Snowflake connector, you can run some tables in batch (COPY INTO or Snowpipe) and others in real time with Snowpipe Streaming. Media resources used in this video are from Pexels, Canva, and the YouTube Studio Audio Library. 0:00 Introduction 1:05 Snowflake concerns 1:51 Ingestion options 3:23 Beginning the demo 3:47 Create Snowflake resources 4:28 User auth setup 5:17 Estuary connector config 6:44 Customization options 8:07 Wrapping up

What’s Next for Data Warehouses? Lessons from Our Benchmark and Emerging Trends
Dani and Ben talks about key findings on performance ceilings, cost traps, and failure modes, and explore the major trends reshaping data warehouse architecture, including: - Separation of Compute & Storage – How Snowflake Gen2, Databricks serverless, and open table formats like Iceberg are changing the game. - Lakehouse Reality Check: What’s working for teams adopting Iceberg, schema evolution patterns, and lake-native pipelines. - Flexibility Over Centralization: Moving beyond “one warehouse to rule them all.

Oracle CDC Setup Tutorial: Stream Oracle Data in Real Time with Estuary
Learn how to set up **Oracle Change Data Capture (CDC)** with Estuary and continuously capture changes from an Oracle Database using **Oracle LogMiner**. In this tutorial, we use a Docker-based Oracle instance to walk through the CDC setup from start to finish. You’ll see how to configure archive logging, set up the required permissions and supplemental logging, configure archive-log retention, and connect Oracle to Estuary. Once your Oracle data is captured, you can use it for real-time replication and data pipelines to destinations such as **Snowflake, BigQuery, ClickHouse, PostgreSQL, Databricks, Amazon Redshift, Kafka, and more**. ### What you'll learn - How Oracle Change Data Capture works with LogMiner - How Oracle redo logs and archive logs are used for CDC - How to enable archive logging and supplemental logging - How to configure permissions for the Estuary Oracle user - How archive-log retention affects CDC recovery - How Oracle container databases (CDB/PDB) affect setup - How to connect Oracle to Estuary - How to discover tables and start capturing changes This setup can be used as the foundation for pipelines such as **Oracle to Snowflake CDC, Oracle to BigQuery replication, Oracle to ClickHouse, Oracle to PostgreSQL, and other Oracle data integration workflows**. ### Follow along Example Oracle CDC project: https://github.com/estuary/examples/tree/main/oracle-capture Try Estuary for free: https://dashboard.estuary.dev/register/?utm_source=youtube&utm_medium=social&utm_campaign=oracle_capture Oracle connector documentation, including setup instructions for non-container databases: https://docs.estuary.dev/reference/Connectors/capture-connectors/OracleDB/ Explore Oracle integrations: https://estuary.dev/source/oracle/ Have questions? Join the Estuary Slack community: https://go.estuary.dev/slack ### Chapters 0:00 Introduction 0:40 Oracle & CDC 2:30 Demo: Project overview 5:42 Demo: Run container 7:22 Demo: Estuary setup 8:50 Wrapping up Media resources used in this video are from Pexels, Canva, and the YouTube Studio Audio Library. #OracleCDC #OracleDatabase #ChangeDataCapture #DataEngineering #Estuary

Estuary | The Right Time Data Platform
Welcome to Estuary, the Right Time Data Platform built for modern data teams. With Estuary, you can move and transform data between hundreds of systems at sub second latency or in batch, depending on your business needs. • Capture data from source systems using pre built, no code connectors. • Automatically infer schemas and manage both real time and historical events in collections. • Materialize your data to any destination with ease and flexibility. • Choose your deployment model: fully SaaS, Bring Your Own Cloud, or private deployment with enterprise level security. Start streaming an ocean of data and get going today: 🌊 https://dashboard.estuary.dev/register/?utm_source=youtube&utm_medium=social&utm_campaign=overview_video Learn more: 🌐 On our site: https://www.estuary.dev/?utm_source=youtube&utm_medium=social&utm_campaign=flow_overview 📚 In our docs: https://docs.estuary.dev/?utm_source=youtube&utm_medium=social&utm_campaign=flow_overview Connect with us: 💬 On Slack: https://go.estuary.dev/slack 🧑💻 In GitHub: https://github.com/estuary ℹ️ On LinkedIn: https://www.linkedin.com/company/estuary-tech/ #righttimedata #datapipelines #streamingdata #realtimeanalytics #CDC #dataengineering #Estuary

Unify Your Data in Microsoft Fabric with Estuary
Want to get your data into Microsoft Fabric—fast and without writing code? Discover what unified data can do with a Microsoft Fabric integration. We’ll cover what makes this relatively new data platform unique and how you can enhance its capabilities further using Estuary. A step-by-step demo walks through Fabric warehouse connector setup in Estuary so you can get your data flowing. Interested in more? - Register for a free Estuary account: https://dashboard.estuary.dev/register - Learn more about Microsoft Fabric: https://estuary.dev/blog/what-is-microsoft-fabric/ - Find source connectors to go with your Fabric destination: https://docs.estuary.dev/reference/Connectors/capture-connectors/ - Join us on Slack: https://go.estuary.dev/slack Media resources used in this video are from Pexels and the YouTube Studio Audio Library. 0:00 Introduction 0:26 Microsoft Fabric 1:33 Covering gaps with Estuary 2:33 Beginning connector creation 3:23 Creating a warehouse 3:59 Configuring a service principal 5:59 Creating a storage account 6:55 Wrapping up the connector 7:33 Outro

Real-time Data Products with Estuary - Ad Performance
In this detailed demo, Dani shows you how to build a real-time data product using Estuary. Learn how to capture and process data from a PostgreSQL database using Change Data Capture (CDC) and stream it into Snowflake for real-time ad performance calculations. This tutorial covers how to join and transform data using Estuary’s derivations and materialize the final output into Snowflake. Follow along as we work with ad clicks and impressions to perform transformations in real-time! 00:00 - Introduction: Real-Time Data Product with Postgres and Snowflake 01:30 - Setting Up Postgres CDC with Estuary 04:45 - Defining Derivations for Real-Time Transformations 09:45 - Materializing Data into Snowflake 12:03 - Real-Time Ad Performance Calculation in Snowflake 12:46 - Conclusion: Wrap-up and Further Resources

PostgreSQL to Iceberg - Streaming Lakehouse Foundations
Stream Real-Time Data from Postgres to Iceberg with Change Data Capture and Estuary. In this step-by-step tutorial, we demonstrate how to set up and stream real-time data from a PostgreSQL database into Iceberg tables using change data capture (CDC) with Estuary. Learn how to capture, ingest, and materialize data using Estuary's seamless integration. This demo uses a sales database to showcase how changes in a PostgreSQL table are tracked and replicated into an Iceberg table stored in AWS S3. Check out Estuary's Iceberg integration: https://estuary.dev/destination/s3-iceberg/ Join Estuary's community Slack: https://estuary-dev.slack.com/join/shared_invite/zt-86nal6yr-VPbv~YfZE9Q~6Zl~gmZdFQ#/shared-invite/email 00:00 - Introduction: Streaming Data from Postgres to Iceberg 00:18 - Postgres Sales Database Overview 01:08 - Starting Change Data Capture (CDC) with Estuary 02:09 - Materializing Data into Apache Iceberg 04:17 - Backfilling Data into Iceberg 05:21 - Querying Iceberg Tables with Python 06:10 - Conclusion: Demo Recap

Seamless Data Integration, Unlimited Potential
Discover the simplest way to connect and move your data.Get hands-on for free, or schedule a demo to see the possibilities for your team.










