Stream Real‑Time Data to Databricks with Estuary
Learn how to stream real-time data from PostgreSQL into Databricks using Estuary — no code, no maintenance.
In this demo, Dani walks through:
• Setting up a Databricks SQL Warehouse and generating a personal access token
• Capturing the users and transactions tables from PostgreSQL in Estuary
• Materializing those tables directly into Databricks using the built-in connector
• Monitoring live data replication and verifying the results in Databricks SQL Warehouse
Highlights of Estuary:
• Real-time change data capture with millisecond latency
• Native support for Databricks Unity Catalog and Delta Lake
• Zero-code pipeline setup with automatic backfill and continuous sync
Why it matters
Streaming live data into Databricks unlocks fresh analytics, real‑time dashboards, and feeding ML models with up‑to‑date data — all without complex ETL or scripting
🔗 Learn more & get started:
• Official Estuary Flow guide: https://estuary.dev/real-time-fraud-detection-databricks/
• https://estuary.dev/blog/load-data-into-databricks/
• Start building for free at: https://dashboard.estuary.dev/register
If you have questions or need help, jump into our community Slack or check the docs.
#databrickstutorial #databricks
00:00 - Introduction
00:49 - Materializing Data to Databricks
01:45 - Verifying Data in Databricks
02:04 - Conclusion
More videos
Estuary | The Right Time Data Platform
Welcome to Estuary, the Right Time Data Platform built for modern data teams. With Estuary, you can move and transform data between hundreds of systems at sub second latency or in batch, depending on your business needs. • Capture data from source systems using pre built, no code connectors. • Automatically infer schemas and manage both real time and historical events in collections. • Materialize your data to any destination with ease and flexibility. • Choose your deployment model: fully SaaS, Bring Your Own Cloud, or private deployment with enterprise level security. Start streaming an ocean of data and get going today: 🌊 https://dashboard.estuary.dev/register/?utm_source=youtube&utm_medium=social&utm_campaign=overview_video Learn more: 🌐 On our site: https://www.estuary.dev/?utm_source=youtube&utm_medium=social&utm_campaign=flow_overview 📚 In our docs: https://docs.estuary.dev/?utm_source=youtube&utm_medium=social&utm_campaign=flow_overview Connect with us: 💬 On Slack: https://go.estuary.dev/slack 🧑💻 In GitHub: https://github.com/estuary ℹ️ On LinkedIn: https://www.linkedin.com/company/estuary-tech/ #righttimedata #datapipelines #streamingdata #realtimeanalytics #CDC #dataengineering #Estuary
What’s Next for Data Warehouses? Lessons from Our Benchmark and Emerging Trends
Dani and Ben talks about key findings on performance ceilings, cost traps, and failure modes, and explore the major trends reshaping data warehouse architecture, including: - Separation of Compute & Storage – How Snowflake Gen2, Databricks serverless, and open table formats like Iceberg are changing the game. - Lakehouse Reality Check: What’s working for teams adopting Iceberg, schema evolution patterns, and lake-native pipelines. - Flexibility Over Centralization: Moving beyond “one warehouse to rule them all.
Save Webhook Data to Databricks in Real Time
Learn how to stream incoming webhook data to Databricks without setting up and maintaining your own server for webhook captures. Follow along with our 3-minute demo and try out Estuary Flow for free → https://dashboard.estuary.dev/register Learn more from our: - Website: https://estuary.dev/ - Webhook capture docs: https://docs.estuary.dev/reference/Connectors/capture-connectors/http-ingest/ - Databricks materialization docs: https://docs.estuary.dev/reference/Connectors/materialization-connectors/databricks/ - Blog article on webhook setup: https://estuary.dev/blog/webhook-setup/ 0:00 Intro 0:19 Set up webhook capture 1:19 Configure webhook in Square 2:08 Create Databricks materialization 2:43 Outro
Seamless Data Integration, Unlimited Potential
Discover the simplest way to connect and move your data.
Get hands-on for free, or schedule a demo to see the possibilities for your team.