Launchmetrics Scales Real-time Analytics to the Next Level with Estuary and Databricks
Challenge
- Support for streaming data from MySQL and Postgres to Databricks
- Reliability, and spending too much time monitoring and troubleshooting
Solution
- Streaming from Aurora for MySQL and Postgres to Databricks with Estuary Flow
Results
- Implementation within days
- Enhanced data engineering productivity
- Eliminated the need for constant monitoring and troubleshooting
- Lower cost of ownership, including up to 40% lower Databricks costs
About Launchmetrics
location
New York, NY
INDUSTRY
Fashion, Lifestyle, and Beauty
GOALS
Improve data pipeline reliability and ensure GDPR compliance
Launchmetrics provides more than 1,700 clients with the software, data and insights they need to connect strategy with execution. With over a decade of expertise, its Brand Performance Cloud(SM) helps executives launch campaigns, amplify reach, measure ROI and benchmark brand performance.
Challenge
Launchmetrics chose Databricks as the foundation for all their analytics. Then they started to evaluate various data integration vendors.
While Launchmetrics was looking to replace their previous provider, they evaluated several alternative vendors. Launchmetrics identified diverse criteria to guide its search: product novelty, user feedback, capability to solve issues related to alerting, data duplication, incorrect data types, stopped pipelines, and GDPR compliance.
Estuary ended up supporting most sources, was more reliable, and at a lower cost. One of the most important features ended up being the ability to use real-time change data capture (CDC) with MySQL, Postgres, and other sources, and have the option to batch-load Databricks.
Solution
Launchmetrics is running Estuary Flow, in production, to support its Brand Performance CloudSM analytics and data sharing with customers. Flow streams one Terabyte of data each month from the underlying Aurora for Postgres and MySQL databases to Databricks. They opted to initially load Databricks in batch intervals to minimize expenses, with the flexibility to transition to real-time loading as required.
Launchmetrics had the first source operational within a day and completed the entire migration within a week. Thanks to Estuary’s great support, any problems during the migration were solved very quickly and communication in the Estuary community Slack channel was fluid.
Benefits
- Implementation within days: Everything from source extraction to loading Databricks was done in days, far faster than the other options.
- Lower vendor costs: Not only does Estuary have a lower cost of ownership than competitors, but it cuts Databricks costs up to 40%.
- Enhanced productivity: Since adopting Flow, Launchmetrics has been able to deliver new features much faster and has eliminated the need to spend time on monitoring and troubleshooting.
“We evaluated several vendors and Estuary stood out for its comprehensive source coverage, reliability and lowest total cost. However, what truly won us over was their flexibility and outstanding support. Flow enabled us to integrate real-time data from sources with batch loading into Databricks, with the option to switch to real-time processing later.”
- Pau Montero Parés, CTO at Launchmetrics
The increased productivity and reliability, and the great support from the Estuary team, has enabled Launchmetrics to continue to add more sources and deliver significantly more functionality at a faster pace.
What's next for Launchmetrics?
“With Estuary Flow seamlessly integrating our data and enhancing monitoring and reliability, Launchmetrics is focused on onboarding any remaining sources that require replication, ensuring a consistent and uninterrupted service delivery. Our aim is to have a low-maintenance solution that operates quietly in the background, allowing us to concentrate on high-value data tasks. As we continue to harness AI to augment our operations, our priority is to ensure that our AI systems are fueled by accurate data, thereby driving innovative solutions and strategic insights.”
- Pau Montero Parés, CTO at Launchmetrics
*Launchmetrics is a registered trademark of the Launchmetrics Group.