Databricks User Group

Transforming Data at Scale: How we Scaled from Few to Hundreds of Developers mit David Schenk, Lead Data Platform Engineer at Obi

David Schenk is the Lead Platform Engineer within the digital innovation unit of market leading hardware retailer OBI. The unit is responsible for providing the internal data analytics platform. The platform started with a small engineering team but rapidly scaled in size and complexity until data engineering became a bottleneck. It had to be reengineered to scale with the speed and growth of the organization. Today the platform supports hundreds of developers. In this talk you will learn about their journey to a robust and scalable data platform, the challenges they faced, their successes and failures, as well as their ambitious goals for the future.

A Deep Dive into Lakehouse Monitoring mit Ivan Trusov, Sr. Specialist Solution Architect at Databricks

In order to draw reliable conclusions from data it is essential to ensure confidence in its quality and accuracy. Databricks Lakehouse Monitoring addresses this critical need by monitoring statistical properties and data quality across all tables incl. machine learning model inference tables. It provides visual insights, alerts on changes in data distribution or model behavior, and helps identify the underlying root causes. In this talk you will get a deep overview of Lakehouse Monitoring, see practical examples and learn about upcoming developments.