打破孤岛：通过 Iceberg 和 Unity Catalog 实现 Databricks-Snowflake 互操作性.pdf

1、Breaking Silos:Enabling Databricks-Snowflake Interoperability With Iceberg and Unity CatalogGeoffrey Freeman Mohit KumarIntrosGeoffrey Freeman is the Director of Data Engineering and Development for the Finance organization at T-Mobile.He has spent his career developing massive online data environme

2、nts,including at GM Cruise and Microsoft Azure.Mohit Kumar is the member of technical staff,architecture for the IT organization at T-Mobile.He has spent his career building&scaling analytical solutions and data science platforms.He is passionate about making data not just accessible,but actionable

3、and excited to share some of that journey with you today.Star Crossed Data Platforms T-Mobile was a marketing company with a technology problem We had 18K systems spread across on-prem and 3 clouds,tried to consolidate,and made progress but still have two giant silosEnterprise Data Today:Powered by

4、Multi-Cloud,Fragmented by DesignMulti-cloud is the norm,not the exception8789%of the Fortune 500 have adopted a multi-cloud strategy(Flexera 2023/2024,HashiCorp 2023)70%of organizations use more than one cloud data platform(Source:IDC,2023)Best of breed=Silo RiskDatabricks:Used by 50%+of Fortune 500

5、 for unified analytics and AI/ML workloadsSnowflake:Adopted by 30%of the Fortune 500 for cloud data warehousing and data sharingBigQuery:Adoption with a broad base of real-time and embedded analytics usersFragmentation is the pricenegative impacts on operationsIncreased cybersecurity risksLack of cr

6、oss-cloud visibilityRising cloud costs and staff burnoutLost value in the gapsOver 90%of enterprises aim to be data-driven,only 32%of enterprise data is currently used for insights(IDC).Governance,integration,and lack of interoperability are key blockers in this gap“Enterprises have embraced the mul