流式处理与治理的结合：使用 Confluent Tableflow 和 Unity Catalog 构建 AI 就绪表.pdf

1、Streaming Meets GovernanceBuilding AI-Ready Tables With Confluent Tableflow and Unity CatalogVictoria Bukta(Databricks)Kasun Indrasiri(Confluent)Who Are We?Lakeflow Connect PMPreviously a PM at Tabular6 Years at Shopify in EngPM for Confluent Tableflow.Previously lead Product Management of Azure Eve

2、nt Hubs Microsoft.Victoria BuktaMember of Product Staff/DatabricksKasun IndrasiriSenior Product Manager/Confluent3Agenda4Your Data EstateLakehouse Unifying ArchitectureLooking Beyond The LakehouseOperational and analytical divide Confluent TableflowYour Bridge From Confluent to DatabricksData Intell

3、igence PlatformNow with easier access to your operational data DemoTableflow with Delta tables and Unity Catalog Q&AAgenda5Your Data EstateLakehouse Unifying ArchitectureLooking Beyond The LakehouseOperational and analytical divide Confluent TableflowYour Bridge From Confluent to DatabricksData Inte

4、lligence PlatformNow with easier access to your operational data DemoTableflow with Delta tables and Unity Catalog Q&ADataIntelligencePlatform+Unified data and governanceAI tuned to your businessDataIntelligencePlatformMosaic AIArtificialIntelligenceDatabricks SQLDataWarehousingAI/BIBusinessIntellig

5、enceLakeFlowIngest,ETL,StreamingYour data stored in an open,broadly accessible lakehouse formatKnowledge of your dataData LakeData WarehouseGovernanceMachine LearningBIDataScienceGenerativeAIIts a complexity nightmare of high costsand proprietary formatsStreamingOrchestration and ETLAnalytical estat

6、e is fragmentedDelta LakeParquetIcebergTablesAI ModelsFunctions FilesViewsStreaming AnalyticsBIData ScienceMachine LearningStructured,Semi-Structured and Unstructured DataThe Data Lakehouse Compute of choice Unified Governance Reduce unnecessary costs from multiple copies of data Break free from loc