DATABRICKS 工作流程：实用操作方法和演示（重复）.pdf

1、2024 Databricks Inc.All rights reservedAs the title suggests,this is a demo heavy session.The slides are more for the talktrack,which will be pretty minimal.Will potentially have the intro slides and then will jump into demos.2024 Databricks Inc.All rights reservedDATABRICKS DATABRICKS WORKFLOWS:WOR

2、KFLOWS:PRACTICAL HOWPRACTICAL HOW-TOS TOS AND DEMOSAND DEMOSAuthor NameDateThis information is provided to outline Databricks general product direction and is for informational purposes only.Customers who purchase Databricks services should make their purchase decisions relying solely upon services,

3、features,and functions that are currently available.Unreleased features or functionality described in forward-looking statements are subject to change at Databricks discretion and may not be delivered as planned or at allProduct safe harbor statement2024 Databricks Inc.All rights reserved4Modern dat

4、a engineering requires modern data orchestrationMultiple data sources&triggersMultiple use casesMultiple dependenciesComplex,multi-stage data flowsExtract,transform,loadMachine learning Model trainingBI dashboard refresh“Data pipelines are growing in size,volume,and complexity,with multistage proces

5、sing and dependencies between various data assets.”*Gartner Data Engineering Essentials,Patterns and Best Practices,September 2022Orchestrating processes across all data,analytics and AI use cases is business critical Real-time applications2024 Databricks Inc.All rights reserved5SessionsClicksJoinFe

6、aturizeAggregateAnalyzeTrainOrdersBI&DataWarehousingDataStreamingDataScience&MLData EngineeringLakehouse Platform?There are many ways to orchestrate your Lakehouse workloads2024 Databricks Inc.All rights reserved6Data teams are less productiveHard to use for many practitionersBad data lowers value o