Databricks 工作流程的新增功能 - 带有现场演示！.pdf

1、2024 Databricks Inc.All rights reservedWhats new inDatabricks Databricks WorkflowsWorkflowsR.R.Fustlin,Product Management,DatabricksJune 12,2024This information is provided to outline Databricks general product direction and is for informational purposes only.Customers who purchase Databricks servic

2、es should make their purchase decisions relying solely upon services,features,and functions that are currently available.Unreleased features or functionality described in forward-looking statements are subject to change at Databricks discretion and may not be delivered as planned or at allProduct sa

3、fe harbor statement2024 Databricks Inc.All rights reserved The Databricks Workflows Story Recent innovations Looking ahead DemoAgenda2024 Databricks Inc.All rights reserved 2015 Cron-based jobs 2016 Notebook workflows 2020 Jobs with multiple tasks Reliability Monitoring 2022 The best lakehouse orche

4、strator Integration with the lakehouse Streaming Cluster reuse 2023 Serverless,performance and ease of use 2024 AI powered ETL2024 Databricks Inc.All rights reservedModern data engineering requires modern data orchestration2024 Databricks Inc.All rights reservedModern data engineering requires moder

5、n data orchestrationMultiple data sources&triggersMultiple use casesMultiple dependenciesComplex,multi-stage data flowsExtract,transform,loadMachine learning Model trainingBI dashboard refresh“Data pipelines are growing in size,volume,and complexity,with multistage processing and dependencies betwee

6、n various data assets.”*Gartner Data Engineering Essentials,Patterns and Best Practices,September 2022Orchestrating processes across all data,analytics and AI use cases is business critical Real-time applications2024 Databricks Inc.All rights reservedBut organizations strugglewith so many toolsof or