探索 MLOPS 和 LLMOPS：架构和最佳实践（重复）.pdf

《探索 MLOPS 和 LLMOPS：架构和最佳实践（重复）.pdf》由会员分享，可在线阅读，更多相关《探索 MLOPS 和 LLMOPS：架构和最佳实践（重复）.pdf（45页珍藏版）》请在三个皮匠报告上搜索。

1、2024 Databricks Inc.All rights reservedExploring MLOps Exploring MLOps and LLMOps:and LLMOps:Architectures Architectures and Best and Best PracticesPractices1Arpit Jasapara,Yinxi Zhang,Joseph BradleyArpit Jasapara,Yinxi Zhang,Joseph BradleyDatabricksDatabricks2024 Databricks Inc.All rights reserved2

2、About usAbout usArpit JasaparaArpit JasaparaEngineeringYinxi ZhangYinxi ZhangData ScienceJoseph BradleyJoseph BradleyProduct Specialist2024 Databricks Inc.All rights reservedMLOpsTalk(20 minutes)MLOps Stacks Demo(15 minutes)Q&A(10 minutes)LLMOpsTalk&MosaicAI Agent Framework Demo(35 minutes)Q&A(10 mi

3、nutes)3AgendaAgendaMLOps+LLMOpsMLOps+LLMOps2024 Databricks Inc.All rights reservedWhat is MLOps?Why should I care?Best practicesMLOps on DatabricksUnity CatalogModel ServingMonitoringDatabricks MLOps Stacks MLOps Stacks Demo4MLOpsMLOps2024 Databricks Inc.All rights reservedMLOps is the set of proces

4、ses and automationprocesses and automationfor managing data,code,and modelsmanaging data,code,and modelsto improve performance,stability,and efficiencyperformance,stability,and efficiency of ML systems5What is MLOps?What is MLOps?MLOps=DataOps+DevOps+ModelOpsMLOps=DataOps+DevOps+ModelOpsBig Book of

5、MLOps2024 Databricks Inc.All rights reserved6ModelOpsDataOpsDevOpsUnity CatalogWorkflowsModel ServingLakehouse Monitoring2024 Databricks Inc.All rights reservedMLOps helps you reduce riskTechnical risk-poorly performing models,fragile infrastructureCompliance risk-violating regulatory or corporate p

6、oliciesMLOps improves long-term efficiency through automationStreamline delivery of models to productionCatch errors before they hit productionAvoid slow,manual processes7Why should I care about MLOps?Why should I care about MLOps?2024 Databricks Inc.All rights reserved8Best Practices:Roles and Proc