利用 Databricks 和 AMD 为生成式 AI 提供支持.pdf

1、2024 Databricks Inc.All rights reserved1Empowering Generative AI with Databricks and AMDKeith Anderson&Avinash SooriyarachchiKeith Anderson&Avinash SooriyarachchiMay 2024May 20242024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved2Speaker InfoSpeaker Info2Keith AndersonAvin

2、ash SooriyarachchiSenior Member of Technical StaffSenior Solutions Architect2024 Databricks Inc.All rights reservedAMD GPU Hardware&SoftwareAMD GPU Hardware&Software AMD GPU HW&SW pre-training large AI models w/existing frameworks Flexible on-prem or GPU cloud pre-training for public/private dataset

3、s Scaling past single host workloads using RDMA&AMD GPUsDatabricks Model Management&Production DeploymentDatabricks Model Management&Production Deployment AI model sharing with Databricks Fine-tuning and model inference on Databricks Better governance,privacy,and cost-effectiveness w/AMD&Databricks3

4、AMD+DATABRICKS FOR GENERATIVE AIAMD+DATABRICKS FOR GENERATIVE AISession summarySession summary2024 Databricks Inc.All rights reserved4TRAINING A GENERATIVE AI MODELTRAINING A GENERATIVE AI MODELPrePre-train model on train model on AMD GPU clusterAMD GPU clusterModel weights saved Model weights saved

5、 to checkpoint fileto checkpoint fileMove model file to Move model file to Databricks workspaceDatabricks workspaceFineFine-tune model on tune model on DatabricksDatabricksFineFine-tuned model tuned model weights saved to fileweights saved to fileModel inference on Model inference on DatabricksDatab

6、ricksHigh level endHigh level end-toto-end workflowend workflow1 16 62 23 34 45 56 62024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved5MODEL PREMODEL PRE-TRAINING ON AMDTRAINING ON AMD2024 Databricks Inc.All rights reservedINSTINCT ACCELERATORSROCMECOSYSTEMINSTINCT ACCELE