使用开源 AI 进行构建：速成课程.pdf

1、A Crash Course:World Summit AIBuilding with Open Source AICedric ClyburnSenior Developer AdvocateRed Hat AI BUcedricclyburn1Legare KerrisonDeveloper AdvocateRed Hat AI BUlegarekerrisonopen sourcecloud computingand automationartificial intelligence and machine learningJan 2023:The ProblemFor 2023 and

2、 the start of 2024,closed dramatically outpaced open.Slide from Neural Magic Board Meeting in March 2023 The Power of OpenThere has been an explosion of capability from open-source over the last 2 years.Llama No OSS modelsZephyrLlama 2Mistral,Granite 2DeepSeek-R1Mixtral,Phi-2Jan 2023RedPajama,MPT,Fa

3、lconMar 2023May 2023July 2023Sept 2023Nov 2023Jan2024July2024Sept 2024Nov 2024Gemma2,NemotronJan 2025DBRX,Granite 3Qwen2-VLPhi-3,ArcticDBRX,Phi-3Llama 3,Qwen2Mar2024May2024The Power of OpenOpen models are deployment targets today.And the trend is not slowing down.650M downloads in 202485,000 Llama d

4、erivative models1B,3B,8B,70B,405B variantsMultilingual,Multimodal,MobileFirst reasoning model on par in quality with OpenAI O11-70B parameter distilled versionsGlobal market pandemonium?LlamaR1HeadlinesModels are commoditizing many options for diverse enterprise needs.Self managed infrastructure1B-4

5、05B size-match task difficulty to model CostComplete data privacy(no 3rd party APIs)SecurityModel lifecycle(no changes to the model in place)Resources(no rate limits/API downtime)ControlImprove accuracy and costs with task specific tuningCustomizationAdvantages of Open Source ModelsOpen-source model

6、s play an important role in the Enterprise AI landscape.7Open source is about more than developing software.Its how we built Red Hat.And its completely revolutionized the AI ecosystem too.Open source is great driver for InnovationThere are various organizations that define open source,but generallyD