田浩炜--基于Ray的eBay大模型高效微调平台实践.pdf

1、例：支撑海量数据的大数据平台与架构 例：支撑海量数据的大数据平台与架构 例：茹炳晟例：茹炳晟例：腾讯Tech Lead，腾讯研究院特约研究员正文要求：微软雅黑：最小字号 8号 宋体：最小字号 10号 等线：最小字号 12号LLM Fine-Tuning Platform with Ray in LLM Fine-Tuning Platform with Ray in eBayeBayHaowei TianHaowei TianeBayCONTENTS1.Background:Emerging LLM AdoptionsBackground:Emerging LLM Adoptions2.AI

2、Sandbox&Ray OverviewAI Sandbox&Ray Overview3.Athena:LLM Fine tuning as a ServiceAthena:LLM Fine tuning as a Service4.LLM Solution Build&EvaluationLLM Solution Build&Evaluation5.Next StepsNext Steps目目录录Part 1Part 1Background:Emerging LLM AdoptionsBackground:Emerging LLM AdoptionsLLMs A Game Changer i

3、n RetailLLMs A Game Changer in RetailLLMs are reshaping the e-commerce industry.Buying AssistanceProduct DescriptionsPersonalized RecommendationsSeller Velocity.eBay LLM Investment eBay LLM Investment eBays AI investments fuel streamlined experiences for buyers and sellers.Herold,Christian et al.“Li

4、LiuM:eBays Large Language Models for e-commerce.”ArXiv abs/2406.12023(2024):n.pag.Emerging LLM ApplicationsEmerging LLM ApplicationsMarketingText GenerationEmerging LLM ApplicationsEmerging LLM ApplicationsShopping Assistant is actually a Multi-AGENT Bot-Planning-Multi-modal knowledge-ActionAI Assis

5、tantInteraction IntelligenceLLM Introducing Challenges LLM Introducing Challenges Models ComplexityModel SelectionParameter TuningChat TemplatesResources Utilization GPU AllocationGPU UtilizationAlgorithm EfficiencyDevelop VelocityFast ExperimentsEfficient EvaluationProduction DeployPart 2Part 2AI S

6、andbox&Ray OverviewAI Sandbox&Ray OverviewRoadmap to Maximizing LLM PerformanceRoadmap to Maximizing LLM PerformanceLLM optimizationLLM optimizationHow the model need to actContext Context optimizationoptimizationWhat the model need to knowOpenAI:A Survey of Techniques for Maximizing LLM Performance