高通（Qualcomm）：2024端侧生成式AI：全栈优化与应用实践报告（英文版）（29页）.pdf

1、Snapdragon and Qualcomm branded products are products of Qualcomm Technologies,Inc.and/or its subsidiaries.March 28,2024QCOMResearchQCOMResearchtinyAI Forum on Generative AI and Foundation Models on the EdgeSnapdragon and Qualcomm branded products are products of Qualcomm Technologies,Inc.and/or its

2、 subsidiaries.On-Device Generative AIFatih PorikliFatih PorikliSenior Director,TechnologyQualcomm Technologies,Inc.2TodaysagendaWhy on-devicegenerative AIFull-stack AI optimizationsfor large vision models Stable Diffusion Stable Diffusion Full-stack AI optimizationsfor large language models Llama 2L

3、lama 2Q&A23LLM:Large language mode;LVM:Language vision model AIMET is a product of Qualcomm Innovation Center,Inc.Qualcomm AI Research is an initiative of Qualcomm Technologies,Inc.Leading machinelearning researchfor on-device AIacross the entirespectrum of topics Platform Platform researchresearchA

4、ppliedAppliedresearchresearchFundamentalFundamentalresearchresearchAI researchAI researchGenerative AIMulti-task learning&MoESelf-supervised learningReinforcement&Imitation learningEmbodied AIModel quantization,compression,NASHW-SW co-designDistillation of generative modelsPower managementAI Model E

5、fficiencyToolkit(AIMET)Deep learningfor 3D/geometryAudio and videoperceptionAI for wirelessand RF sensingEnergy-efficientperceptionAI forchip designOn-device learningTransformers&attentionGraph and kerneloptimizationFederated learningAI assistant(LLM)Computer vision&perceptionDiffusion based generat

6、ors(LVM)Deep learning for graphics Voice AIFull-stack AI research&optimizationmodel,HW,SW innovation across each layer4OnOn-devicedeviceintelligence is intelligence is paramountparamountProcess data closest to the source,complement the cloudPrivacyReliabilityLow latencyCostEnergyPersonalization5 5Ge