1、Snapdragon and Qualcomm branded products are products of Qualcomm Technologies,Inc.and/or its subsidiaries.Whats next in on-device generative AIMay 30,2024Joseph SoriagaSr.Director,TechnologyQualcomm Technologies,Inc.Snapdragon and Qualcomm branded products are products of Qualcomm Technologies,Inc.
2、and/or its subsidiaries.2TodaysagendaTrends in generative AI and why on device is keyEfficiency techniques to bring generative AI on deviceAdaptation and personalizationtechniquesToward agents and embodied AI at the edgeQ&A3Robotics with GATrEnable robots to efficiently learn complex dexterous skill
3、s in 3D spacesfrom cameras through use of geometric algebra transformers(GATr)Wireless multimodal fusion in deepSense 6G Understand environments better by combining GPS,camera,and mmWave RF using transformers to improvemmWave beam managementMulti-camera and LIDAR aligned for birds-eye-viewEnable enh
4、anced perception of the world for autonomous vehicles,robots,and more using cross-view attentionTransformers are key and extending to more modalities 4Generative AIcapabilitiescontinue toincreaseMODALITY AND USE CASECAPABILITY AND KPIAgentsExecute multi-step tasks with reasoning autonomously to achi
5、eve a goalVideo&3DGenerating content for a richerand more realistic experienceVoice UIVoice is a natural and intuitiveinterface for conversationLarge multimodal modelsUtilizing more sensinginput modalities to betterunderstand the worldPersonalizationFine-tuned models customized to consumers,enterpri
6、ses,or industries(e.g.,LoRA)Longer context windowAllows in-depth conversationsHigher resolutionProcess higher fidelity imagesfor better accuracyLoRA:low-rank adaptation5To scale,the center of gravity of AI processing is moving to the edgeHybrid AIDistribute workloads among cloud andedge/devices to d