高通：2023年生成式人工智能在边缘（英文版）（37页）.pdf

1、Snapdragon and Qualcomm branded products are products of Qualcomm Technologies,Inc.and/or its subsidiaries.November 8,2023QCOMResearchQCOMResearchSnapdragon and Qualcomm branded products are products of Qualcomm Technologies,Inc.and/or its subsidiaries.Generative AI at the edgeJoseph Joseph SoriagaS

2、oriagaSenior Director,TechnologyQualcomm Technologies,Inc.2TodaysagendaWhy on-devicegenerative AI is keyFull-stack AI optimizationsfor diffusion models Stable Diffusion Stable Diffusion Full-stack AI optimizationsfor large language models Llama 2Llama 2Hybrid AI technologiesand architecturesQ&A23AIM

3、ET is a product of Qualcomm Innovation Center,Inc.Qualcomm AI Research is an initiative of Qualcomm Technologies,Inc.LLM:Large language mode;LVM:Language vision modelLeading machinelearning researchfor on-device AIacross the entirespectrum of topics Platform Platform researchresearchAppliedAppliedre

4、searchresearchFundamentalFundamentalresearchresearchAI researchAI researchGenerative AIG-CNNSelf-supervised learningReinforcement learningCausality and system-2Model quantization,compression,and NASHW-SW co-designDistillation of generative modelsPower managementAI Model EfficiencyToolkit(AIMET)Deep

5、learningfor 3D/geometryAudio and videocompressionAI for wirelessand RF sensingEnergy-efficientperceptionAI forchip designOn-device learningBayesian distributed learningGraph and kerneloptimizationFederated learningDeep learning for graphicsVideo recognition and predictionVirtual AI assistant(LLM)Dif

6、fusion-based image generation(LVM)Voice UI4FullFull-stack stack AI research&AI research&optimizationoptimizationModel,hardware,and softwareinnovation across each layerto accelerate AI applicationsEarly R&D andtechnology inventionsessential to leadingthe ecosystem forwardTransfer tech to commercialte