1、ASSESSING THE ON-DEVICE ARTIFICIAL INTELLIGENCE(AI)OPPORTUNITY FOR ENTERPRISES AND CONSUMERSINTRODUCTIONThe Artificial Intelligence(AI)market continues to develop rapidly,spurred by the accessibility of generative AI,which has expanded opportunities for enterprise and consumer deployments.Until now,

2、generative,and other AI models have been mostly deployed in the cloud,but as AI becomes more accessible and the market looks to scale across use cases,this cloud-centric framework presents significant commercial and technical challenges.On-device AI capabili-tiesand eventually hybrid AIin which infe

3、rencing workloads for large complex models are performed locally,are emerging to better support the case for deploying AI at scale.This white-paper explores the opportunity of on-device AI for enterprises and consumers,and the role that“productive AI”applications will play in building a strong Retur

4、n on Investment(ROI)-based value proposition for end users.KEY TAKEAWAYS Moving inference workloads to the device will help enterprises and consumers unlock AI at scale by solving foundational commercial and technical challenges like data privacy,network and server latency,and networking and cloud i

5、nfrastructure sub-scriptions and/or costs,while enabling users to enjoy a variety of generative AI applications tailored to their personal needs.However,on-device generative AI will bring potential chal-lenges around workload management,power consumption,and memory burden,which will require Neural P

6、rocessing Units(NPUs)and model shrinking already happening today.TABLE OF CONTENTSINTRODUCTION.1KEY TAKEAWAYS.1STATE OF ARTIFICIAL INTELLIGENCE.2OVERVIEW.2IMPACTFUL TRENDS.3BUILDING THE CASE FOR ON-DEVICE AI.4CONSUMER MARKET.4ENTERPRISE MARKET.5KEY CHALLENGES.6ON-DEVICE GENERATIVE AI BY DEVICE TYPE.