生成式人工智能时代LLM的AI计算设计趋势.pdf

1、AI Computing Design Trends for LLMs in the Generative AI EraBor-Sung LiangMediaTekAI ClustersAI Computing Design Trends for LLMs in the Generative AI EraBor-Sung LiangSenior Director,MediaTekEvolution of LLM(Large Language Model)Phase 1Training ComputePhase 2Test-Time ComputeSmall LLM to Democratizi

2、ng AIPhase 3Agentic AI(Agentic Swarm)AI-based EcosystemFocus on TrainingFocus on InferenceBeyond single LLM3Bor-Sung Liang,MediaTekLLMAgentic Architecture AgentMemoryShort-term MemoryLong-term MemoryPlanningReflectionChain-of-ThoughtSub-goal decompositionSelf-CriticsToolsCalculator()Code Interpreter

3、s()Search()Calendar()Database()ActionInternetControlPurchase/FinanceActuator4Bor-Sung Liang,MediaTekAgentic Swarm AgentMemoryShort-term MemoryLong-term MemoryPlanningReflectionChain-of-ThoughtSub-goal decompositionSelf-CriticsToolsCalculator()Code Interpreters()Search()Calendar()Database()ActionInte

4、rnetControlPurchase/FinanceActuatorREF:Sequoia CapitalAgents in Agentic Swarm Orchestration for Specific Functions Rigorous Testing and Evaluations Fine-Tuned for End-to-End ServicesKey Factors for Agentic Swarm Seamless Communication Protocol Secure Trust Persistent Identity for AI AgentsAgentic Ec

5、onomy TravelAgencyAirline CompanyHotelsLocalTouristServiceLocal Guide5Bor-Sung Liang,MediaTekBor-Sung Liang,Keynote(Plenary),IEEE ISCAS(International Symposium on Circuits and Systems),London,UK,May 27,2025Agentic AI on Edge DeviceUserPrivacy infoPerferenceUserAuthorization“Agentic AI on Edge Device

6、”to connect Users with Agentic Swarm User Authorization Coordinator and Interface to Activate Agentic Swarm Keep Users Private Information and Preferences Get Users Surrounding Information(Camera,Mic,Sensors)and Status(Calendar,.)Orchestrator Interface to Activate Agentic Swarm6Bor-Sung Liang,MediaT