11.30 Hussam Amrouch - TUM.pdf

1、1by H.Amrouch Thermal Management Expo in Stuttgart E-mail:amrouchtum.deChair of AI Processor Design,Technical University of MunichConfidentialChallenges in the Era of AI Chips and Advance Technologies by Hussam AmrouchChair of AI Processor Design2by H.Amrouch Thermal Management Expo in Stuttgart E-m

2、ail:amrouchtum.deChair of AI Processor Design,Technical University of MunichConfidentialAI:The Next RevolutionComputing demand3.4 months doubling!Source:https:/1e+4Petaflop/s-day1e+21e01e-21e-41e-61e-81e-101e-121e-141960197019802000201020201990Modern Era First Era3by H.Amrouch Thermal Management Exp

3、o in Stuttgart E-mail:amrouchtum.deChair of AI Processor Design,Technical University of MunichConfidentialDeep Learning Breakthroughs in the AccuracyIts possible because Efficient AI ChipsAI Chip:Google TPUv1 ISCA17Complex DNN on one TPUv3:1.8min 2048 GPUs+512 CPUspictures sources:by GDJ,openclipart

4、.org and https:/ H.Amrouch Thermal Management Expo in Stuttgart E-mail:amrouchtum.deChair of AI Processor Design,Technical University of MunichConfidentialIts possible because Efficient AI ChipsBUT.More Efficiency is really Good?5by H.Amrouch Thermal Management Expo in Stuttgart E-mail:amrouchtum.de

5、Chair of AI Processor Design,Technical University of MunichConfidentialLesson from Previous Revolution?src:https:/learnodo- go back to 1865src:WikipediaWilliam JevonsJevons ParadoxWhen technology increases theefficiency,the consumption rises Gain from efficiency will backfire!6Confidentialby H.Amrou

6、ch Thermal Management Expo in Stuttgart E-mail:amrouchtum.deChair of AI Processor Design,Technical University of MunichAI Acceleration and Efficiency ParadoxMore Efficient HW for AI Larger and larger AI models Memory Bottleneck!Significant Efficiency Loss Novel architectures are MUST7by H.Amrouch Th