《Liteon 赋能未来:面向 AI GPU 基础架构的可扩展解决方案.pdf》由会员分享,可在线阅读,更多相关《Liteon 赋能未来:面向 AI GPU 基础架构的可扩展解决方案.pdf(16页珍藏版)》请在三个皮匠报告上搜索。
1、LITEON GPU Power SolutionsCI SBU Frank Hung2Agenda NV GPU Roadmap and Power Consumption required LITEON GPU Power Solution for GB200/GB300 LITEON HVDC Solution for MW GPU ApplicationNV GPU Roadmap and Power Consumption required GPU Power Consumption Continues Increasing 202020222024202520262027Nvidi
2、a GPU ArchitectureHopperBlackwellBlackwell Ultra RubinRubin Ultra CPU+GPU SuperchipGH100GH200GB100/GB200GB300VR200VR300GPUH100H200B100/B200B300R200R300GPU Power Consumption(TDP)400W700W1000W1400W1800W3600WSystemNVL88 GPUsNVL72/14472/144 GPUsNVL144144 GPUsNVL576576 GPUsPowering AI a Growing Energy Ch
3、allenge02505007501,00020202122232425262728292030AI serversGeneral purposeserversCoolingOther IT equipmentOther infrastructureGlobal data center electricity consumption,TWhHistoricalProjectedGPU Server Power Architecture Evolution PSU 3.2kW-5.5kWfrom 12V to 50V Power shelf 33kW-72kW 50V Power Rack 50
4、0kW-1MW HVDC:+/-400V or 800VIT RackHVDC OutIn-serverIn-IT-rackSeparate from IT rack2022-202320242025-2026Embedded PowerPower ShelfPower Rack(Power Sidecar)Architectural changePSUs relocated from servers to centralized power shelfKey driverServer power consumption increases driven by AI applicationsA
5、rchitectural changePower moved out of IT rackKey driverNvidias pushing for higher GPU server power wattage demandHopperBlackwellBlackwell ultraRubinRubin ultraLITEON GPU Power Solution for GB200/GB300LITEONs 19”Power Shelf Roadmap Supporting NVIDIA GPU Evolution202420252026GPU ServersPower ShelfTOR
6、switchPower ShelfAI Rack33kW 1RUAC Feed:1 AC WhipDC Output:1 DC Clip5.5kW PSU 6+01 277Vac to 50Vdc97.5%eff.GB20033kW 1RUAC Feed:1 AC WhipDC Output:1 DC Clip5.5kW PSU 6+01 277Vac to 50Vdc97.5%eff.GB30018kW 1OUAC Feed:1 AC WhipDC Output:1 DC Clip3kW PSU 6+01 277Vac to 50Vdc97.5%eff.GH200BeforeAfter(Op