HotChips_AI_Keynote_V1.5_Final.pdf

1、Beyond Compute:Enabling AI Through System IntegrationENIACCalculatorPersonal ComputerCray-1Laptop ComputerDatacentersSmart Phone ComputerConsolesTraining DatacentersTraining ServerIoT ComputerFSD ComputerHuman ComputerAbacusDiff EngineComputing Input DataUseful OutputsProcessingSource:Google ImagesP

2、rojections In 2011Source: Reality+New ProjectionsVol of Data(Zettabytes)0501001502002010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025181147120977964.24133261815.512.596.552Big Data-Data Explosion Corporate Data Type ChangesMore than 80%data is unstructured in nature5,00

3、020102011201220132014201520162017201820192020010,00015,00020,00025,00030,00035,00040,00045,000Structured DataUnstructured DataWorldwide Corporate Data GrowthExabytes80%of Data Growth is UnstructuredNew Types of ProcessingTraditional ProcessingProducts&Profits from Data ProcessingSource:IDCCorporate

4、Data Type ChangesMore than 80%data is unstructured in nature5,00020102011201220132014201520162017201820192020010,00015,00020,00025,00030,00035,00040,00045,000Structured DataUnstructured DataWorldwide Corporate Data GrowthExabytes80%of Data Growth is UnstructuredMachine Learning(ML)/AIAlgorithmic Cod

5、esProducts&Profits from Data ProcessingSource:IDCSoftware 2.0Software 1.0“The history of numerical weather prediction and climate simulation is almost exactly coincident with the history of digital computing itself.”-V.Balaji,Climbing down Charneys ladder:Machine Learning and the post-Dennard era of

6、 computational climate scienceClimate Super-Computing Architectures Over Time 1950 1960 1970 1980 1990 2000 2010 2020 1 101010101010101010102 3 4 5 6 7 8 9 10 History of GFDL Computing Growth of Computational Power with Time IBM 701 IBM 704 IBM 7090 IBM 70301/Stretch CBC 6600 UNIVAC1108IBM 360/91IBM