从互联网到 AI：云产业的重构和演进-贾扬清.pdf

1、What does AImean for CloudYangqing Jia/Lepton AIHow hard is it to build AI apps?https:/elmo.chat/1AI isthe 3rd pillar in IT Strategy.Image source:xkcdThe growth of AI,statistically shownThe growth of AI,statistically shownHuge number of Supply&Demand Huge number of Supply&Demand Huge growth of model

2、sAug 2022Sep 2023HuggingFace#of modelsMore“non-AI”developers using AI334k65k2Enterprises gobeyond simpleAPI calls.Image source:xkcdWhats your most used search engine?Whats your most used search engine?Enterprises need Specialized models Enterprises need Specialized models Is it expensive to own my o

3、wn LLM?Is it expensive to own my own LLM?Or,should I opt to use APIs?Or,should I opt to use APIs?Strategy Related:Privacy and security-can I send my data to APIs?Customization:is there even an API for my custom model?Price:LLaMA2-7B costs$0.1-$0.3/million token in common APIs.A10 GPU costs$0.6/hour,

4、at 2,500 tokens/s peak.$0.6 dedicated=9 million/h=$0.9-$2.7 API calls.New small modelsNew small modelswork awesomely!work awesomely!AGIAIGCLLM3What doesthis mean forcloud infra?-Professor Richard Sutton,“The Bitter Lesson”-Professor Richard Sutton,“The Bitter Lesson”“The biggest lesson that can be r

5、ead from 70 years of AI research is that general methods that leverage computation are ultimately the most effective,and by a large margin.”Cloud value proposition no longer holdsCloud value proposition no longer holdsSUPPLY CHAINSOFTWAREBut is it“JBOG”-just a bunch of GPUs?But is it“JBOG”-just a bunch of GPUs?In the AI eraYou need inframore thanever before?infolepton.ai