1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.A I M 2 7 2Ankur MehrotraMark AndrewsMaster AI model development with Amazon SageMaker AIHe/himDir
2、ector,AWS AIAmazon Web ServicesHe/himSr.Principal,Product ManagementAmazon Nova 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.THE CHALLENGEIn a world where everyone has access to the same Foundation Models,how do you build a competitive advantage?2025,Amazon Web Services,Inc.or
3、its affiliates.All rights reserved.Intelligence+Context=Competitive advantageGenAI modelYour data+Your preferencesYour competitive advantage=2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Model development mimics the human learning journeyLearning the language of the worldG E N E
4、 R A L W O R L D K N O W L E D G EDeveloping specialized knowledgeS P E C I A L I Z E K N O W L E D G EMastering a specific craftTA S K S P E C I A L I Z AT I O N 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.A models learning journeyH U M A N S TA G EM O D E L S TA G EW H AT T
5、H E M O D E L L E A R N SKindergartenMiddle SchoolHigh SchoolCollegeWorkforce(after graduation)Pre-trainingSupervised Fine-Tuning(SFT)Preference Optimization(DPO)Reasoning and tool use(RL)Inference and LoRA adaptationLearns language,grammar,and world factsLearns to stay on topic,follow instructions,
6、and produce structured explanationsLearns judgment,clarity,and alignment with human preferencesDevelops step-by-step reasoning and tool integrationThe model applies everything it has learned in real-world tasks.LoRA/PEFT act as“continuing education,”letting it learn new tasks,languages,or domains wi