构建从云端到边缘的端到端SLM管道.pdf

1、H M C 3 1 1Developing end-to-end SLM pipelines from the cloud to the edgeGokul ChandraPrincipal Specialist Solutions ArchitectAditya LollaSenior Specialist Solutions ArchitectAgendaIntroduction to AWS Hybrid EdgeAmazon EKS with AWS Hybrid EdgeSmall Language Models and why it matters SLM Pipeline Ove

2、rview Reference Architectures Best Practices for deployment 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Cloud Continuum:AWS wherever you need itREGIONSAWS RegionsAWS European Sovereign Cloud(announced)METRO AREAS&TELCO NETWORKSAmazon CloudFrontAWS Local Zones AWS WavelengthON-

3、PREMISESAWS OutpostsAWS Dedicated Local ZonesAmazon ECS AnywhereAmazon EKS Hybrid NodesFAR EDGEAmazon EKS AnywhereAWS IoTSame infrastructure,services,APIs,and tools for a consistent experience 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Customers want the same experience acros

4、s environmentsSameoperational consistencySame tools for automation,deployments,and security controlsSame services and APIsSame pace of innovation as in the cloudSame reliable,secure,and high-performance infrastructure 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Amazon EKS on A

5、WS Hybrid Edge InfrastructureCustomer Data CenterAWS CloudOutpost connection to parent AZAWS OutpostsWorker node groupKubernetes control planeAmazon EKS management APIs in AWS regionAWS Outposts-EKS Extended Clusters Customer Data CenterAWS CloudAmazon EKS management APIs in AWS regionAWS OutpostsWo

6、rker node groupKubernetes control planeAWS Outposts-EKS Local ClustersAWS Local ZonesAWS RegionWorker node groupKubernetes control planeAmazon EKS management APIs in AWS regionControl PlaneCommunicationAWS Local Zones EKS 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Small Langu