监控生成式人工智能工作负载的质量和准确性.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.C O P 4 1 8Monitor the quality and accuracy of your generative AI workloadsRaviteja Sunkavalli(he/him)Senior Solutions Architect,CloudOpsAWSGanesh Sambandan(he/him)S

2、enior Technical Account Manager,Strategic AccountsAWS 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.AgendaIntroduction to AgentsObservability Why it matters?Building observable AI agents Explore CloudWatch generative AI observabilityTroubleshooting ScenariosResources 2025,Amazon

3、 Web Services,Inc.or its affiliates.All rights reserved.Generative AI has come a long way in a short amount of time2023The year of POCs2024The year of Production2025The year of Business ValueHow do I prioritize my projects?How can we stay secure and compliant?How can I lower my costs?What customizat

4、ion method should I use?How can I leverage agents?How can we keep up with the latest and greatest models?How can we stay secure and compliant?How can I get all my employees to embrace AI?What is generative AI?Is this secure?How do I choose a model?Do I need to become a prompt engineer?Where do I get

5、 started?2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.5STRANDSAGENTS SDKLANGCHAINLLAMAINDEXCREW.AIFrameworks for Frameworks for building agentsbuilding agentsOPEN AI AGENTS SDKGOOGLE ADK 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Two Scenarios:Understand

6、 and audit every interactionWith ObservabilityWithout Obs ervabili tyNo understanding of what the agent(s)are doing 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Mask sensitive dataAmazon CloudWatch generative AI observability360 view of agent workflowsZero-C