《使用 Amazon Bedrock AgentCore 构建成本优化的代理.pdf》由会员分享,可在线阅读,更多相关《使用 Amazon Bedrock AgentCore 构建成本优化的代理.pdf(44页珍藏版)》请在三个皮匠报告上搜索。
1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.A I M 3 3 0 1Building Cost-Optimized Agents with Amazon Bedrock AgentCoreTalha ChatthaSr.Agentic AI Specialist SAAWSVivek BhadauriaPrincipal EngineerAWS 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.The 8-Year D
2、emo 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Have you ever built an Agentic AI app?2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.ExpectationsHeres the dataThanks,here is my analysisPerfect,we are done!clean,efficient,beautiful 2025,Amazon Web Services,I
3、nc.or its affiliates.All rights reserved.RealityMessage 1(250 tokens)Still goingMessage 2(300 tokens)Message 3(280 tokens)Message 47(220 tokens)Message 48(305 tokens)Loop detectedPlease help!TIMEOUT 0.5$3$5$150$152$2000$2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.What went wro
4、ng?Token explosionAgent infraTools sprawl 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Optimization frameworkCostValueWhat drives cost?How to optimize?LLMInfraToolsCutRemoveStarveRouteRe-architectCache 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amaz
5、on Web Services,Inc.or its affiliates.All rights reserved.Level 1LLM Optimizations 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Intelligent RoutingSummarizeExtractReasonAnalyzePrompt CachingSystem PromptTool DefsExamplesStatic contextDynamic contentContext EngineeringJust in Ti
6、meCompactionNote takingSub-agent Store refs,not dataLoad dynamically what is needed*Key decisions*Open issues*Recent files*Old results*Redundant messages NOTES.md Persistent memory outside context*Progress*Plan*User preferences*Facts*Decisions Main Agent Summaries onlyYou are a highly sophisticated