1、Mandy GuGenAI for ProductivityAgendaOur JourneyContextLearningsGenAI todayContextAbout WealthsimpleWealthsimple is a Canadian fintech helping Canadians achieve financial independence through our unified app which combines investing,saving&spendingGenAI at WealthsimpleOur LLM efforts are primarily or
2、ganized into:Employee productivityOptimizing operationsLLM PlatformLLM Enablement PhilosophyAccessibilitySecurityOptionalityIn the past 1.5 years,we have Developed and open sourced our LLM Gateway used internally by over half of the companyShipped in house PII redaction modelDeployed 4 open-source L
3、LMsPlatform support for fine tuning and model training with hardware accelerationLLMs in production optimizing operationsOur LLM JourneyOur LLM Journey in 2023MAYJUNJULAUGSEPOCTNOVLaunch LLM GatewayDECOur LLM Journey in 2023MAYJUNJULAUGSEPOCTNOVLaunch LLM GatewayDECUsers can select their model throu
4、gh the drop down.Our production systems can also interact with these models programmatically through an API endpoint from our LLM service.Conversations can be exported to other platforms we use and they can be imported as checkpoints to create a blended experience across different models.Driving Ado
5、ption:Sticks and CarrotsDriving Adoption:Sticks and CarrotsCarrots Free to use OptionalityEasier to use for developers:Increased reliability Integrated APIDriving Adoption:Sticks and CarrotsSticks“Nudge mechanism”:Slack reminders for direct LLM usageGuidelines to leverage gateway for work related pu
6、rposesCarrots Free to use OptionalityEasier to use for developers:Increased reliability Integrated APIOur LLM Gateway offers the freedom to exploreSecurity,Reliability,OptionalityPrevent sharing sensitive information with third party LLM providersSecurityBackoff,fallback mechanismsIncreased Availabi