通过 ETL 和 SQL 查询实现通用数据连接.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.A N T 2 0 9Universal data connectivity with ETL and SQL queriesShrey MalpaniSr.Product Manager,AWS Analytics(he/him/his)Shruti WorlikarSr.Manager,SSA,AWS Analytics(s

2、he/her)2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Challenges in data connectivity 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Our customers have invested in varied data sources and tools

3、Amazon SageMaker AID A T A S O U R C E SC A T A L O GT R A N S F O R MM LS T O R EQ U E R YAmazon RedshiftAmazon AthenaAmazon EMRAWS Glue3P applicationsData Market PlaceAWS Glue Data CatalogData Lake(RAW)Datawarehouse(Structured)TelematicsManufacturingSalesFinanceCustomer experienceProduct qualityDa

4、ta scientistsBusiness analystsData engineersData stewardsData owners 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Universal data connectivity with AWS 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Meet Alex The Data EngineerAlexBackgroundData engineer at la

5、rge enterpriseFamiliar with ETL pipelinesIn depth Apache SparkunderstandingWorks with multiple data sourcesPressure to deliver results fastKey QuestionsHow to connect to data sources inmy organization?What tools can help?How to simplify existing pipelines?How to deliver insights fast?2025,Amazon Web

6、 Services,Inc.or its affiliates.All rights reserved.SnowflakeAmazon RedshiftAmazon Simple Storage Service(Amazon S3)Amazon AuroraAmazon Relational Database Service(Amazon RDS)AlexData sources 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Alexs tasksCreate ETL Pipeline to ingest