Indeed 向 Amazon S3 表的迁移.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.S T G 2 1 0Venkatesh MandalapaBrett SeibIndeeds migration to Amazon S3 TablesStaff Software Engine

2、erIndeedSr.Solutions ArchitectAWS 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Amazon S3 Tables overviewThe challenges of a Data Lake at scaleIndeeds migration to S3 TablesResults and tips for successAgenda 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Cust

3、omer problems to solveGrowing scale requires more performanceEnforcing table-level security is complexOptimizing storage cost drives unexpected operational burden 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Amazon S3 Tables The table is a first-class AWS resourceHas an ARNCan

4、take an S3 resource policyPurpose built for tabular dataHas a dedicated endpoint: 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.S3 Tables Security controlsreinvent-bucket-1/warehouse/table1/data/obj1.parquetreinvent-bucket-1/warehouse/table1/data/obj2.parquetreinvent-bucket-1/wa

5、rehouse/table1/data/obj3.parquetreinvent-bucket-1/warehouse/table1/data/obj4.parquetreinvent-bucket-1/warehouse/table2/data/obj1.parquetreinvent-bucket-1/warehouse/table2/data/obj2.parquet 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.S3 Tables Security controls Effect:Allow,Act

6、ion:s3tables:GetTableData,s3tables:PutTableData/table1/data/obj1.parquet/table1/data/obj2.parquet/table1/data/obj3.parquet/table1/data/obj4.parquet 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.S3 Tables Automatic compactionFewer requests to S3Better latency&throughputAutomatic