DELTA 与 JODIE HELPERS 合并优化.pdf

1、2024 Databricks Inc.All rights reserved1DELTA MERGE DELTA MERGE OPTIMIZATIONS OPTIMIZATIONS WITH JODIE WITH JODIE HELPERSHELPERShttps:/ Banik RoyJoydeep Banik RoyHead of Data Science,ZeotapHead of Data Science,Zeotap2024 Databricks Inc.All rights reservedIntegrate,Unify,Segment and Orchestrate custo

2、mer data for brandsIntuitive UI for marketersDrive business outcomes for your 1st Party dataNavigate the Cookieless futureZEOTAP CDPZEOTAP DATAZEOTAP CDPZEOTAP DATA23rd Party Aggregated Data Consented,GDPR CompliantPeople based,deterministicExclusive Telco data partnershipsDemographic,IAB 1.1 and ot

3、her attributesBIT ABOUTBIT ABOUTZEOTAPZEOTAPAND WHAT WE DOAND WHAT WE DO2024 Databricks Inc.All rights reservedThis spot is great for a diagram,image,small table,code snippet or screenshot3How Delta Merge WorksHow Delta Merge WorksUnder the HoodUnder the Hood2024 Databricks Inc.All rights reservedAP

4、PLY DATA SKIPPINGFIRST JOIN-INNERnotMatchedBySource Clause-RIGHT OUTERDOES SANITYMULTIPLE SOURCE ROWS NOT MATCHING SINGLE TARGET ROWRECORDS STATSnumTargetFilesBeforeSkippingnumTargetFilesAfterSkippingWRITING PHASEOUTER JOIN RIGHT OUTER-merge without when not matched clause is optimisedFULL OUTERIF C

5、HANGE DATA CAPTURE ENABLEDRECORD CDFRECORD STATSnumTargetRowsUpdatednumTargetRowsNotMatchedBySourceUpdatednumTargetRowsInsertedWRITE FILES AND RECORD TRANSACTION/VERSION4HOW DELTA MERGE WORKSHOW DELTA MERGE WORKSMERGE WITH UPSERTSMERGE WITH UPSERTS2024 Databricks Inc.All rights reserved5DATA SKIPPIN

6、G DATA SKIPPING Collecting min max values and null Collecting min max values and null counts on your columnscounts on your columns Total records per fileTotal records per file Filter files from Delta Table based Filter files from Delta Table based on these metricson these metrics Candidate files for