如何将增量共享用于流数据（重复）.pdf

1、2024 Databricks Inc.All rights reservedHOW TO USE DELTA HOW TO USE DELTA SHARING FOR SHARING FOR STREAMING DATASTREAMING DATAMatt Slack-Senior Specialist Solution ArchitectSurya Sai Turaga-Senior Solution Architect13th June 2024This information is provided to outline Databricks general product direc

2、tion and is for informational purposes only.Customers who purchase Databricks services should make their purchase decisions relying solely upon services,features,and functions that are currently available.Unreleased features or functionality described in forward-looking statements are subject to cha

3、nge at Databricks discretion and may not be delivered as planned or at allProduct safe harbor statement2024 Databricks Inc.All rights reserved Company-data provider for financial market data(similar to Bloomberg/State Street)Use Case-create a marketplace for financial data products,e.g.:pricing and

4、market datacompany datarisk intelligenceeconomic datanewscommodities data Success Criteriaconsistent sub 10 second data delivery to customersintegrates into customers existing systems requires minimal additional infrastructure3Customer Story2024 Databricks Inc.All rights reservedAchievable latency c

5、urrently around 10sSupports high volumes of dataEnables many other use casesSupports medium latencyReduces complexitySharing externally and cross-cloud4When is streaming for Delta Sharing a good fit?No additional infrastructure needed(Kafka,Eventhubs,Kinesis etc.)No(de)serialization to AVRO/Protobuf

6、/JSONSchema management without a schema registryCommon semantics for accessing tables with batch/streamSecure for cross cloud data sharingMake your data available anywhere with low latency2024 Databricks Inc.All rights reserved5Recap Delta Sharing architectureNotes:Sharing happens on Delta part file