《2020Flink峰会报告:7-FFA2020_李畅_英语_compressed.pdf》由会员分享,可在线阅读,更多相关《2020Flink峰会报告:7-FFA2020_李畅_英语_compressed.pdf(39页珍藏版)》请在三个皮匠报告上搜索。
1、ByteDance MQ-Hive Real-time Data Integration Based on Flink LiChang at ByteDance About Me LiChang Joined the ByteDance data management suite team after graduating in 2016, and built ByteDances one-stop data middle platform Focus on distributed computing and storage under large-scale data, and provid
2、e efficient and reliable global data integration solutions #2 Data Integration Challenges #1 MQ-Hive Real-time Data Integration Based on Flink #3 Future Outlook #4 Evolution of MQ-Hive Technology Data Integration Challenges#1 Input Sources Database Message queue Big data storage Others Data Integrat
3、ion Background Data Middle Platform Dataleap Data development Data integration Data governance Data map External System Data analysis platform Online data service ML platform Others Dataleap is a one-stop data middle platform developed by ByteDance,help users quickly complete a full set of data construction such as data development, integration, operation and maintenance Diversified Scenes Batch S