time-series-database-on-kubernetes-efficient-management-of-massive-internet-of-vehicles-data-kuberneteszha-daeppan-fa-lia-hao-ji-ni-jie-wu-dai-vicky-lee-huawei-cloud-computing-technology-co-ltd.pdf

1、Time Series Database on Kubernetes:Efficient management of massive Internet of Vehicles dataAbout MeIm a Time-series database expert in the HUAWEI CLOUD Database Innovation Lab and the Co-founder of the openGemini community,has been engaged in distributed databases and NoSQL databases as a cloud ser

2、vice for many years.Currently,mainly dedicated to openGemini developmentVicky LeeContent IoV Technology Architecture Evolution and Industry Challenges IoV Solution Based on openGemini openGemini Key TechnologiesIoV Technology Architecture Evolution and Industry ChallengesTechnical Challenges:Perform

3、ance,Real-time Analysis And CostsMore and more vehicles connected to internetMore than 70%new vehicles have the network connection capability,and the annual IoV access increment exceeds 30%.Data collection frequency is becoming increasingly higherGB StandardData:100+ColumnsFrequency:30sEnterprise St

4、andardData:1000+ColumnsFrequency:10S/1S/100msThe enterprise standard data is more than 10 x that of the GB standard,it means that these data need to be quickly written into the database.If millions of vehicles report data，the write traffic reaches 10 GB/sIncreasing storage costsreal-time analysis6 m

5、onths1 month1 monthoffline analysis3 years/10 years/Permanent1 year1 yearMassive data and long storage time.1 million vehicles generate 3 PB data in a year.Increasing requirements for real-time analyticsIntelligent operationsseller competence enablementdecision making and Insightexperience optimizat

6、ionThese scenarios,such as alarm,vehicle status query,and fault analysis,have higher requirements on real-time servicesEarly IoV Technical ArchitectureGatewayfilefileKafkaFormat ConversionofflineanalysisData FilesData FilesData FilesData FilesHDFSMapReduceHQL1.Big data storage2.Statistical AnalysesB