2892 - 使用 VMware NVMe_TCP 的 Ceph 块性能.pdf

1、Orlando,FLOctober 69IBM TechXchange 20252892 Block Performance with VMware and NVMe/TCPMike BurkhartIBM Storage Ceph Tech PMCeph Block Performance with VMware and NVMe/TCPAgenda01020304NVMe/TCP Architecture and ComponentsWhats NewPerformanceQ&AIBM TechXchange|2025 IBM CorporationWhy NVMe over TCP?IB

2、M Storage CephStorage Ceph is an enterprise-grade software-defined storage solution with a three-in-one architecture that unifies block,file,and object data in a single highly scalable and resilient distributed solution that simplifies your infrastructure stack.NVMe Density,performance,high-throughp

3、ut:larger number of queues and queue paths,fewer clock cycles per I/O IBM Storage Ceph with NVMe/TCPUnlocking the power of NVMe over modern high-bandwidth networks with disaggregated storageAgenda01020304NVMe/TCP Architecture and ComponentsWhats NewPerformanceQ&AIBM TechXchange|2025 IBM CorporationI

4、BM Storage Ceph client Block storage accessRADOSReliable autonomic distributed object storeOSDMONOSDMONOSDMONMONMonitorOSDObject storage daemonLIBRADOSLibrary allowing applications to access RADOSRADOS block device(RBD)LibRBD,kRBD,NVMe/TCPNVMe over TCPOverviewStorage Ceph ClusterCeph Node 1Ceph Node

5、 2OSD XCeph Node OSD YCeph Node NOSD ZmonmonmgrIBM Storage Ceph NVMe/TCP GatewayNVMe-oF Initiator BRADOSNVMe-oF Initiator CNVMe-oF Initiator AOSD WIBM Storage Ceph block StorageReactor Core Association modelController association maps 1x1 NVMe queue to a TCP connectionNo controller-wide sequencingNo

6、 controller-wide reassembly constraintsNo shared state across NVMe queues and TCPConnection binding is performed in NVMe-oF connect time(binding queue to controller)NVMe to RBD commands mappingRBD backend in SPDKRBD backend in SPDK maps NVMe operations to RBD APINatively supportedNatively supportedR