NVIDIA vGPU 在 Ampere GPU 上的新特性和飞跃.pdf

1、NVIDIANVIDIAVGPU在AMPEREGPU上的新特性和飞跃Neo Jia， Dec 2020#page#AGENDANVIDIA VGPU introductionWhat is NVIDIA VGPUAmpere SRIOVHow NVIDIA VGPU architecture takes advantage of SRIOVAmpere Multi-instance GPUWhat can you offer combining Multi-Instance GPU and VGPU#page#NVIDIAVGPUINTRODUCTION#page#NVIDIA VGPUPer

2、formance， Density，Manageability-for GPUNVIDIA VGPUFully enables NVIDIA GPU on virtualized platformsVMVMWide availability supported by all major hypervisorsSO 1sangGuest OSGreat app compatibility- NVIDIA driver inside VMGreat performance- VM direct access to GPU hardwareAppsAppsNVIDIANVIDIADriverDriv

3、erlmproved densityMultiple VMs can share one GPUHypervisorHighly manageableVGPU ManagerNVIDIA host driver management tools retain full controlof the GPUVGPU suspend， resume， live migration enables workloadsDatacenter GPUto be transparently moved between GPUs3nVID#page#AMPERE SRIOV#page#V/O Virtualiz

4、ationMediated and SRIOV solutionSingle-root I/0 virtualization （SRIOV）Mediated devicesVirtual Function (VF） defined by PCle spec“software-defined1/0virtualization solution，easy toadd features like live migrationSeparate IOMMU translation domainNo requirement for SRIOVFulL MMO space， posted interrupt

5、 for perf improvementQEMUQEMUQEMUQEMUVFIO PCIVFIO PCIVFIO PCIVFIO PCIdriverdriverdriverdriverKernel spaceKernel spacePCle VendorVFIOMDEVPCle Vendorvffo-pci.koDevice DriverDevice DriverVirtuaVirtualmdeymdeyFunctiorunctioPCle Device/ PFPCle DeviceAONU#page#NVIDIA VGPU KVM Architecture 101Based on upst

6、ream VFIO mediatedVMVMAppsAppsarchitectureNVIDIA driverNVIDIA driverNo VFIO UAPI changeQEMUQEMUVFIO PCI driverVFIO PCI driverMediated device managed by genericsysfs interface or libvirtLinux kernelVFIO Mediated Frameworkkvm.koVGPU ManagerUnified VFIO Mediated frameworksupports both mediated and SRIO