使用PCI Express网络进行资源解耦.pdf

1、Resource Disaggregation Using Resource Disaggregation Using PCI Express Network PCI Express Network Delta Electronics Inc.Resource Disaggregation Using PCI Express Network Tzi-cker ChiuehGeneral Director Delta Research CenterFUTURE TECHNOLOGIES SYMPOSIUMOutline1.Resource-Disaggregating Rack 2.PCI Ex

2、press Architecture 3.Rack-Wide Global Space 4.Dynamic Resource Pooling Objective:Resources somewhere in a rack are directly accessible to any host in the same rack.Host 1s CPU can access Host 2s memory without involving Host 2s CPU Resource to be pooled:SSD,NIC,GPU,AI accelerator,and memoryEnabling

3、Technology:a low-latency,high-bandwidth&reliable rack-scale network,such as PCI Express(PCIe)is a viable candidate PCIe 5.0:32Gbps/lane,per-hop latency 100nsecResource-Aggregating Rack N1N2N1N2Software-defined server(SDS):the composition of a physical server within a rack is defined via software at

4、run time Some workloads are CPU-intensive,others are memory-intensive,and still others are network-intensiveSoftware-Defined Server PCIeNetworkCPU PoolDRAMPoolDiskPoolNICPoolTraditional RackDisaggregated RackCPUDRAMDiskNICEvery PCIe device in a PCIe domain is assigned a device ID and a specific addr

5、ess range(BAR).Devices in a PCIe domain form a tree,rooted at the root complex.Every PCIe port accepts PCIe packets whose target address falls within its BAR.Four types of PCIe operationsEnumerate/Probe/ConfigureDMA set-up DMA payload transferInterrupt deliveryEvery PCIe operation is a memory read/w

6、rite operation.PCI Express(PCIe)Architecture Base/limit0 x70000-0 x90000Each host forms its own domain,and only a domains root complex or endpoints could interact with resources in its domain.How to enable a virtual machine on one host to directly access resources in another domain securely?No Multi