用于PCIE的高能效光链路.pdf

1、OCP Global Summit October 18,2023|San Jose,CAJeff Hutchins,RanovusEnergy Efficient Optical Links for PCIe AI/ML Scale-OutKey objectives for energy efficient links for AI/MLPresented at Lightcountings“Linear Drive Enables Green All-Optical Connectivity for Datacenters Webinar”,March 2023 Presented at

2、 Lightcountings“Linear Drive Enables Green All-Optical Connectivity for Datacenters Webinar”,March 2023 Key PCIe Enablers for AI/ML Scale-Out:qReduced power consumptionqImproved densityqReduced latencyMoores law is not keeping pace further increasing pressure on networking3AI datacenter applications

3、 for energy efficient PCIe links4Cloud DCFront-End w/TCP/IP,UDP,etc.Ethernet(200GbE)FRONT ENDNetwork Type I/Fs Standards based Energy efficient Potentially high density for some applicationsCompute type I/Fs(PCIe like interfaces)Network Type I/FsComp-IOComp-MemComp-CompHigh-PerfHBMDDR/LPDDRCXL.memUP

4、I xGMI NVLinkCXL.cacheNVLinkInfinibandEthernetPCIeBack-End w/low latency(GPU-GPU)BACKEND/COMPUTEAdapted from oif2023.269,Ram Huggahalli,Microsoft Bookended or standards based Low Latency Energy efficient Potentially high density for some applications Bookended or standards based Low Latency Energy e

5、fficient Potentially high density for some applicationsCategorization of data Center linksAI datacenter applications for energy efficient PCIe links5AI/ML InterfacesPCIe-like InterfacesCharacteristicsCloud DCFront-End w/TCP/IP,UDP,etc.Ethernet(200GbE)FRONT ENDNetwork Type I/Fs Standards based Energy

6、 efficient Potentially high density for some applicationsCompute type I/Fs(PCIe like interfaces)Network Type I/FsComp-IOComp-MemComp-CompHigh-PerfHBMDDR/LPDDRCXL.memUPI xGMI NVLinkCXL.cacheNVLinkInfinibandEthernetPCIeBack-End w/low latency(GPU-GPU)BACKEND/COMPUTEAdapted from oif2023.269,Ram Huggahal