《用于PCIE的高能效光链路.pdf》由会员分享,可在线阅读,更多相关《用于PCIE的高能效光链路.pdf(16页珍藏版)》请在三个皮匠报告上搜索。
1、OCP Global Summit October 18,2023|San Jose,CAJeff Hutchins,RanovusEnergy Efficient Optical Links for PCIe AI/ML Scale-OutKey objectives for energy efficient links for AI/MLPresented at Lightcountings“Linear Drive Enables Green All-Optical Connectivity for Datacenters Webinar”,March 2023 Presented at
2、 Lightcountings“Linear Drive Enables Green All-Optical Connectivity for Datacenters Webinar”,March 2023 Key PCIe Enablers for AI/ML Scale-Out:qReduced power consumptionqImproved densityqReduced latencyMoores law is not keeping pace further increasing pressure on networking3AI datacenter applications
3、 for energy efficient PCIe links4Cloud DCFront-End w/TCP/IP,UDP,etc.Ethernet(200GbE)FRONT ENDNetwork Type I/Fs Standards based Energy efficient Potentially high density for some applicationsCompute type I/Fs(PCIe like interfaces)Network Type I/FsComp-IOComp-MemComp-CompHigh-PerfHBMDDR/LPDDRCXL.memUP
4、I xGMI NVLinkCXL.cacheNVLinkInfinibandEthernetPCIeBack-End w/low latency(GPU-GPU)BACKEND/COMPUTEAdapted from oif2023.269,Ram Huggahalli,Microsoft Bookended or standards based Low Latency Energy efficient Potentially high density for some applications Bookended or standards based Low Latency Energy e
5、fficient Potentially high density for some applicationsCategorization of data Center linksAI datacenter applications for energy efficient PCIe links5AI/ML InterfacesPCIe-like InterfacesCharacteristicsCloud DCFront-End w/TCP/IP,UDP,etc.Ethernet(200GbE)FRONT ENDNetwork Type I/Fs Standards based Energy
6、 efficient Potentially high density for some applicationsCompute type I/Fs(PCIe like interfaces)Network Type I/FsComp-IOComp-MemComp-CompHigh-PerfHBMDDR/LPDDRCXL.memUPI xGMI NVLinkCXL.cacheNVLinkInfinibandEthernetPCIeBack-End w/low latency(GPU-GPU)BACKEND/COMPUTEAdapted from oif2023.269,Ram Huggahal