用于大规模内存池的光纤 CXL 互连.pdf

1、OCP Global Summit October 18,2023|San Jose,CARon Swartzentruber,LightelligenceOptical CXL Interconnect for Large Scale Memory PoolingnMemory centric shift in the data centerMemory centric shift in the data centernAI Large Language Model growthAI Large Language Model growthnNeed for optical CXL techn

2、ology Need for optical CXL technology nCase study:OPT inference benefits using optical CXLCase study:OPT inference benefits using optical CXLAgendaDisaggregation is the Future for DatacenterAI TrendsOptical Interconnect LatencyCXL is the Predominant Standard for DisaggregationOptical CXL is Required

3、 for ScalingOptical CXL in the DatacenterCase Study:LLM InferenceLLM Model ListResultsPHOTOWAVETM OPTICAL CXL MEMORY EXPANDERPHOTOWAVETM OPTICAL CXL MEMORY EXPANDERSummary of ResultsPHOTOWAVETM Form FactorsEndnotesComparative Assessment TableArchitectural ParameterDescriptionApplication requirement

4、or technical capabilityTechnical capability focusing on CXL over optics solutionUse caseCXL/PCIe over optics#of Links/HostApplication and packaging method driven.Pluggable or on-board optics supports up to 16 while co-packaged optics(CPO)form factor can support more.Host interfacePCIe,UCIe interface

5、Un-retimed/retimed?Different variants covering both un-retimed and retimed system.FEC requirementsNo FEC for Gen5.FEC needed for Gen6.Block DiagramArchitecture varies based on different applications.Comparative Assessment TableParameterUnitsCommentsData rate per laneGbps32Gbps(PCIe Gen5)and 64Gbps P

6、AM4(PCIe Gen6)#lanes/link#x16,x8,x4Aggregate BW/linkGbpsFor x16,512Gbps/link(Gen5)and 1024Gbps/link(Gen6)Linear BW densityGbps/mmVaries based on different form factorAreal BW densityGbps/mm2Varies based on different form factorEnergy efficiency single directio