面向未来人工智能集群的光路交换技术.pdf

1、Optical Circuit Switching Technology Optical Circuit Switching Technology for future AI Clustersfor future AI ClustersNational Institute of ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY(AIST)Optical Circuit Switching Technology for future AI ClustersOPTICAL COMMUNICATION NETWORKSKenji MizutaniLeader,Te

2、am/AISTKazuhiro IkedaDeputy Director/AISTOutline(Optional)54321Background:ScaleBackground:Scale-up,Scaleup,Scale-out,Optical Circuit Switchingout,Optical Circuit SwitchingAIST Technology 1:OPTWEBAIST Technology 1:OPTWEBAIST Technology 2:SiAIST Technology 2:Si-Photonics OCSPhotonics OCSFujitsu&AISTFu

3、jitsu&AIST Technology 3:Optical Direct InterconnectionTechnology 3:Optical Direct InterconnectionCall for ActionCall for ActionAI ServerAI ServerMultiple AI accelerators(xPUs)ScaleScale-up NWup NW/ScaleScale-out NWout NWScaleScale-up NW up NW:All-to-all connectivity“Tbps bandwidth”“high-radix”To han

4、dle larger AI models.ScaleScale-out NWout NWExpansion of the number of xPUs“sub-Tbps bandwidth”“small-radix”“Rail”configurationBackground:AI DatacenterSWSWSWSW従来従来従来従来従来従来従来従来従来従来CPUCPUCXL memStorageCXL memStorageSWSWSWRouterRouterSWSWSWSWSWSWSWSWSWSWSWBackend NWScale-upxPUxPUAI serverScale-outInter

5、-Datacenter NetworkAI clusterFrontend NWTrend in xPUs network property Petascale switching capacity required by 2030.Increased scale-up connections are driving up wiring costs.1001,00010,000100,0001,000,0001001,00010,000100,0001,000,0002015202020252030Switching Capacity per scale-up NW GB/secTotal L

6、ink Bandwidth per xPU GB/secYearDGX series(816)NVL72Rapid increase in switching capacityRapid increase in wiring complexityNVL512Power consumption of ethernet switchRapidly growing switching capacity will increase power consumption of networks.The power consumption of optical I/O is not included,and