基于Photonic Fabric的放大网络用于芯片到芯片和芯片到内存的连接.pdf

1、 2023 Celestial AI.All Rights Reserved.Celestial AI ConfidentialPhotonic FabricTMbased Scale-Up Network for Chip-to-Chip&Chip-to-Memory ConnectivityPreet VirkCo-Founder&COO,Celestial AI 2024 Celestial AI Inc.,All Rights Reserved.Celestial AI,the C logo,and Photonic Fabric are trademarks or registere

2、d trademarks of Celestial AI Inc.in the United States and other countriesAI Hardware Summit,San Jose11th Sep 2024AI The Largest Technological Wave We Have Ever Seen2Notes:1.Source:The economic potential of generative AI(McKinsey,June 2023);Total AI economic potential estimated to range from$17.1Tn t

3、o$25.6Tn)PioneersPioneers1960-1980($200Bn)1980-2000($600Bn)2000-2020($1.2 Trillion)Pioneers2020 and beyond($20 Trillion)PioneersMainframe100s of 1,000s of usersClient/ServerMillions of usersCloud/MobileBillions of usersAI/Large Language Models10s of billions of connected people,devices and applicati

4、onsAll are building their own AI Processorsand Data Center ArchitecturesFour Hyperscalers Represent 70%of Data Center MarketUnprecedented Growth&Market ConcentrationSource:Morgan Stanley Artificial Intelligence is Changing Everything!AI Driving a New Generation of Optical Compute InterconnectHBM3 HB

5、M4 Equivalent Bandwidth:The Minimum Requirement for Accelerated Computing Optical Interconnect Scale-Up Network for XPU-XPU Connectivity:Enabling Cluster Scale Processing of AI models Celestial AIs Photonic Fabric-Optical Interconnect for Accelerated Computing17.8 TbpsCPO 120242026202820302032203420

6、16201820202022Off Package Bandwidth1.Industry Trend based on data by John Wilson,Nvidia Research:“High Bandwidth Density,Energy Efficient Short Reach Signaling that Enables Massively Scalable Parallelism”2.Assuming 6 chiplets per XPU1010011,00010,000Total Off-Package Bandwidth(Tbps)32016080402064010