启用人工智能基础设施.pdf

1、Broadcom Proprietary and Confidential.Copyright 2024 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.|Ethernet for AI Scale Hasan SirajHead of Software and AI Infrastructure Products,BroadcomBroadcom Proprietary and Confidential.Copyright 2024 Broadcom.A

2、ll Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.|Exponential Acceleration of Compute for AIOptimized forSerial TasksGPUOptimized forParallel TasksCPUMultiple CoresThousands of CoresGPU ClustersScale-up GPU Network for AI WorkloadsTens of Thousands of GPUsBroadcom

3、Proprietary and Confidential.Copyright 2024 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.|COMPUTERIS THETHE NETWORK3Broadcom Proprietary and Confidential.Copyright 2024 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its s

4、ubsidiaries.|OCP keynote by Alexis Bjorlinat 2022 OCP Global SummitRanking requires high injection&bisection bandwidthM#=ML model#TIME SPENT IN NETWORKING35%57%18%38%Network I/O is Keyfor RecommendationWorkloads.“4Broadcom Proprietary and Confidential.Copyright 2024 Broadcom.All Rights Reserved.The

5、term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.|What Makes AI Networks Unique?5ComputeVery high bandwidth RDMA traffic Bulk data transfersIntermittent data surgesStraggler data significantly impacts job completion timeTraining jobs run over long durations(hours,days)CommunicateSynchron

6、izeBroadcom Proprietary and Confidential.Copyright 2024 Broadcom.All Rights Reserved.The term“Broadcom”refers to Broadcom Inc.and/or its subsidiaries.|Broadcoms AI Network SolutionsJericho3-AI(Leaf)Jericho3-AIJericho3-AIJericho3-AIRamonRamonRamon(Spine)Tomahawk 5(Leaf)Tomahawk 5Tomahawk 5Tomahawk 5T