会议4_基于 BROADCOM ROCE 的高性能可扩展 MPI 库.pdf

1、HIGH PERFORMANCE&SCALABLE MPI LIBRARY OVER BROADCOM ROCE2024 OFA Virtual WorkshopMustafa Abduljabbar,Shulei Xu,Noah Pavuk,and Hemal Shah*Core Switching Group(CSG),Broadcom Inc Network Based Computing Laboratory(NOWLAB),The Ohio State UniversityFollow us onhttps:/ 2024 Virtual OFA Workshop2Network Ba

2、sed Computing Laboratoryhttps:/ Virtual OFA Workshop3Network Based Computing LaboratoryEnhanced Performance:RoCE delivers significantly lower latency and higher throughput compared to traditional Ethernet,empowering HPC applications to achieve peak performance.Optimized Efficiency:RoCE offloads RDMA

3、 operations to specialized hardware,reducing CPU overhead and freeing up valuable processing resources for critical computational tasks.Cost-Effective Solution:RoCE leverages existing Ethernet infrastructure.Scalable and Flexible:RoCE supports a range of Ethernet speeds and Layer 3 routing.Why RoCE

4、for HPC?2024 Virtual OFA Workshop4Network Based Computing Laboratory1.MVAPICH-CPU release:Optimizing MPI communication operations on new generation Broadcom adaptersWe provide support for newer generation Broadcom network adapters(Thor 200 Gbps)in MVAPICH2 and optimize the communication protocols(RC

5、,UD,Hybrid)Focus will be towards point-to-point operations(two-sided)and frequently used collective operations(such as Allreduce and Alltoall).Benefits of these designs will be studied at the applications level.These design changes will be incorporated into the future MVAPICH release.2.MVAPICH-GPU r

6、elease:Exploring the use of Peer Direct capabilities in new Broadcom adapters for high-performance data transfers to/from GPU device memoryBroadcom has introduced support for Peer Direct RDMA to enable high-performance communication operations from device memory.We study and evaluate the performance