《会议4_基于 BROADCOM ROCE 的高性能可扩展 MPI 库.pdf》由会员分享,可在线阅读,更多相关《会议4_基于 BROADCOM ROCE 的高性能可扩展 MPI 库.pdf(30页珍藏版)》请在三个皮匠报告上搜索。
1、HIGH PERFORMANCE&SCALABLE MPI LIBRARY OVER BROADCOM ROCE2024 OFA Virtual WorkshopMustafa Abduljabbar,Shulei Xu,Noah Pavuk,and Hemal Shah*Core Switching Group(CSG),Broadcom Inc Network Based Computing Laboratory(NOWLAB),The Ohio State UniversityFollow us onhttps:/ 2024 Virtual OFA Workshop2Network Ba
2、sed Computing Laboratoryhttps:/ Virtual OFA Workshop3Network Based Computing LaboratoryEnhanced Performance:RoCE delivers significantly lower latency and higher throughput compared to traditional Ethernet,empowering HPC applications to achieve peak performance.Optimized Efficiency:RoCE offloads RDMA
3、 operations to specialized hardware,reducing CPU overhead and freeing up valuable processing resources for critical computational tasks.Cost-Effective Solution:RoCE leverages existing Ethernet infrastructure.Scalable and Flexible:RoCE supports a range of Ethernet speeds and Layer 3 routing.Why RoCE
4、for HPC?2024 Virtual OFA Workshop4Network Based Computing Laboratory1.MVAPICH-CPU release:Optimizing MPI communication operations on new generation Broadcom adaptersWe provide support for newer generation Broadcom network adapters(Thor 200 Gbps)in MVAPICH2 and optimize the communication protocols(RC
5、,UD,Hybrid)Focus will be towards point-to-point operations(two-sided)and frequently used collective operations(such as Allreduce and Alltoall).Benefits of these designs will be studied at the applications level.These design changes will be incorporated into the future MVAPICH release.2.MVAPICH-GPU r
6、elease:Exploring the use of Peer Direct capabilities in new Broadcom adapters for high-performance data transfers to/from GPU device memoryBroadcom has introduced support for Peer Direct RDMA to enable high-performance communication operations from device memory.We study and evaluate the performance