利用 CXL® 突破记忆壁垒.pdf

1、1|2024 SNIA.All Rights Reserved.Breaking Through the Memory Wall with CXLPresented byAhmed MedhioubProduct Manager,CXL Smart Memory Controllers2|2024 SNIA.All Rights Reserved.Memory Wall Breaking through the Memory WallMemory Bound Use CasesCXL for Modular Shared InfrastructureEcosystem EnablementCa

2、lls to ActionAgendaAgenda3|2024 SNIA.All Rights Reserved.Challenges with Previous Attempts1.Limited scalability of memory BW and capacity2.Significant memory latency delta vs local memory3.Proprietary system configuration and deployment4.Complex software integration with popular appsThe Memory WallT

3、he Memory WallBreaking Through the Memory Wall with CXL1.Increase server memory BW and capacity by 50%2.Reduce latency by 25%3.Standard DRAM for flexible supply chain and cost4.Seamlessly expand memory for existing and new applications12 Memory Channels with Two LeosLocal CPUMemory ChannelsDDR5 5600

4、 x16x16HW InterleavingCXL-Attached Memory Channels4|2024 SNIA.All Rights Reserved.eCommerce&Business Intelligence Online Transaction Processing Online Analytics ProcessingBreaking Through the Memory WallBreaking Through the Memory WallWhat is happening?OLTPOLTPWhat has happened?OLAPOLAPOpportunity f

5、or CXL to Boost MySQL Database PerformanceOpportunity for CXL to Boost MySQL Database PerformanceAI Inferencing Recommendation Engines Semantic CacheOpportunity for CXL to Boost Vector Database PerformanceOpportunity for CXL to Boost Vector Database PerformanceVectorDBVector DatabaseInference Server

6、RESTModelsQueryInferenceUsersQuery/StoreInference5|2024 SNIA.All Rights Reserved.OLTP&OLAP ResultsOLTP&OLAP ResultsOLAPOLAPOLTPOLTPCPUStorageLocalLocal+CXLCXL ModeBenchmark5th Gen Intel Xeon Scalable Processor(Single-Socket)4x NVMe PCIe 4.0 SSDs512GB(8x 64GB DDR5-5600)512GB(8x 64GB DDR5-5600)+256GB(