SNIA-SDC23-Ki-Is-SSD-with-CXL-Interfaces-Brilliantly-Stupid-or-Stupidly-Brilliant.pdf

1、Is SSD with CXL Interfaces Is SSD with CXL Interfaces Brilliantly Stupid or Brilliantly Stupid or Stupidly Brilliant?Stupidly Brilliant?YANG SEOK KIYANG SEOK KI,Ph.D.Vice President,Memory Solutions Lab.,Samsung ElectronicsStupid or Brilliant?Stupid or Brilliant?Draisine(Running machine),1817:the 1st

2、 bicycle in recordThe Jazz Singer,1927:the 1st movie with an audio trackSSD with CXL InterfacesSSD with CXL Interfaces Storage with memory and/or storage interfacesSSDTechnical NeedsMemory HierarchyMemory Hierarchy Keep hot data close to CPU using data localityMemory HierarchyTraditional WorkloadTra

3、ditional WorkloadHotColdNeeds(1):Persistent MemoryNeeds(1):Persistent Memory Discontinuation of the leading technologyDatabase:Oracle Exadata Redo LogStorage:DAOS(Distributed Application Object Storage)Database ServerPersistent MemoryRedo buffers for Instance 1Commit RecordRedo Record2RDMA PUTs(25+u

4、s)1 write for redo record1 write for commit recordIntegrated FabricPersistent MemoryBlock StorageDAOS Storage EngineMetadata,Low-Latency I/O,and Indexing/QueryBulk DataMemory InterfaceNVMeInterfacePMDKSPDKStorage ServerNeeds(2):Secondary MemoryNeeds(2):Secondary Memory High overhead of virtual memor

5、y implementationSwap for memory extension on diskRedis Auto Tiering for memory extension on SSD0:1:N-1:CPU0:1:N-1:Virtual AddressesPage TableMemoryPhysical AddressesDiskStorage engineLRU/LFUSSDWarm ValuesDRAMHot ValuesNeeds(3):Fast Small IONeeds(3):Fast Small IO High overhead of IOs smaller than 4KB

6、DLRM size is rapidly growing0.00120102012201420162018202020220.010.1110100100010000Unit:BillionsGrowingComputeNeedsGrowingMemoryNeedsTopMLPBottomMLPInteractionsSparse Features.Dense FeaturesEmbeddingEmbeddingSource:MetaAlexNetGoogLeNetVGCResNetBERTAlphaZeroResNetGPT-3SwitchTransformer(G)CXL-based SS