智能数据加速器接口：用例、未来和论据.pdf

1、1|2024 SNIA.All Rights Reserved.Smart Data Accelerator Interface:Use cases,futures,and proof pointsShyam IyerSDXI TWG ChairSNIA Technical CouncilDistinguished Engineer,Dell Technologiessdxitwgchairsnia.org2|2024 SNIA.All Rights Reserved.AgendaSNIA SDXI TWGSDXI Use casesLooking AheadProof PointsSumma

2、ry and Call to Action3|2024 SNIA.All Rights Reserved.SDXI(Smart Data Accelerator Interface)Smart Data Accelerator Interface(SDXI)is a SNIA standard for a memory to memory data movement and acceleration interface that is-Extensible Forward-compatible Independent of I/O interconnect technologySNIA SDX

3、I TWG was formed in June 2020v1.0 released!https:/www.snia.org/sdxi4|2024 SNIA.All Rights Reserved.SDXI v1.0 Specification Contributors5|2024 SNIA.All Rights Reserved.SDXI InternalsSNIA SDXI Specification v1.0 Internals https:/ SNIA.All Rights Reserved.Use Cases7|2024 SNIA.All Rights Reserved.Sample

4、 accelerator usage modelsSoftware Memcopy8|2024 SNIA.All Rights Reserved.Sample accelerator usage modelsPersist Data9|2024 SNIA.All Rights Reserved.Sample accelerator usage modelsVirtualized Data Movement10|2024 SNIA.All Rights Reserved.Sample accelerator usage modelsTiered MemoryApplication(User)DR

5、AMPersistent MemoryCXL Attached MemoryMMIOHBM/Other classes of memoryAccelerators11|2024 SNIA.All Rights Reserved.Sample accelerator usage modelsTransformData Transformation12|2024 SNIA.All Rights Reserved.Sample accelerator usage modelsComputeIn Memory Computation13|2024 SNIA.All Rights Reserved.Do

6、es it apply to AI?Yes!Varying data formats and intermediate data representations used in AI/ML data pipelinesE.g.,file,Columnar,Binary,Text,Tabular,Nested,Array-based,Hierarchical Training/inferencing operations involve tensors in memory Tensors may be in different address spaces like Host Memory,GP