SNIA-SDC23-Zheng-KV-CSD-An-Ordered-Hardware-Accelerated.pdf

1、1|2023 Triad National Security,LLC.All Rights Reserved.Virtual ConferenceSeptember 28-29,2021KV-CSDAn Ordered,HW-Accelerated KV Store For Rapid Data Insertion and QueriesQing Zheng,Scientist,Los Alamos National Laboratory(LANL)LA-UR-23-302732|2023 Triad National Security,LLC.All Rights Reserved.A Co

2、llaboration with SK hynix3|2023 Triad National Security,LLC.All Rights Reserved.ProblemScientific data analytics often slowed down by unordered,unindexed data accessKV-CSDAn ordered,hardware-accelerated KV store for rapid data insertion and queriesGoalLeverage computational storage to sort and index

3、 data at restOverview4|2023 Triad National Security,LLC.All Rights Reserved.A Quick LookThe arm board implements KV atop SSD zonesApps use custom NVMe KV commands for bulk data insertion,index creation,and queriesAppArm SoC boradZNS SSDTwo components:(1)an arm SoC board,(2)a ZNS SSDKV5|2023 Triad Na

4、tional Security,LLC.All Rights Reserved.KV-CSD in Real WorldCurrent PrototypeZNS SSDARM SoC(FPGA in future)PCIe(NVMeOF in future)ZNS SSDARM SoC 6|2023 Triad National Security,LLC.All Rights Reserved.Why ordered computational KV storage?How does it work?Todays Talk7|2023 Triad National Security,LLC.A

5、ll Rights Reserved.How Scientific Simulations RunTime based bulk-synchronous parallel programsIterate between compute&I/O phasesAnalytics occur after simulationCompute IO Compute IO Compute IOAnalyticsSimulation PipelineTimeTimestep 0-15Timestep 16-31Timestep 32-47Persist timestep 15 to storage8|202

6、3 Triad National Security,LLC.All Rights Reserved.How Data is Stored TodayThrough filesystemsData stored as one big or many small files per timestepData typically accompanied by metadata that describes the data(type,dimension,)Compute IO Compute IO Compute IOAnalyticsSimulation PipelineTimeFilesFile