简化科学工作流程：HPC 的计算存储策略.pdf

1、1|2024 SNIA.All Rights Reserved.Streamlining Scientific Workflows:Computational Storage Strategies for HPCDominic MannoLos Alamos National LaboratoryHPC-Design2|2024 SNIA.All Rights Reserved.Scientific Workflows and HPC Storage Weapons Science Workflow Dismantle Weapon,find issue Experiment to learn

2、 physical properties of materials(accelerators,gas guns,hydro tests,lasers,etc.)CAD drawings and experimental set up as input Physics simulation that obeys material properties at extreme conditions Computation Workflow Run,Checkpoint,run analyze/viz maybe backup,smooth,run,checkpoint,run.Analyze Pla

3、n for refurb/dismantle/etc.Prepare for report out to President/CongressCheckpoint,what is that?3|2024 SNIA.All Rights Reserved.Exploration 1:Data Management4|2024 SNIA.All Rights Reserved.HPC StorageNVMe Lustre Servers5|2024 SNIA.All Rights Reserved.User Workflow Determine required input data Input

4、decks (initial state,tabular constants,mesh configuration,)Re-start information(checkpoint)Data location(scratch,campaign,archive)Find,stat,user driven data organization Run sim,checkpoint,migrate,run,chkpt,Analyze,smooth/modify,run sim,viz,archive Requires users to know their data and org Metadata

5、search slow,limited to each FS capabilities Data movement parallel,slightly complex,separate cluster6|2024 SNIA.All Rights Reserved.Key TechnologyMetadata indexing Grand Unified File Index(GUFI)(link paper)Data movement scheduling CONDUITUser defined metadata GUFI+Data Science Infrastructure(DSI)(li

6、nk)Computational storage (file system offloads)7|2024 SNIA.All Rights Reserved.Exploration 2:Plasma Simulation8|2024 SNIA.All Rights Reserved.User WorkflowI want to understand how magnetic reconnection occurs:Need to sim plasma flowing over one another Need to understand which pa