陆游游-SuperFS：高速硬件时代的新型文件系统.pdf

1、SuperFS:!#$%&($)*!#$%&!()*+,-./()*0+,-.12345267#$%&()*#$%&()*n!#$%&()*+,-./012345678200TB9:n;*+,-./01234?78120TB%9:ABC1E-61E-51E-41E-3201020112012201320142015201620172018Bps/FlopsI/O 速度 vs 计算速度1E+01E+11E+21E+3200920102011201220132014201520162017201820192020算（Flops）Top-1 超级计算机发展!#$#$%&%&#$#$!(!(#$#$)

2、&)&#$#$*#$#$)#$#$(+(+#$#$&+&+#$,-./0-,-./0-!#$%&#$%&123/4123/4567567889-:239-:2356;56;88?:?:A/.-/BA/.-/B7DE6FGH2IJKABLM.NOABMPQQRSTDMPp!#$%&!#$%&()()*+,*+,-./-./012345012345CD&%)ECD&%)E=%?:?:D!*ED!*E=+A/.-/BA/.-/B%D+E%D+E=%123/4123/4(D(%E(D(%E=&!#$%&#$%&CDC*+ECDC*+E=&56;56;881E100P10P1P!#$%&()*#$%&(

3、)*4p!-#$%&()*+!#$%&()*+,!-./01$%(23456789:1 Li,Mu,et al.Scaling distributed machine learning with the parameter server.F OSDI.2014.2 Ken Brock.“Building Efficient Deep Learning Accelerators from the Foundation Up”p!,#$%-./01213+,-.+,-.p 67!#$8TOP5009:;?ALustreBIBM Spectrum ScaleCDEFGHITOP1FugakuTOP4

4、!#$%&TOP5PerlmutterTOP2SummitTOP3SierraTOP6SeleneTOP9HPC5TOP10FronteraTOP8JEWELSBoosterModuleTOP7(2)/0-./0-.JK-.LMNOP01U9:VWXYZU9:VWXYZ!#$%&(9:VWXYZ9:VWXYZ_YZab_YZab!GHIJKLM;?A;?A;?A*+,-NOPQRSOPQRS!1#$%&()*+,-./012345!2#$%&()*+,-./01234!4#54678+,-9:;?*!3#ABCDEFG+,-./8HIJKLM9ABC/0-./0-.JK-.LMQ011p-.L

5、MRS,TUVWXY()!$-.LMRS,TUVWXY()!$0NO PQRSTU1048.6NVWXOY ZT224V?I/O+_288GB/s ab_c70GB/s+I/OdefghidBCI/ODEI/O!#$%&()*+,-!#$I/O#$%&#$/0-./0-.JK-.LMQ012pZ_W,TUXYFGZ_W,TUXYFG#$%&()FMDS;GH;!HDFS1*Lustre40*!#$%&!#$%&#()*+,#()*+,-./01-./01IJ1IJ11000*$%&()T T/0-./0-.JK-.LMQ013(100.0,1.0)(2.1,2.1)(2.0,2.1)(2.0,

6、2.0)(1.0,1.0)(2.1,2.1)(2.0,2.0)(1.0,1.0)(2.0,2.0)(9.3,1.1)(1.1,4.8)(1.0,33.3)(25.0,1.0)(1.0,1.0)(1.0,1.0)(1.0,1.0)(11.1,1.0)(1.4,4.3)(2.0,2.1)(2.3,2.0)(1.0,1.0)(16.7,1.1)(1.3,6.3)(4.5,1.3)(1.0,1.0)(1.0,1.0)(1.0,1.0)(33.3,1.0)(1.0,1.0)(1.0,1.0)(1.1,12.5)(1.3,12.5)(1.0,50.0)(2.4,2.2)(1.1,50.0)(1.1,3.3