HotchipsMLIRTutorialIntroFinal.pdf

1、Stephen NeuendorfferFellowAugust 21,2022MLIR Tutorial|2MLIR Tutorial|August 2022 A New Golden Age for Computer ArchitectureA New Golden Age for CompilersContextHennessey and Patterson,ISCA 2018End of Growth of Single Program Speed?40 years of Processor Performance198019851990199520002005201020151000

2、00100001000100101Performance vs.VAX11-780CISC2X/3.5 yrs(22%/yr)RISC2X/1.5 yrs(52%/yr)End of Dennard ScalingMulticore2X/3.5 yrs(23%/yr)End of the line?2X/20 yrs(3%/yr)AmdahlsLaw2X/6 yrs(12%/yr)Technology&Power:Dennard Scaling20002004200820122016201020016012080400Namometers4.53.62.71.80.90Relative Pow

3、er per nm2|3MLIR Tutorial|August 2022 Next generation open sourcecompiler infrastructure LLVM core projectWell positioned to support this new golden age!MLIR:Multi-Level Intermediate RepresentationMultiple open-source frontend languages(not just ML!)Exascale Fortran,Tensorflow,pytorch-C,HIP/CUDA,SYC

4、LMultiple open-source backendsLLVM,GPU,ACAP,Programmable LogicFrontendBackendMiddle|4MLIR Tutorial|August 2022 DSPUnified TargetsDesign Space Exploration+OptimizationCIRCTPLMLHPCMultiple DomainsEnd-To-End InfrastructureCommunityOpen SourceVendorOpen SourceMLIR-AIEROCmLLVMCPUGPUACAPProprietaryMLIRFut

5、ure Heterogeneous ProgrammingClang|5MLIR Tutorial|August 2022 AgendaMLIR BasicsJacques Pienaar(Google)CPU and GPU Code GenerationHarsh Menon(Nod.AI)BreakML Frontends and TOSASuraj Sudhir(ARM)Hardware Design and CIRCTAndrew Lenhart(SiFive)and John Demme(Microsoft)|6MLIR Tutorial|August 2022 Copyright

6、 and disclaimer 2022 Advanced Micro Devices,Inc.All rights reserved.AMD,the AMD Arrow logo,and combinations thereof are trademarks of Advanced Micro Devices,Inc.Other product names used in this publication are for identification purposes only and may be trademarks of their respec