SESSION 14 - Digital Techniques for System Adaptation, Power Management and Clocking.pdf

1、ISSCC 2024SESSION 14Digital Techniques for System Adaptation,Power Management and Clocking14.1 A Software-Assisted Peak Current Regulation Scheme to Improve Power-Limited Inference Performance in a 5nm AI SoC 2024 IEEE International Solid-State Circuits Conference1 of 37A Software-Assisted Peak Curr

2、ent Regulation Scheme to Improve Power-Limited Inference Performance in a 5nm AI SoCMonodeep Kar1,Joel Silberman1,Swagath Venkataramani1,Viji Srinivasan1,Bruce Fleischer1,Joshua Rubin1,JohnDavid Lancaster1,Saekyu Lee1,Matthew Cohen1,Matthew Ziegler1,NianzhengCao1,Sandra Woodward2,Ankur Agrawal1,Chin

3、g Zhou1,Prasanth Chatarasi1,Thomas Gooding2,Michael Guillorn1,Bahman Hekmatshoartabari1,Philip Jacob1,Radhika Jain1,Shubham Jain1,Jinwook Jung1,Kyu-Hyoun Kim1,Siyu Koswatta1,Martin Lutz1,Alberto Mannari3,Abey Mathew4,Indira Nair1,Ashish Ranjan1,Zhibin Ren1,Scot Rider5,Thomas Roewer1,David Satterfiel

4、d6,Marcel Schaal1,Sanchari Sen1,Gustavo Tellez1,Hung Tran1,Wei Wang1,Vidhi Zalani1,Jintao Zhang1,Xin Zhang1,Vinay Shah7,Robert Senger1,Arvind Kumar1,Pong-Fei Lu1,Leland Chang11IBM Research,Yorktown Heights,NY,2IBM,Rochester,MN,3IBM Research,Zurich,Switzerland,4IBM,Austin,TX,5IBM,Poughkeepsie,NY,6IBM

5、 Research,Lowell,MA,7IBM,Hursley,United Kingdom14.1 A Software-Assisted Peak Current Regulation Scheme to Improve Power-Limited Inference Performance in a 5nm AI SoC 2024 IEEE International Solid-State Circuits Conference2 of 37Outline IntroductionPower profile of an AI Inference SoC Dynamic power m

6、anagement for AI Control enhancements for AI inference Measurement Results Conclusion14.1 A Software-Assisted Peak Current Regulation Scheme to Improve Power-Limited Inference Performance in a 5nm AI SoC 2024 IEEE International Solid-State Circuits Conference3 of 37AI Inference SoCAn AI SoC deployed