SESSION 34 - Compute-In-Memory.pdf

1、ISSCC 2024SESSION 34Compute-In-Memory34.1:A 28nm 83.23TFLOPS/W POSIT-Based Compute-in-Memory Macro for High-Accuracy AI Applications 2024 IEEE International Solid-State Circuits Conference1 of 34A 28nm 83.23TFLOPS/WPOSIT-Based Compute-in-Memory Macro for High-Accuracy AI Applications Yang Wang1,Xiao

2、long Yang1,Yubin Qin1,Zhiren Zhao1,Ruiqi Guo1,Zhiheng Yue1,Huiming Han1,Shaojun Wei1,Yang Hu1,Shouyi Yin1,21Tsinghua University,Beijing,China2Shanghai AI Laboratory,Shanghai,China 34.1:A 28nm 83.23TFLOPS/W POSIT-Based Compute-in-Memory Macro for High-Accuracy AI Applications 2024 IEEE International

3、Solid-State Circuits Conference2 of 34Outline Background and Motivation Challenges of POSIT-Based CIM Macro Proposed POSITCIM Macro FeaturesBi-directional Regime Processing Codec Critical-bit Pre-compute-and-store CIM ArrayCyclically-alternating Scheduling Adder Tree Measurement and ComparisonConclu

4、sion 34.1:A 28nm 83.23TFLOPS/W POSIT-Based Compute-in-Memory Macro for High-Accuracy AI Applications 2024 IEEE International Solid-State Circuits Conference3 of 34FP-CIM for High-accuracy AI Applications Recent AI tasks are becoming increasingly complex.Complex AI application requires FP-CIM for hig

5、h accuracy.Keyword SpottingFaceRecogn.AIAssistantAutomaticDriveAIGC34.1:A 28nm 83.23TFLOPS/W POSIT-Based Compute-in-Memory Macro for High-Accuracy AI Applications 2024 IEEE International Solid-State Circuits Conference4 of 34Limitation of Conventional FP Data Format If a bullet becomes longer,break

6、it into two bullets Conventional FP cannot achieve high accuracy with low power.Data DistributionFloating Point 16Brain Float 1634.1:A 28nm 83.23TFLOPS/W POSIT-Based Compute-in-Memory Macro for High-Accuracy AI Applications 2024 IEEE International Solid-State Circuits Conference5 of 34Principle of P