Analog In-memory computing with multilevel memristive devices for high performance computing - Glenn Ge - TetraMem Inc.pdf

1、Glenn Ge,Co-founder&CEOTetraMem Inc.Analog In-memory computing with multilevel memristive devices for high performance computing The AI and AI Chip MarketSource:ARK Big Idea 2022 AI applications will add$30 trillion to the global equity market capitalization during the next 2 decades and AI chip mar

2、ket will reach$150 billion at 2030 with 30%CAGR3Source:Global X 2023 OpenAIs Sora Ignites Increased Computing Demand41 minute of OpenAIs Sora video may take over an hour to generate=Without new efficient computing,we need 18,460,000 A100 to generate the videos daily watched in TikTok*.*Source:Video

3、picture from OpenAI&analysis from Minsheng Securities,2024Customer Pain-points For Energy Efficiency AMDs plenary talk,ISSCC 2023 AMDs plenary talk by Dr.Lisa Su,ISSCC 2023 In-Memory Computing(IMC)Solution For AI ComputingALUCache Memory(L1/L2/L3)ALUALUALUALUALUALUALUDRAM MemoryTraditional von Neuma

4、nn Architecture IMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC UnitIMC Architecture Data processed in the same physical location as it is stored with minimum intermediate data movement&storage=low power consumption Massive

5、parallel computing process by cross-bar array architecture with device-level grain cores=high throughput Computing by physical laws(Ohms law and Kirchhoffs current law)=low latency Data movementSuperior architecture,but right device is the keyTang etc.2019 Symposium on VLSI CircuitsNote:nvCIM=nonvol

6、atile compute in memory,PE:processing element SRAM:Very fast and little energy(pJ level)for data movement but very limited size(few K to a few hundred M Byte on chip)DRAM:Large memory size(GB)but high energy(1000 pJ level)and slow speed(ns)Computing Memory:Memory Device with Special Attributes For C