1、1|2024 SNIA.All Rights Reserved.Memories are Driving Big Architectural Changes.Hold Onto Your Hats!Presented byJim Handy,Objective AnalysisTom Coughlin,Coughlin Associates,President,IEEE2|2024 SNIA.All Rights Reserved.OutlineChange 1:Emerging Memories ArriveChange 2:Memory DisaggregationChange 3:Pro
2、cessing in MemoryChange 4:ChipletsChange 5:AI Everywhere3|2024 SNIA.All Rights Reserved.OutlineChange 1:Emerging Memories ArriveChange 2:Memory DisaggregationChange 3:Processing in MemoryChange 4:ChipletsChange 5:AI Everywhere4|2024 SNIA.All Rights Reserved.Emerging Memories Bear Strong Similarities
3、Graphic courtesy of Dr.Johannes Mller5|2024 SNIA.All Rights Reserved.What is an“Emerging Memory?”Established Memory Large market:$1B+Worrisome scaling limit Well-understood process Based on silicon alone You know these names:DRAM NAND flash NOR flash SRAM Specialty(FIFO,CAM)Emerging Memory Small Mar
4、ket:0.9910 X fasterIntel Xeon Gold GSI Gem1050100150200250300350SERVER POWER IN WATTS2 X Lower system power Idle APUCPU25|2024 SNIA.All Rights Reserved.Analog Neural NetsOld idea seeing renewed interestInstant Matrix Algebra Single cycle math for entire matrix multiplySimple operation Difficult to s
5、et upA good accelerator to a standard CPUFits emerging memories wellLots of research,but few products26|2024 SNIA.All Rights Reserved.One or More of these May SucceedProspective co-processor to offload tasks from a standard CPUPossibly the main processor in smaller edge applications Low-end CPU or M
6、PU will perform housekeepingCould slow CPU performance increases CPU only needed for less significant&slower tasks More complicated tasks offloaded to the PIM chip Overall cost savings resultPerformance scales with the addition of PIM chips One CPU per 10/100/1,000 PIMs27|2024 SNIA.All Rights Reserv