用于任务关键型边缘 AI 的 MENTIUM 混合计算与 SYNOPSYS 合作.pdf

1、Mentium Technologies All Rights Reserved 9/13/20241 2024 Mentium Technologies Inc.MENTIUM HYBRID COMPUTATION FOR MISSION-CRITICAL EDGE AI,PARTNERING WITH SYNOPSYSMirko Prezioso,Co-founder&CEO,Mentium TechnologiesSeptember 10,2024 2024 Mentium Technologies Inc.Mentium Technologies History Spin-off fr

2、om UCSB In 2015,we demonstrated the first DNN in-memory computing in an integrated array.Mentium,an AI Co-processors Startup,was founded in 20172 2024 Mentium Technologies Inc.Cloud-level AI on Edge Systems for mission-critical AI applicationsSub 1W regionHybrid architecture allows 10 x larger model

3、s AI capabilities(accuracy,complexity,reliability)Enhancing existing systems by easy integration No competition with SoC manufacturersSaves customers millions of dollars to re-use existing system softwareRad-hard option developed with NASA no other solution Military&Police BodycamsHigh-EndSmart Secu

4、ritySpace EdgeRoboticsADASAR/VRGenAIMobileExpanding toDronesMentium Today3 2024 Mentium Technologies Inc.References:a)COCO test-dev Benchmark(Object Detection)|Papers With Codeb)docs/en master weixin_47013828/myrep GitCodec)How Hugging Face achieved a 2x performance boost for Question Answering c)wi

5、th DistilBERT in Node.js The TensorFlow Blogd)1810.00736(arxiv.org)a)c)d)Neural Network Capacity“Inference quality”is proportional toNeural Network sizeAI Inference is only as good as your Neural Networka)b)d)4 2024 Mentium Technologies Inc.Analog in-memory computing is greatirrriiLarge DNN model is

6、suesAnalog in-memory advantagesSolved?On-chip storageGreat storage density advantage over SRAM Memory BottleneckStorage and computing in the same physical device ThroughputMassively parallel So,problem solved,right?No!neuroni+wi1wi2wijri1i2i3xxx5 2024 Mentium Technologies Inc.but not perfect.SRAMPro