叶昌-开发者大会.pptx

1、AIAI时代，嵌入式工程师如何玩转大模型时代，嵌入式工程师如何玩转大模型?叶昌2024.06.011 Gholami,Amir,Zhewei Yao,Sehoon Kim,Coleman Hooper,Michael W.Mahoney,and Kurt Keutzer.“Ai and memory wall.”arXiv preprint arXiv:2403.14123(2024).AI vs.HWAI vs.HWFast AI vs.Slow Fast AI vs.Slow HardwareHardwareCompare to the Moores law,LLMs have an al

2、most crazy increasing speed on memory requirement;For embedded software engineers,CNN is OK,but Transformer is too far;TimeTimeParameter countParameter countcomputing power gapCNNTransformerEmbedded engineeringAI2021(ChatGPT）AI vs.Embedded engineeringAI vs.Embedded engineeringARE WE REALLY STUCKED A

3、T THE CNN PHASE IN NEW AI ERA?ARE WE REALLY STUCKED AT THE CNN PHASE IN NEW AI ERA?Opportunity for embedded software engineersOpportunity for embedded software engineers2 Liang Y,Wu C,Song T,et al.Taskmatrix.ai:Completing tasks by connecting foundation models with millions of apisJ.arXiv preprint ar

4、Xiv:2303.16434,2023.3 Zhao W X,Zhou K,Li J,et al.A survey of large language modelsJ.arXiv preprint arXiv:2303.18223,2023.OpenAI,Microsoft,Google,Meta,Alibaba,Baidu,LLMLLMdesign,trainuseSmart homeRobotManufacturingAuto drivingMedical assistantOpportunity for embedded software engineers:from applicati

5、on viewpointOpportunity for embedded software engineers:from application viewpoint4 https:/ relatedHardware relatedOpportunity for embedded software engineers:from chip viewpointOpportunity for embedded software engineers:from chip viewpoint5 https:/market.us/report/ai-chip-market/AI chip type:CPU,G

6、PU,FPGA,ASIC;All kinds of forms of AI chip will keep fast developing in the coming years synchronously;CPU is flexible and low cost,and ASIC is efficient and power saving.For embedded software engineers,and for RT-ThreadFor embedded software engineers,and for RT-Thread OS,OS,how to make all devices?