T9 - Domain-Specific Accelerators_from hardware to system.pdf

1、SpeakerVideo 2024 IEEE International Solid-State Circuits ConferenceDomain-Specific Accelerators:From Hardware to SystemSophia Shao(ysshaoBerkeley.edu)ISSCC 2024 Tutorial 9February 2,20241 of 72SpeakerVideo 2024 IEEE International Solid-State Circuits ConferenceGrowing Demand in ComputingPublication

2、 dateSep 30,2012Dec 13,2015Sep 8,2018Jun 4,2021Training compute(petaFLOP)1,00010,000100,0001 million10 million100 million1 billion10 billionAlexNetVGG16GoogLeNet/InceptionV1ResNet-152(ImageNet)TransformerAlphaZeroYOLOv3GPTBERT-LargeGPT-2AlphaFoldGPT-3 175B(davinci)DALL-EPaLM(540B)LLaMA(65B)GPT-4PaLM

3、 2Task domainDrawingDrivingGamesLanguageMultimodalOtherSpeechVisionOtherSource:Epoch(2023)OurWorldInData.org/artificial-intelligence CC BYMoores LawScaling2 of 72SpeakerVideo 2024 IEEE International Solid-State Circuits ConferenceSlowing Supply in ComputingDiminishing Efficiency Returns:Achieving ef

4、ficiency gains becomes more challenging as technology advances to smaller nodes.Diminishing Cost Benefits:The traditional cost benefits with packing more transistors into a chip are also diminishing with advanced nodes.3 of 72SpeakerVideo 2024 IEEE International Solid-State Circuits ConferenceSlowin

5、g Supply in ComputingMarvellDiminishing Efficiency Returns:Achieving efficiency gains becomes more challenging as technology advances to smaller nodes.Diminishing Cost Benefits:The traditional cost benefits with packing more transistors into a chip are also diminishing with advanced nodes.3 of 72Spe

6、akerVideo 2024 IEEE International Solid-State Circuits ConferenceSlowing Supply in ComputingGrowing Demand in Computing4 of 72SpeakerVideo 2024 IEEE International Solid-State Circuits ConferenceSlowing Supply in ComputingGrowing Demand in Computing5 of 72SpeakerVideo 2024 IEEE International Solid-St