F2 - Energy-Efficient AI-Computing Systems for Large-Language Models.pdf

1、ISSCC 2024Forum 2Energy-Efficient AI-Computing Systems for Large-Language ModelsISSCC 2024 Forum 2Energy-Efficient AI-Computing Systems for Large-Language ModelsEric Karl,Intel Corporation,Hillsboro,Oregon,USAJun-Seok Park,Samsung Electronics,Gyeonggi-do,KoreaJae-sun Seo,Cornell Tech,New York,New Yo

2、rk,USAYongpan Liu,Tsinghua University,Beijing,ChinaVivek De,Intel Corporation,Hillsboro,Oregon,USAAlicia Klinefelter,NVIDIA,Durham,North Carolina,USAISSCC 2024-Forum 2:Introduction 2024 IEEE International Solid-State Circuits ConferenceDuring the Forum:8 Talks1 Breakfast,2 Coffee Breaks&1 Lunch Brea

3、k45 minute talk followed by 5 minutes Q&A for each presenterPlease silence your mobile devicesPlease complete your speaker evaluations.Help us improve ISSCC.After the Forum:Forum presentations will be available as downloadable PDFs and streaming videos(not downloadable)to the registered forum attend

4、ees only.The material will not appear in IEEE Xplore or the conference digest.Forum BasicsISSCC 2024-Forum 2:Introduction 2024 IEEE International Solid-State Circuits ConferenceIncredible demand and interest in the varied capabilities of LLMs&Generative AI applicationsChatGPT 100M users in just 2 mo

5、nthsInstagram 2.5 years to 100MTikTok 9 months to 100MOn the Rise of Generative AI Applicationshttps:/ Electrician,from the series PSEUDOMNESIA,2022.Credit:Boris Eldagsen/Co-created with DALLE2/Courtesy of Photo Edition BerlinISSCC 2024-Forum 2:Introduction 2024 IEEE International Solid-State Circui

6、ts ConferenceAgendaStartTitleSpeakerAffiliation8:00 AMBreakfast8:15 AMForum 2 IntroductionEric KarlIntel8:25 AMA Brief History of Large Language Models and a glimpse into the futureLarry HeckGeorgia Tech9:15 AMLLM Training and Inference on GPU&HPC SystemsMohammad ShoeybiNVIDIA10:05 AMBreak10:20 AMCl