1、2024.12.102024?30?AI?Y?/2017-2018/2019/2020/2021/2022/2023/?+?+?+?,2024?全?AI?意2024?J?John J.Hopfield?E?Geoffrey E.Hinton?,2024?AI?Trans-former?19561974198019871995201320202021202220232025GPT-3?GPT-4?Chat-GPT2030?AI?Sora?意?70?,2024?2024?,2024?AI?Trans-former?195619741980198719952013202020212022202320

2、25GPT-3?GPT-4?Chat-GPT2030?AIGC?分?AI?Sora?AI?分?2024?1 1?RoBERTa-base 125M(fine-tuned)GPT-2-XL 1.5B(fine-tuned)UnifiedQA 11BGopher 280B(5-shot)Chinchilla 70B(5-shot)PaLMFlan-U-PaLM 540BGPT-4(few-shot)Claude 3 Opus(5-shot)Claude 3.5 Sonnet(5-shot)0.0020.0040.0060.0080.00100.002019?7?26?2020?9?7?2020?1

3、0?7?2022?1?21?2022?3?29?2022?10?5?2022?10?20?2024?3?1?2024?3?4?2024?6?20?MMLU?Massive Multitask Language Understanding,?,2024?;?分?分?分?分?分?分?分?分?分?2 2?VS?AI?OpenAI?NLP?GPT-12018.6?OpenAI?201920202021202220232024GPT-22019.2GPT-32020.5GPT-3.52022.3DALLEDALLE 22023.10DALLE 311?AnthropicChatGPT2023.7?GPT

4、s?2024.2Sora2024.9?John Schulman?Mira Murati?2024.5?Ilya Sutskever?Sam Altman?GPTs?2020.7OpenAI APIMuseNet2019.4Jukebox2021.10OpenAI CodexSearchGPT?Elon Musk?2023.3GPT-4GPT-4o2024.7GPT-4o minio1-previewo1-miniCLIP2022.9WhisperGPT-4V?,?,2024?;?2024.12ChatGPT Proo1?Nvidia,?,2024?;?PC?GPU?40.2%39.4%55.

5、6%78.0%53.3%50.5%46.5%46.3%0.0%50.0%100.0%201920202021202220232024Data Center Processors for Analytics and AIGPUs for ComputersOtherPC+?GPU?GPU?分?分?GeForce RTX 2080GeForce RTX 2080XavierXavierRTX 3090RTX 3090A100A100Grace GPUGrace GPUOmniverse AvatarOmniverse AvatarRTX 4090RTX 4090H100H100Drive Thor

6、Drive ThorH200H200DGX GH200DGX GH200GB200GB200NV SwitchNV Switch?PC?PC?/?/?/?/?AI/?top3?DellHPTeslaAmazonVmwareIBMAmazonMetaAlphabetAmazonAmazonMicrosoftMicrosoftTeslaTeslaMicrosoftAmazonAlphabetMicrosoftMetaAmazon?Microsoft,Google,Meta,?,?,2024?409014019024021?Q4 22?Q1 22?Q222?Q322?Q423?Q1 23?Q223?