硅晶之梦：走向人工智能奇点.pdf

1、InspirationInspirationDharmesh Jani DJOpen Ecosystem and Partnership LeadMeta Inc.Silicon Dreams:Towards the AI SingularityOBJECTS IN THE MIRROR ARE CLOSER THAN THEY APPEARFriday,October 9th,1903Source:https:/en.wikipedia.org/wiki/Flying_Machines_Which_Do_Not_FlyAI SINGULARITYAI SINGULARITYOr Artifi

2、cial General IntelligenceHuman to HumanVisualVerbalPhysicalEmotionalHuman to EntityVisualVerbalPhysicalEmotionalHuman to Entity86 Billion Neurons400 Billion Parameters150T Synapses15T Tokens20W powerData Center ScaleArtificial General Intelligence(AGI)Definition:1.A form of artificial intelligence t

3、hat possesses the ability to understand,learn,and apply knowledge across a wide range of tasks and domains,mirroring the breadth and adaptability of human intelligence.2.The pinnacle of AI development,capable of autonomously solving complex problems,planning,reasoning abstractly,and exhibiting self

4、improvement via constant learning.the concept of AI Singularity,wherein the rapid advancement of AI technologies reaches a critical point,potentially leading to an exponential increase in intelligence surpassing human levels.UniversalUsecasesRecognitionMiningSynthesisUniversal use cases that are dri

5、ve technologyFundamental use cases have recurring theme of recognition,mining and synthesis for learning and knowledge creationGenAI:A Dominant WL in DCs100M Users4 years,6mo2 years,6moGenAI as emerging workload2moAI workloads are fast evolvingRecommendation-DLRM2022exponential changesLlama-65B2023R

6、ecommendation-DLRM2022exponential changesLlama-65B2023Recommendation-DLRM2022Total Compute(PF/s)1400Memory Capacity(TB)110Training Scale(GPUs)1x20 xand we are not done yet.Llama-65BCirca:2023Llama-3Circa:2024OUTPUT MODALITIESINPUT MODALITIESText2D images2D videos3D assets(static)3D assets(movement)M