头条新闻——实现自主人工智能.pdf

1、Delivering Sovereign AIChris StephensVP,CTO Groq+3x Chief Data Officer+Faculty Carnegie Mellon+Father of 5AI is Sovereign&GlobalEveryone is Making a PlanWhy?Why?Global AI Trends1.Data&Compute Residency2.AI security standards3.Custom model ecosystems1.Inference speed&cost explosion1234Why?Groq Propri

2、etary Under NDA8https:/ isInferenceThe first phase of AI is training where a model“learns”The power comes from inference,where the learning is used to solve problems1950s2000sAlgorithmsEnabled first mechanical automation of reasoning2010sPRESENTTrainingCreated todays foundation models,but required m

3、assive compute and powerTODAYInferenceAccessible and within reach for every business with predictable costs and clear ROI.FUTUREAI-Native WorldInstant,affordable,intelligent AI woven into daily lifeTHE PROMISE OF AI ISMassive and UnrealizedGroq Proprietary Under NDAOnly the beginningThis will be hug

4、e.Public+private demand is persistent,concurrent,and growing11We all need Inferencemost of the work will be inference,andhow much inference will be you need?If your country ran AI like electricityHow much inference compute would you need per citizen?0.87 tokens per second3T tokens per day50M PeopleT

5、HIS IS A NATION-SCALE INFRASTRUCTURE NEEDEnergy EfficiencyOptimizedOwnershipMinimized Running CostEconomically Efficient12x75%10 x5xGroq v GPU50M People by the NumbersCapExOpExTCOConsumptionGroq Proprietary Under NDAWeve done this twice.3x!Groq Proprietary Under NDAFeb 2025Our First International Ex

6、pansionGroq+Humain“Aramcos tech arm takes the lead as global giants sign deals at LEAP.”Groq Proprietary Under NDAMay 2025Our Next International ExpansionGroq+Bell Canada“Groqs technology delivers the speed and efficiency our customers neednow,not years from now.”Mirko Bibic,President&CEO,BCE and Be