6587 - Innovations in Open-Source AI and Hardware (Meta).pdf

1、FROM IDEAS TO IMPACT!Sr.Director,InfrastructureMetaOla TrudbakkenTODAYMeta is an AI company20061B+Hugging Face downloads100Kderivative models10Xgrowth since 2023Imagine a wise llama exceeding expectationsLlama is leading the Open Source AI movementSegment Anything withJosephine MillerJosephine Mille

2、r,a London-based XR designer,utilizes Metas Segment Anything 2 to transform digital fashion by segmenting outfits in videos,showcasing diverse looks effortlessly,and enhancing creative workflows.Brighthearts Fetal HeartScreeningsBrightHeart,a Paris-based medtech company,uses Metas DINOv2 to improve

3、fetal heart screenings by enhancing early detection of congenital heart defects and accelerating development for rapid FDA clearance.Orakl Oncologys Cancer Treatment AccelerationOrakl Oncology,a spinoff from the Gustave Roussy Institute,leverages Metas DINOv2 to analyze organoid images,improving pat

4、ient response predictions in clinical trials and streamlining drug discovery.European Use Cases for Meta AIAIScaleComputeDataNetworkSoftwareSince 2022,weve seen a major AI infrastructure change6K clusters Job size:128-512 GPUs202216-24K clusters Job size:16K GPUs2023Software InfraPhysical Infrastruc

5、tureLlama2025AI at Meta100K+clusters for LLama 4AI Cluster Size2024202620282030Number of connected accelerators10 xSCALE UP DOMAIN GROWING100 AcceleratorsINCREASED POWER ENVELOP70 KWEFFICIENCY AND SAFETY 100 AcceleratorsINCREASED POWER ENVELOP 0.5 MWEFFICIENCY AND SAFETY+/-400V DCScaleup DomainsTODA

6、Y2030AI Cluster Driven Opportunities for Rack Scale System DesignHigh Power Rack Rack Element“Lego Blocks”Rack Management ControllerSwitch TrayPower SupplyManifolds Accelerator Tray Interconnect BackplaneToR400 kW300 kW200 kW100 kW50 kWTime to Production AI Cluster Design Require