6660 - A Blueprint for Scalable AI Computational Infrastructure.pdf

1、James Kelly,OCP FoundationOpen Systems for AI Strategic Initiative Contribution:“A Blueprint for Scalable Infrastructure”A Directional White PaperOpen Systems for AI Strategic Initiative Contribution:“A Blueprint for Scalable Infrastructure”A Directional White PaperJames Kelly,OCP FoundationSummit T

2、rack:Artificial Intelligence(AI)NEW100-page whitepaperFrom Component to AI Cluster:From Component to AI Cluster:Standardized rack architectures supporting power envelopes of 250kW to 1MW Advanced liquid cooling solutions for high-density nodesHigh-voltage,high-efficiency power delivery systemsSuppor

3、t for multiple,evolving scale-up and scale-out fabrics for performanceFull stack development to enable a universal and truly open system for AIComprehensive management frameworks for near-autonomous operationsVision for Future Open Systems for AI ClustersProcessorsHPMChassis/TrayPodClusterFullFull-S

4、tack thinking applied to integrate 3 manageable work areas:Stack thinking applied to integrate 3 manageable work areas:Taking a Holistic System ViewSystems ManagementDC IT InfrastructureDC Physical InfrastructureDC Physical Infrastructure Key ChallengesAI-driven Trends:Chip power is rising More chip

5、s co-located within a rack Higher volume consumed by IT inside the rack Reduced volume inside rack for power,battery,networking and cooling Increase in rack power and power density More stringent serviceability requirements New Technology Challenges:Power delivery to the chip Heat extraction from th

6、e chip,system/racks Rack power outpacing battery PSU improvementsDC Physical Infrastructure Planned Contributions Case studies for cooling of the accelerator chip High power rack(HPR)reference designs Understanding rack high-voltage power trade-offs Reference designs for sidecar rack units Reference