Energy Aware Runtime （EAR） 能否成为欧洲 AI HPC 数据中心能源优化的赌注？.pdf

1、OCP Regional Summit|April 19,2023|Prague,CZCould Energy Aware Runtime(EAR)be the European bet for AI/HPC Data Centerenergy optimization?Julita Corbalan,Associated professor,Barcelona Supercomputing Center(BSC)/Polytechnic University of Catalonia(UPC)Why energy management?Be cost-effective:Operationa

2、l costsBe eco-responsible:Limited resourcesBe energy-efficient:Understand and optimizeSystem software for Energy management in HPC/AI Data CentersEAR includesSystem monitoringJob accountingJob optimizationSystem optimizationEAR targets energy/power but includes many other metrics for understandingWh

3、ats EARMain EAR featuresJob/SystemoptimizationJob accountingand dynamicmonitoringSystemmonitoring Extensible monitoring:Power,CPU frequency,temperature,etc Multiple sources of data:inband IPMI,GPU,RAPL Intel,AMD,NVIDIA Extensible report:MariaDB,Postgres,Sysfs,Prometheus(wip)Basic alerts for power an

4、d temperature Powerful non-intrusive application monitoring and characterization Runtime signatures:Performance and Power metrics CPI,GB/s,Power,Frequency Dynamic CPU/Memory/GPU frequency optimization Node and cluster powercapJob energy optimization processLoop detection/Time guidedRuntime signature

5、computationClasificationApply energypolicies and modelsCPU/Memory/GPU frequencyselectionReport runtimesignaturesbatch myapp.shSpecificFrequencysettingsIOGPU boundGPU idleCPU busy waitingCPU-GPUcomputational100%runtimeNo application modificationsPerformance and power metrics for energy/performance an

6、alysis and optimizationTimePower Node,DRAM,CPU,GPUFrequency:CPU,Memory,GPU Cycles per InstructionsMemory bandwidth(GB/sec)GPU activity:Utilization,Memory utilizationIO MB/secMPI activityRuntime signature includesSystem power/energy controlH