计算机科学
节点(物理)
图形处理单元的通用计算
培训(气象学)
并行计算
协处理器
电力需求
超级计算机
功率(物理)
计算机体系结构
操作系统
功率消耗
绘图
工程类
物理
量子力学
气象学
结构工程
作者
Imran Latif,Alex C. Newkirk,Matthew R. Carbone,Arslan Munir,Yuewei Lin,Jonathan Koomey,Xi Yu,Zhihua Dong
出处
期刊:IEEE Access
[Institute of Electrical and Electronics Engineers]
日期:2025-01-01
卷期号:13: 61740-61747
被引量:64
标识
DOI:10.1109/access.2025.3554728
摘要
The expansion of artificial intelligence (AI) applications has driven substantial investment in computational infrastructure, especially by cloud computing providers. Quantifying the energy footprint of this infrastructure requires models parameterized by the power demand of AI hardware during training. In this work, we measured the instantaneous power draw of an 8-GPU NVIDIA H100 HGX node during the training of open-source image classifier (ResNet) and large-language models (Llama2-13b). We characterize power demand for a single node configuration, providing foundational data for future multi-node studies. The maximum observed power draw was approximately 8.4 kW, 18% lower than the manufacturer-rated 10.2 kW, even with GPUs near full utilization. Holding model architecture constant, increasing batch size from 512 to 4096 images for ResNet reduced total training energy consumption by a factor of 4. These findings can inform capacity planning for data center operators and energy use estimates by researchers. Future work will investigate the impact of cooling technology and carbon-aware scheduling on AI workload energy consumption.
科研通智能强力驱动
Strongly Powered by AbleSci AI