计算机科学
工作量
调度(生产过程)
作业调度程序
分布式计算
模块化设计
超级计算机
数据管理
模式(遗传算法)
操作系统
数据建模
动态优先级调度
大数据
建筑
数据结构
重新使用
数据库管理员
实时计算
软件工程
任务分析
计算机集群
作者
Lingfei Wang,Maria Alejandra Rodriguez,Nir Lipovetzky
出处
期刊:Conference proceedings
[Institute of Electrical and Electronics Engineers]
日期:2025-10-05
卷期号:: 5314-5320
被引量:1
标识
DOI:10.1109/smc58881.2025.11342567
摘要
This paper presents HPCsim, a modular and extensible simulation framework designed to support research in High-Performance Computing workload management. HPCsim focuses on modeling the full scheduling cycle — including job submission, queuing, job selection, resource allocation, execution, and evaluation — using real traces and structured cluster metadata. Most of the existing simulation tools focus on low-level system behavior but lack the abstractions needed for HPC workload management research. They do not natively support multi-resource job models, batch queuing, or system-level scheduling policies. Moreover, their focus on low-level execution details, such as hardware timing, message passing, and architectural interactions, introduces significant computational overhead, making them inefficient for large-scale experiments in high-level workload management, especially in learning-based scheduling where rapid simulation and frequent policy updates are critical. The framework is built based on Slurm, one of the most widely deployed workload managers, and introduces a structured workload data schema encompassing job traces, node configurations, and switch-based topologies. HPCsim is fully compatible with Gymnasium, enabling integration with reinforcement learning workflows, while also supporting other scheduling strategies. We validate HPCsim through experiments using real traces from a GPU-accelerated HPC cluster and demonstrate its utility for comparing scheduling policies and visualizing topology-sensitive placement behavior. HPCsim is released as an open-source tool to facilitate reproducibility and accelerate research in HPC scheduling.
科研通智能强力驱动
Strongly Powered by AbleSci AI