Malleability in Modern HPC Systems: Current Experiences, Challenges, and Future Opportunities - Archive ouverte HAL
Article Dans Une Revue IEEE Transactions on Parallel and Distributed Systems Année : 2024

Malleability in Modern HPC Systems: Current Experiences, Challenges, and Future Opportunities

Alberto Cascajo
Jean-Baptiste Besnard
Dominik Huber
Sonja Happ
David Singh
Rui Machado
Martin Schulz
Simon Pickartz
Tiberiu Rotaru
Heena Sirwani
Jesus Carretero

Résumé

With the increase of complex scientific simulations driven by workflows and heterogeneous workload profiles, managing system resources effectively is essential for improving performance and system throughput, especially due to trends like heterogeneous HPC and deeply integrated systems with on-chip accelerators. For optimal resource utilization, dynamic resource allocation can improve productivity across all system and application levels, by adapting the applications’ configurations to the system’s resources. In this context, malleable jobs, which can change resources at runtime, can increase the system throughput and resource utilization while bringing various advantages for HPC users (e.g., shorter waiting time). Malleability has received much attention recently, even though it has been an active research area for almost two decades [1]. This paper presents the state-of-the-art of malleable implementations in HPC systems, targeting mainly malleability in compute and I/O resources. Based on our experiences, we state our current concerns and list future opportunities for research.

Domaines

Informatique

Dates et versions

hal-04689073 , version 1 (05-09-2024)

Licence

Identifiants

Citer

Ahmad Tarraf, Martin Schreiber, Alberto Cascajo, Jean-Baptiste Besnard, Marc-André Vef, et al.. Malleability in Modern HPC Systems: Current Experiences, Challenges, and Future Opportunities. IEEE Transactions on Parallel and Distributed Systems, 2024, 35 (9), pp.1551-1564. ⟨10.1109/TPDS.2024.3406764⟩. ⟨hal-04689073⟩
5 Consultations
0 Téléchargements

Altmetric

Partager

More