Scalable Work-Stealing Load-Balancer for HPC Distributed Memory Systems - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2019

Scalable Work-Stealing Load-Balancer for HPC Distributed Memory Systems

Résumé

Work-stealing schedulers are common in shared memory environments. However, large scale distributed memory usage has been limited to specific ad-hoc implementations preventing a broader adoption. In this paper we introduce a new scalable work-stealing algorithm for distributed memory systems as well as our implementation as the TITUS_DLB library. It is based on Kleinberg’s small-world graph. It allows to control the communication patterns and associated runtime overheads while providing efficient heuristics for victim selection and results routing. To validate our approach, we present the DLB_Bench benchmark which emulates arbitrary workload distribution and imbalance characteristics. Finally, we compare TITUS_DLB to the ad-hoc solution developed for the YALES2 computational fluid dynamics and combustion solver. We achieve up to 54% performance gain over thousands of cores.
Fichier non déposé

Dates et versions

hal-02129605 , version 1 (15-05-2019)

Identifiants

Citer

Clement Fontenaille, Eric Petit, Pablo de Oliveira Castro, Seijilo Uemura, Devan Sohier, et al.. Scalable Work-Stealing Load-Balancer for HPC Distributed Memory Systems. Euro-Par 2018: Parallel Processing Workshops, pp.146-158, 2019, ⟨10.1007/978-3-030-10549-5_12⟩. ⟨hal-02129605⟩
113 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More