Investigating Dependency Graph Discovery Impact on Task-based MPI+OpenMP Applications Performances - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Investigating Dependency Graph Discovery Impact on Task-based MPI+OpenMP Applications Performances

Résumé

The architecture of supercomputers is evolving to expose massive parallelism. MPI and OpenMP are widely used in application codes on the largest supercomputers in the world. The community primarily focused on composing MPI with OpenMP before its version 3.0 introduced task-based programming. Recent advances in OpenMP task model and its interoperability with MPI enabled fine model composition and seamless support for asynchrony. Yet, OpenMP tasking overheads limit the gain of task-based applications over their historical loop parallelization (parallel for construct). This paper identifies the OpenMP task dependency graph discovery speed as a limiting factor in the performance of task-based applications. We study its impact on intra and inter-node performances over two benchmarks (Cholesky, HPCG) and a proxy-application (LULESH). We evaluate the performance impacts of several discovery optimizations, and introduce a persistent task dependency graph reducing overheads by a factor up to 15 at run-time. We measure 2x speedup over parallel for versions weak scaled to 16K cores, due to improved cache memory use and communication overlap, enabled by task refinement and depth-first scheduling.

Mots clés

Fichier principal
Vignette du fichier
article.pdf (1.53 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04136674 , version 1 (06-07-2023)
hal-04136674 , version 2 (31-08-2023)

Licence

Identifiants

Citer

Romain Pereira, Adrien Roussel, Patrick Carribault, Thierry Gautier. Investigating Dependency Graph Discovery Impact on Task-based MPI+OpenMP Applications Performances. 52nd International Conference on Parallel Processing (ICPP 2023), Aug 2023, Salt Lake City, United States. ⟨10.1145/3605573.3605602⟩. ⟨hal-04136674v1⟩
233 Consultations
193 Téléchargements

Altmetric

Partager

More