Dynamic Placement of Progress Thread for Overlapping MPI Non-Blocking Collectives on Manycore Processor - Archive ouverte HAL
Communication Dans Un Congrès Année : 2018

Dynamic Placement of Progress Thread for Overlapping MPI Non-Blocking Collectives on Manycore Processor

Résumé

To amortize the cost of MPI collective operations, non-blocking collectives have been proposed so as to allow communications to be overlapped with computation. Unfortunately, collective communications are more CPU-hungry than point-to-point communications and running them in a communication thread on a dedicated CPU core makes them slow. On the other hand, running collective communications on the application cores leads to no overlap. To address these issues, we propose an algorithm for tree-based collective operations that splits the tree between communication cores and application cores. To get the best of both worlds, the algorithm runs the short but heavy part of the tree on application cores, and the long but narrow part of the tree on one or several communication cores, so as to get a trade-off between overlap and absolute performance. We provide a model to study and predict its behavior and to tune its parameters. We implemented it in the MPC framework, which is a thread-based MPI implementation. We have run benchmarks on manycore processors such as the KNL and Skylake and get good results for both performance and overlap.
Fichier principal
Vignette du fichier
europar2018.pdf (939.87 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01888255 , version 1 (04-10-2018)

Identifiants

  • HAL Id : hal-01888255 , version 1

Citer

Alexandre Denis, Julien Jaeger, Emmanuel Jeannot, Marc Pérache, Hugo Taboada. Dynamic Placement of Progress Thread for Overlapping MPI Non-Blocking Collectives on Manycore Processor. EURO-PAR 2018 : 24th International European Conferenceon Parallel and Distributed Computing, Aldinucci, Marco, Padovani, Luca, Torquati, Massimo (Eds.), Aug 2018, Turin, Italy. ⟨hal-01888255⟩
182 Consultations
176 Téléchargements

Partager

More