Transparent overlapping of blocking communication in MPI applications - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

Transparent overlapping of blocking communication in MPI applications

Résumé

With the growing number of cores and fast network like Infiniband, one of the keys to performance improvement in MPI applications is the ability to overlap CPU-bound computation with network communications. While this can be done manually, this is often a complex and error prone procedure. We propose an approach that allows MPI blocking communication to act as nonblocking communication until data are needed, increasing the potential for communication and computation overlapping. Our approach, COMMMAMA, uses a separate communication thread to which communications are offloaded and a memory protection mechanism to track memory accesses in communication buffers. This guarantees both progress for these communications and the largest window during which communication and computation can be processed in parallel. This approach also significantly reduces the hassle for programmers to design MPI applications as it reduces the need to forecast when nonblocking communication should be waited.
Fichier principal
Vignette du fichier
hpcc_final.pdf (258.3 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03007204 , version 1 (16-11-2020)

Licence

Identifiants

Citer

Alexis Lescouet, Élisabeth Brunet, François Trahay, Gaël Thomas. Transparent overlapping of blocking communication in MPI applications. HPCC2020: 22nd IEEE International Conference on High-Performance Computing and Communications, Dec 2020, Yanuca Island (online), Fiji. pp.744-749, ⟨10.1109/HPCC-SmartCity-DSS50907.2020.00097⟩. ⟨hal-03007204⟩
105 Consultations
346 Téléchargements

Altmetric

Partager

More