Data Redistribution using One-sided Transfers to In-memory HDF5 Files - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

Data Redistribution using One-sided Transfers to In-memory HDF5 Files

Résumé

Outputs of simulation codes making use of the HDF5 file format are usually and mainly composed of several different attributes and datasets, storing either lightweight pieces of information or containing heavy parts of data. These objects, when written or read through the HDF5 layer, create metadata and data IO operations of different block sizes, which depend on the precision and dimension of the arrays that are being manipulated. By making use of simple block redistribution strategies, we present in this paper a case study showing HDF5 IO performance improvements for "in-memory" files stored in a distributed shared memory buffer using one-sided communications through the HDF5 API.
Fichier principal
Vignette du fichier
paper_41.pdf (186.67 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00648396 , version 1 (05-12-2011)

Identifiants

Citer

Jérome Soumagne, John Biddiscombe, Aurélien Esnard. Data Redistribution using One-sided Transfers to In-memory HDF5 Files. Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface, 2011, Santorini, Greece. pp.198--207, ⟨10.1007/978-3-642-24449-0_23⟩. ⟨hal-00648396⟩

Collections

CNRS INRIA INRIA2
184 Consultations
234 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More