PDI, an approach to decouple I/O concerns from high-performance simulation codes - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2017

PDI, an approach to decouple I/O concerns from high-performance simulation codes

Résumé

High-performance computing (HPC) applications manipulate and store large datasets for scientific analysis, visualization purposes and/or resiliency. Multiple software libraries have been designed for interacting with the parallel file system and in some cases with intermediate storage levels. These libraries provide different level of abstraction and have been optimized for different purposes. The best I/O library for a given usage depends on multiple criteria including the purpose of the I/O, the computer architecture or the problem size. Therefore, to optimize their I/O strategies, scientists have to use multiple API's depending on the targeted execution. As a result, simulation codes contain intrusive and library dependent I/O instructions interwoven with domain instructions. In this paper, we propose a novel interface that transparently manage the I/O aspects and support multiple I/O libraries within the same execution. We demonstrate the low overhead of our interface and perform experiments at scale with the Gysela production code.
Fichier principal
Vignette du fichier
paper.pdf (547.01 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01587075 , version 1 (13-09-2017)

Licence

Identifiants

  • HAL Id : hal-01587075 , version 1

Citer

Corentin Roussel, Kai Keller, Mohamed Gaalich, Leonardo Bautista Gomez, Julien Bigot. PDI, an approach to decouple I/O concerns from high-performance simulation codes. 2017. ⟨hal-01587075⟩
1101 Consultations
393 Téléchargements

Partager

More