In Situ Statistical Analysis for Parametric Studies - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

In Situ Statistical Analysis for Parametric Studies

Théophile Terraz
Bruno Raffin
Alejandro Ribes
  • Fonction : Auteur
EDF
Yvan Fournier
  • Fonction : Auteur
EDF

Résumé

In situ processing proposes to reduce storage needs and I/O traffic by processing results of parallel simulations as soon as they are available in the memory of the compute processes. We focus here on computing in situ statistics on the results of N simulations from a parametric study. The classical approach consists in running various instances of the same simulation with different values of input parameters. Results are then saved to disks and statistics are computed post mortem, leading to very I/O intensive applications. Our solution is to develop Melissa, an in situ library running on staging nodes as a parallel server. When starting, simulations connect to Melissa and send the results of each time step to Melissa as soon as they are available. Melissa implements iterative versions of classical statistical operations, enabling to update results as soon as a new time step from a simulation is available. Once all statistics ar updated, the time step can be discarded. We also discuss two different approaches for scheduling simulation runs: the jobs-in-job and the multi-jobs approaches. Experiments run instances of the Computational Fluid Dynamics Open Source solver Code_Saturne. They confirm that our approach enables one to avoid storing simulation results to disk or in memory.
Fichier principal
Vignette du fichier
paper.pdf (1.51 Mo) Télécharger le fichier
Vignette du fichier
heat_variance9.jpg (70.53 Ko) Télécharger le fichier
melissa_heat_variance2016.gif (4.11 Mo) Télécharger le fichier
Vignette du fichier
melissa_heat_variance2016.jpg (40.84 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Origine : Fichiers produits par l'(les) auteur(s)
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01383860 , version 1 (21-10-2016)

Licence

Paternité - Pas d'utilisation commerciale

Identifiants

  • HAL Id : hal-01383860 , version 1

Citer

Théophile Terraz, Bruno Raffin, Alejandro Ribes, Yvan Fournier. In Situ Statistical Analysis for Parametric Studies. In Situ Infrastructures for Enabling Extreme-scale Analysis and Visualization (ISAV2016), Nov 2016, Salt Lake City, United States. ⟨hal-01383860⟩
913 Consultations
243 Téléchargements

Partager

Gmail Facebook X LinkedIn More