In Situ Statistical Analysis for Parametric Studies - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2016

In Situ Statistical Analysis for Parametric Studies

Théophile Terraz
Bruno Raffin
Alejandro Ribes
  • Function : Author
EDF
Yvan Fournier
  • Function : Author
EDF

Abstract

In situ processing proposes to reduce storage needs and I/O traffic by processing results of parallel simulations as soon as they are available in the memory of the compute processes. We focus here on computing in situ statistics on the results of N simulations from a parametric study. The classical approach consists in running various instances of the same simulation with different values of input parameters. Results are then saved to disks and statistics are computed post mortem, leading to very I/O intensive applications. Our solution is to develop Melissa, an in situ library running on staging nodes as a parallel server. When starting, simulations connect to Melissa and send the results of each time step to Melissa as soon as they are available. Melissa implements iterative versions of classical statistical operations, enabling to update results as soon as a new time step from a simulation is available. Once all statistics ar updated, the time step can be discarded. We also discuss two different approaches for scheduling simulation runs: the jobs-in-job and the multi-jobs approaches. Experiments run instances of the Computational Fluid Dynamics Open Source solver Code_Saturne. They confirm that our approach enables one to avoid storing simulation results to disk or in memory.
Fichier principal
Vignette du fichier
paper.pdf (1.51 Mo) Télécharger le fichier
Vignette du fichier
heat_variance9.jpg (70.53 Ko) Télécharger le fichier
melissa_heat_variance2016.gif (4.11 Mo) Télécharger le fichier
Vignette du fichier
melissa_heat_variance2016.jpg (40.84 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Format Figure, Image
Origin Files produced by the author(s)
Origin Files produced by the author(s)
Format Figure, Image
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01383860 , version 1 (21-10-2016)

Licence

Identifiers

  • HAL Id : hal-01383860 , version 1

Cite

Théophile Terraz, Bruno Raffin, Alejandro Ribes, Yvan Fournier. In Situ Statistical Analysis for Parametric Studies. In Situ Infrastructures for Enabling Extreme-scale Analysis and Visualization (ISAV2016), Nov 2016, Salt Lake City, United States. ⟨hal-01383860⟩
919 View
261 Download

Share

Gmail Mastodon Facebook X LinkedIn More