Using Formal Grammars to Predict I/O Behaviors in HPC: the Omnisc'IO Approach - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Parallel and Distributed Systems Year : 2016

Using Formal Grammars to Predict I/O Behaviors in HPC: the Omnisc'IO Approach

Abstract

The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching, and scheduling. In order to further improve these techniques, modeling and predicting spatial and temporal I/O patterns of HPC applications as they run has become crucial. In this paper we present Omnisc'IO, an approach that builds a grammar-based model of the I/O behavior of HPC applications and uses it to predict when future I/O operations will occur, and where and how much data will be accessed. To infer grammars, Omnisc'IO is based on StarSequitur, a novel algorithm extending Nevill-Manning's Sequitur algorithm. Omnisc'IO is transparently integrated into the POSIX and MPI I/O stacks and does not require any modification in applications or higher-level I/O libraries. It works without any prior knowledge of the application and converges to accurate predictions of any N future I/O operations within a couple of iterations. Its implementation is efficient in both computation time and memory footprint.
Fichier principal
Vignette du fichier
paper.pdf (2.77 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01238103 , version 1 (04-12-2015)

Identifiers

Cite

Matthieu Dorier, Shadi Ibrahim, Gabriel Antoniu, Robert Ross. Using Formal Grammars to Predict I/O Behaviors in HPC: the Omnisc'IO Approach. IEEE Transactions on Parallel and Distributed Systems, 2016, ⟨10.1109/TPDS.2015.2485980⟩. ⟨hal-01238103⟩
508 View
265 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More