aIOLi: an input/output library for cluster of SMP - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2005

aIOLi: an input/output library for cluster of SMP

Abstract

As clusters use grows, lots of scientific applications (biology, climatology, nuclear physics...) have been rewritten to fully exploit this extra CPU power and storage capacity. This kind of software uses and creates huge amounts of data with typical parallel I/O access patterns. Several issues, like "out-of-core limitation" or "efficient parallel input/output access" already known in a local context (on SMP nodes for example), have to be handled in a distributed environment such as a cluster. Several solutions have been proposed by the scientific community to handle these issues, like parallel file systems or parallel I/O libraries, but their specific API limits portability and requires good knowledge of their internal mechanisms. This paper presents an efficient I/O library, aIOLi, for parallel access to remote storages in SMP clusters. Thanks to the SMP kernel features, our framework provides parallel I/O without inter-processes synchronization mechanisms as well as a simple interface based on the classic UNIX system calls (creat/open/read/write/close). Our experiments show that the aIOLi solution allows achieving performance close to the limits of the remote storage system.

Domains

Other [cs.OH]
No file

Dates and versions

hal-00687248 , version 1 (12-04-2012)

Identifiers

Cite

Adrien Lebre, Yves Denneulin. aIOLi: an input/output library for cluster of SMP. Cluster Computing and the Grid, 2005. CCGrid 2005. IEEE International Symposium on, May 2005, Cardiff, United Kingdom. ⟨10.1109/CCGRID.2005.1558684⟩. ⟨hal-00687248⟩
182 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More