Efficient Out-of-core and Out-of-place Rectangular Matrix Transposition and Rotation - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Computers Year : 2021

Efficient Out-of-core and Out-of-place Rectangular Matrix Transposition and Rotation


Modern computers keep following the traditional model of addressing memory linearly for their main memory and out-of-core storage. While this model allows efficient row access to row-major 2D matrices, it introduces complexity to perform efficient column access. A common strategy to improve these accesses is to transpose or rotate the matrix beforehand, thus the accessing complexity is centralized in one transformation operation. Further column accesses are performed as row accesses to the transposed matrix therefore they are optimized to the memory model. In this paper, we propose an efficient solution to perform in-memory or out-of-core rectangular matrix transposition and rotation by using an out-of-place strategy, reading a matrix from an input file and writing the transformed matrix to another (output) file. An originality of our processing algorithm is to rely on an optimized use of the page cache mechanism. It is parallel, optimized by several levels of tiling and independent of any disk block size. We evaluate our approach on five common storage configurations: HDD, hybrid HDD-SSD, SSD, software RAID 0 of several SSDs and NVMe. We show that it brings significant performance improvement over a hand-tuned optimized reference implementation developed by the Caldera company and we confront it against the baseline speed of a straight file copy.
Fichier principal
Vignette du fichier
IEEE_TC_GodardLoechnerBastoul.pdf (603.18 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02960539 , version 1 (08-10-2020)



Paul Godard, Vincent Loechner, Cédric Bastoul. Efficient Out-of-core and Out-of-place Rectangular Matrix Transposition and Rotation. IEEE Transactions on Computers, 2021, 70 (11), pp.7. ⟨10.1109/TC.2020.3030592⟩. ⟨hal-02960539⟩
165 View
631 Download



Gmail Facebook X LinkedIn More