Mixed precision iterative refinement for low-rank matrix and tensor approximations - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Mixed precision iterative refinement for low-rank matrix and tensor approximations

Résumé

We present a new mixed precision algorithm to compute low-rank matrix and tensor approximations, a fundamental task in numerous applications in scientific computing and data analysis. Our algorithm is reminiscent of the iterative refinement framework for linear systems: we first compute a low-rank approximation in low precision and then refine its accuracy by iteratively updating it. We carry out an error analysis of our algorithm which proves that we can reach a high accuracy while performing most of the operations in low precision. We measure the computational cost of the algorithm, which depends on the numerical rank of the input (matrix or tensor) as well as the speed ratio between low and high precision arithmetic. We identify two situations where our method has a strong potential : when the hardware provides fast low precision matrix multiplyaccumulate units, and when the numerical rank of the input is small at low accuracy levels. We confirm experimentally the potential of our algorithm for computing various low-rank matrix and tensor decompositions such as SVD, QR, Tucker, hierarchical Tucker, and tensor-train.
Fichier principal
Vignette du fichier
Paper.pdf (804.75 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04115337 , version 1 (02-06-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04115337 , version 1

Citer

Marc Baboulin, Oguz Kaya, Théo Mary, Matthieu Robeyns. Mixed precision iterative refinement for low-rank matrix and tensor approximations. 2023. ⟨hal-04115337⟩
155 Consultations
120 Téléchargements

Partager

Gmail Facebook X LinkedIn More