Spurious Valleys, NP-hardness, and Tractability of Sparse Matrix Factorization With Fixed Support - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles SIAM Journal on Matrix Analysis and Applications Year : 2022

Spurious Valleys, NP-hardness, and Tractability of Sparse Matrix Factorization With Fixed Support

Abstract

The problem of approximating a dense matrix by a product of sparse factors is a fundamental problem for many signal processing and machine learning tasks. It can be decomposed into two subproblems: finding the position of the non-zero coefficients in the sparse factors, and determining their values. While the first step is usually seen as the most challenging one due to its combinatorial nature, this paper focuses on the second step, referred to as sparse matrix approximation with fixed support. First, we show its NP-hardness, while also presenting a nontrivial family of supports making the problem practically tractable with a dedicated algorithm. Then, we investigate the landscape of its natural optimization formulation, proving the absence of spurious local valleys and spurious local minima, whose presence could prevent local optimization methods to achieve global optimality. The advantages of the proposed algorithm over state-of-the-art first-order optimization methods are discussed.
Vignette du fichier
graphgx2.png (13.96 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
main.pdf (1.58 Mo) Télécharger le fichier
Format : Figure, Image
Origin : Files produced by the author(s)
Origin : Files produced by the author(s)

Dates and versions

hal-03364668 , version 1 (06-10-2021)
hal-03364668 , version 2 (08-10-2021)
hal-03364668 , version 3 (29-11-2021)
hal-03364668 , version 4 (11-07-2022)
hal-03364668 , version 5 (16-11-2022)

Identifiers

Cite

Quoc-Tung Le, Elisa Riccietti, Rémi Gribonval. Spurious Valleys, NP-hardness, and Tractability of Sparse Matrix Factorization With Fixed Support. SIAM Journal on Matrix Analysis and Applications, In press. ⟨hal-03364668v5⟩
403 View
248 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More