Gradient Polytope Faces Pursuit for large scale sparse recovery problems
Abstract
Polytope Faces Pursuit is a greedy algorithm that performs Basis Pursuit with similar order complexity to Orthogonal Matching Pursuit. The algorithm adds one basis vector at a time and adopts a path-following approach based on the geometry of the polar polytope associated with the dual Linear Program. Its initial implementation uses the method of Cholesky factorization to update the solution vector at each step, which can be computationally expensive for solving large scale problems as it requires the succesive storage of large matrices. In this paper, we present a different approach using directional updates to estimate the solution vector at each time. The proposed method uses the gradient descent method, reducing the memory requirements and computational complexity. We demonstrate the application of this Gradient Polytope Faces Pursuit algorithm to a source separation problem.
Keywords
linear programming
signal representation
sparse matrices
time-frequency analysis
Cholesky factorization
computational complexity
dual linear program
gradient descent method
gradient polytope faces pursuit
greedy algorithm
large scale sparse recovery
orthogonal matching pursuit
path following approach
polar polytope
gradient methods
greedy algorithms