D-FW: Communication efficient distributed algorithms for high-dimensional sparse optimization - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2016

D-FW: Communication efficient distributed algorithms for high-dimensional sparse optimization

Abstract

We propose distributed algorithms for high-dimensional sparse optimization. In many applications, the parameter is sparse but high-dimensional. This is pathological for existing distributed algorithms as the latter require an information exchange stage involving transmission of the full parameter, which may not be sparse during the intermediate steps of optimization. The novelty of this work is to develop communication efficient algorithms using the stochastic Frank-Wolfe (sFW) algorithm, where the gradient computation is inexact but controllable. For star network topology, we propose an algorithm with low communication cost and establishes its convergence. The proposed algorithm is then extended to perform decentralized optimization on general network topology. Numerical experiments are conducted to verify our findings.
No file

Dates and versions

hal-01419048 , version 1 (19-12-2016)

Identifiers

Cite

Jean Lafond, Hoi-To Wai, Éric Moulines. D-FW: Communication efficient distributed algorithms for high-dimensional sparse optimization. International Conference on Acoustics, Speech and Signal Processing , Mar 2016, Shangai, China. pp.4144 - 4148, ⟨10.1109/ICASSP.2016.7472457⟩. ⟨hal-01419048⟩
389 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More