DiCoDiLe: Distributed Convolutional Dictionary Learning - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Pattern Analysis and Machine Intelligence Year : 2020

DiCoDiLe: Distributed Convolutional Dictionary Learning

DiCoDiLe: Apprentissage Distribué de Dictionnaire Convolutif

Abstract

Convolutional dictionary learning (CDL) estimates shift invariant basis adapted to represent signals or images. CDL has proven useful for image denoising or inpainting, as well as for pattern discovery on multivariate signals. Contrarily to standard patch-based dictionary learning, patterns estimated by CDL can be positioned anywhere in signals or images. Optimization techniques consequently face the difficulty of working with extremely large inputs with millions of pixels or time samples. To address this optimization problem, we propose a distributed and asynchronous algorithm, employing locally greedy coordinate descent and a soft-locking mechanism that does not require a central server. Computation can be distributed on a number of workers which scales linearly with the size of the data. The parallel computation accelerates the parameter estimation and the distributed setting allows our algorithm be used with data that does not fit into a single computer's RAM. Experiments confirm the theoretical scaling properties of the algorithm, allowing us to learn patterns on images from the Hubble Space Telescope containing tens of millions of pixels.
Fichier principal
Vignette du fichier
PAMI_dicodile.pdf (8.2 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02371715 , version 1 (20-11-2019)
hal-02371715 , version 2 (24-11-2020)

Identifiers

  • HAL Id : hal-02371715 , version 2

Cite

Thomas Moreau, Alexandre Gramfort. DiCoDiLe: Distributed Convolutional Dictionary Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, In press. ⟨hal-02371715v2⟩
159 View
215 Download

Share

Gmail Facebook X LinkedIn More