Learning Maximally Monotone Operators for Image Recovery - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles SIAM Journal on Imaging Sciences Year : 2021

Learning Maximally Monotone Operators for Image Recovery


We introduce a new paradigm for solving regularized variational problems. These are typically formulated to address ill-posed inverse problems encountered in signal and image processing. The objective function is traditionally defined by adding a regularization function to a data fit term, which is subsequently minimized by using iterative optimization algorithms. Recently, several works have proposed to replace the operator related to the regularization by a more sophisticated denoiser. These approaches, known as plug-and-play (PnP) methods, have shown excellent performance. Although it has been noticed that, under nonexpansiveness assumptions on the denoisers, the convergence of the resulting algorithm is guaranteed, little is known about characterizing the asymptotically delivered solution. In the current article, we propose to address this limitation. More specifically, instead of employing a functional regularization, we perform an operator regularization, where a maximally monotone operator (MMO) is learned in a supervised manner. This formulation is flexible as it allows the solution to be characterized through a broad range of variational inequalities, and it includes convex regularizations as special cases. From an algorithmic standpoint, the proposed approach consists in replacing the resolvent of the MMO by a neural network (NN). We provide a universal approximation theorem proving that nonexpansive NNs provide suitable models for the resolvent of a wide class of MMOs. The proposed approach thus provides a sound theoretical framework for analyzing the asymptotic behavior of first-order PnP algorithms. In addition, we propose a numerical strategy to train NNs corresponding to resolvents of MMOs. We apply our approach to image restoration problems and demonstrate its validity in terms of both convergence and quality.
Fichier principal
Vignette du fichier
main_hal.pdf (7.87 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03087515 , version 1 (23-12-2020)
hal-03087515 , version 2 (20-12-2021)


  • HAL Id : hal-03087515 , version 2


Jean-Christophe Pesquet, Audrey Repetti, Matthieu Terris, Yves Wiaux. Learning Maximally Monotone Operators for Image Recovery. SIAM Journal on Imaging Sciences, 2021, 14 (3), pp.1206-1237. ⟨hal-03087515v2⟩
293 View
128 Download


Gmail Mastodon Facebook X LinkedIn More