Gradient-based adaptive importance samplers - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Journal of The Franklin Institute Year : 2023

Gradient-based adaptive importance samplers

Abstract

Importance sampling (IS) is a powerful Monte Carlo methodology for the approximation of intractable integrals, very often involving a target probability distribution. The performance of IS heavily depends on the appropriate selection of the proposal distributions where the samples are simulated from. In this paper, we propose an adaptive importance sampler, called GRAMIS, that iteratively improves the set of proposals. The algorithm exploits geometric information of the target to adapt the location and scale parameters of those proposals. Moreover, in order to allow for a cooperative adaptation, a repulsion term is introduced that favors a coordinated exploration of the state space. This translates into a more diverse exploration and a better approximation of the target via the mixture of proposals. Moreover, we provide a theoretical justification of the repulsion term. We show the good performance of GRAMIS in two problems where the target has a challenging shape and cannot be easily approximated by a standard uni-modal proposal.
Fichier principal
Vignette du fichier
main_GRAMIS_FI_final_arxiv.pdf (1.94 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04165344 , version 1 (18-07-2023)

Licence

Attribution

Identifiers

Cite

Víctor Elvira, Emilie Chouzenoux, Ömer Deniz Akyildiz, Luca Martino. Gradient-based adaptive importance samplers. Journal of The Franklin Institute, 2023, 360 (13), pp.9490-9514. ⟨10.1016/j.jfranklin.2023.06.041⟩. ⟨hal-04165344⟩
43 View
27 Download

Altmetric

Share

Gmail Facebook X LinkedIn More