Smoothness Analysis for Probabilistic Programs with Application to Optimised Variational Inference - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Proceedings of the ACM on Programming Languages Year : 2023

Smoothness Analysis for Probabilistic Programs with Application to Optimised Variational Inference

Wonyeol Lee
Hongseok Yang

Abstract

We present a static analysis for discovering differentiable or more generally smooth parts of a given probabilistic program, and show how the analysis can be used to improve the pathwise gradient estimator, one of the most popular methods for posterior inference and model learning. Our improvement increases the scope of the estimator from differentiable models to non-differentiable ones without requiring manual intervention of the user; the improved estimator automatically identifies differentiable parts of a given probabilistic program using our static analysis, and applies the pathwise gradient estimator to the identified parts while using a more general but less efficient estimator, called score estimator, for the rest of the program. Our analysis has a surprisingly subtle soundness argument, partly due to the misbehaviours of some target smoothness properties when viewed from the perspective of program analysis designers. For instance, some smoothness properties, such as partial differentiability and partial continuity, are not preserved by function composition, and this makes it difficult to analyse sequential composition soundly without heavily sacrificing precision. We formulate five assumptions on a target smoothness property, prove the soundness of our analysis under those assumptions, and show that our leading examples satisfy these assumptions. We also show that by using information from our analysis instantiated for differentiability, our improved gradient estimator satisfies an important differentiability requirement and thus computes the correct estimate on average (i.e., returns an unbiased estimate) under a regularity condition. Our experiments with representative probabilistic programs in the Pyro language show that our static analysis is capable of identifying smooth parts of those programs accurately, and making our improved pathwise gradient estimator exploit all the opportunities for high performance in those programs. CCS Concepts: • Software and its engineering → Correctness; Automated static analysis; • Mathematics of computing → Bayesian computation; Variational methods.
Fichier principal
Vignette du fichier
paper.pdf (1.01 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03936759 , version 1 (12-01-2023)

Identifiers

Cite

Wonyeol Lee, Xavier Rival, Hongseok Yang. Smoothness Analysis for Probabilistic Programs with Application to Optimised Variational Inference. Proceedings of the ACM on Programming Languages, 2023, 7, pp.335 - 366. ⟨10.1145/3571205⟩. ⟨hal-03936759⟩
37 View
50 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More