Smoothness Analysis for Probabilistic Programs with Application to Optimised Variational Inference - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Proceedings of the ACM on Programming Languages Année : 2023

Smoothness Analysis for Probabilistic Programs with Application to Optimised Variational Inference

Wonyeol Lee
Hongseok Yang

Résumé

We present a static analysis for discovering differentiable or more generally smooth parts of a given probabilistic program, and show how the analysis can be used to improve the pathwise gradient estimator, one of the most popular methods for posterior inference and model learning. Our improvement increases the scope of the estimator from differentiable models to non-differentiable ones without requiring manual intervention of the user; the improved estimator automatically identifies differentiable parts of a given probabilistic program using our static analysis, and applies the pathwise gradient estimator to the identified parts while using a more general but less efficient estimator, called score estimator, for the rest of the program. Our analysis has a surprisingly subtle soundness argument, partly due to the misbehaviours of some target smoothness properties when viewed from the perspective of program analysis designers. For instance, some smoothness properties, such as partial differentiability and partial continuity, are not preserved by function composition, and this makes it difficult to analyse sequential composition soundly without heavily sacrificing precision. We formulate five assumptions on a target smoothness property, prove the soundness of our analysis under those assumptions, and show that our leading examples satisfy these assumptions. We also show that by using information from our analysis instantiated for differentiability, our improved gradient estimator satisfies an important differentiability requirement and thus computes the correct estimate on average (i.e., returns an unbiased estimate) under a regularity condition. Our experiments with representative probabilistic programs in the Pyro language show that our static analysis is capable of identifying smooth parts of those programs accurately, and making our improved pathwise gradient estimator exploit all the opportunities for high performance in those programs. CCS Concepts: • Software and its engineering → Correctness; Automated static analysis; • Mathematics of computing → Bayesian computation; Variational methods.
Fichier principal
Vignette du fichier
paper.pdf (1.01 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03936759 , version 1 (12-01-2023)

Identifiants

Citer

Wonyeol Lee, Xavier Rival, Hongseok Yang. Smoothness Analysis for Probabilistic Programs with Application to Optimised Variational Inference. Proceedings of the ACM on Programming Languages, 2023, 7, pp.335 - 366. ⟨10.1145/3571205⟩. ⟨hal-03936759⟩
33 Consultations
46 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More