math.STJun 25, 2024

Variance Reduction for Independent Metropolis

Authors: Siran Liu, Petros Dellaportas, Michalis K. Titsias

Abstract

Assume that we would like to estimate the expected value of a function FF with respect to an intractable density ππ, which is specified up to some unknown normalising constant. We prove that if ππ is close enough under KL divergence to another density qq, an independent Metropolis sampler estimator that obtains samples from ππ with proposal density qq, enriched with a variance reduction computational strategy based on control variates, achieves smaller asymptotic variance than i.i.d. sampling from ππ. The control variates construction requires no extra computational effort but assumes that the expected value of FF under qq is analytically available. We illustrate this result by calculating the marginal likelihood in a linear regression model with prior-likelihood conflict and a non-conjugate prior. Furthermore, we propose an adaptive independent Metropolis algorithm that adapts the proposal density such that its KL divergence with the target is being reduced. We demonstrate its applicability in a Bayesian logistic and Gaussian process regression problems and we rigorously justify our asymptotic arguments under easily verifiable and essentially minimal conditions.

Explore similar work

CardsList
  1. Gaussian Invariant Markov Chain Monte Carlo

    Jun 26, 2025Michalis K. Titsias, Angelos Alexopoulos, Siran Liu +1Markov Chain Monte CarloLangevin Dynamics