stat.MLFeb 26, 2026

Partition Function Estimation under Bounded f-Divergence

Authors: Adam Block, Abhishek Shetty

Organizations: Department of Computer Science, Columbia University · Department of Electrical Engineering, Columbia University · MIT

Abstract

We study the statistical complexity of estimating partition functions given sample access to a proposal distribution and an unnormalized density ratio for a target distribution. While partition function estimation is a classical problem, existing guarantees typically rely on structural assumptions about the domain or model geometry. We instead provide a general, information-theoretic characterization that depends only on the relationship between the proposal and target distributions. Our analysis introduces the integrated coverage profile, a functional that quantifies how much target mass lies in regions where the density ratio is large. We show that integrated coverage tightly characterizes the sample complexity of multiplicative partition function estimation and provide matching lower bounds. We further express these bounds in terms of ff-divergences, yielding sharp phase transitions depending on the growth rate of f and recovering classical results as a special case while extending to heavy-tailed regimes. Matching lower bounds establish tightness in all regimes. As applications, we derive improved finite-sample guarantees for importance sampling and self-normalized importance sampling, and we show a strict separation between the complexity of approximate sampling and counting under the same divergence constraints. Our results unify and generalize prior analyses of importance sampling, rejection sampling, and heavy-tailed mean estimation, providing a minimal-assumption theory of partition function estimation. Along the way we introduce new technical tools including new connections between coverage and ff-divergences as well as a generalization of the classical Paley-Zygmund inequality.

Figures & tables

Explore similar work

CardsList
  1. Universal Bounds for Self-Normalized Kullback-Leibler Estimation

    Oct 9, 2026Buu Phan, Lester Mackey, David Alvarez-MelisKullback-Leibler DivergenceImportance Sampling

  2. Ratio Covers of Convex Sets and Optimal Mixture Density Estimation

    Feb 18, 2026Spencer Compton, Gábor Lugosi, Jaouad Mourtada +2Density EstimationMinimax Estimation

  3. Product Monte Carlo: Expectation Under a Product of Densities

    Oct 8, 2026Pietro Carlotti, Sifan Liu, Yuling YaoBayesian Inference