stat.MLNov 16, 2026

Compressed Simulation-Based Inference: Neural Posterior Estimation for Massive Data via Low-Dimensional Sketches

Authors: Michael Wieck-Sosa, Cosma Rohilla Shalizi

Organizations: Department of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA, USA.

Abstract

Neural posterior estimation (NPE) is a popular Bayesian simulation-based inference (SBI) approach that uses neural networks trained on simulated data--parameter pairs to approximate the posterior given a user-chosen prior. For high-dimensional observations, NPE methods typically approximate the conditional density of the parameter given a user-chosen or learned summary statistic, rather than the entire dataset, due to the curse of dimensionality. However, both approaches face challenges: hand-crafting good summaries for complex models requires considerable effort from scientists, while learning them from massive datasets can be prohibitively computationally expensive. To address these challenges, we propose approximating the conditional density of a parameter given low-dimensional sketches of the data. We show that, for a model with a pp-dimensional parameter, only 2p+12p+1 random sketches are needed for posterior consistency. We compare with state-of-the-art embedding networks for NPE, and we find that our method matches the best embedding network's performance while increasing computational efficiency.

Figures & tables

Explore similar work

CardsList
  1. Mixed neural posterior estimation for simulators with discrete and continuous parameters

    May 13, 2026Jan Boelts, Cornelius Schröder, Jonas Beck +3Simulation-Based InferenceParameter Estimation

  2. Sample-Size Extrapolation in Simulation-Based Inference via Statistical Scaling

    Oct 12, 2026Shiyi Sun, Lei Fang, Geoff K NichollsPosterior ContractionSimulation-Based Inference

  3. High-Dimensional Simulation-Based Inference in Latent Spaces

    Sep 29, 2026Lars Kühmichel, Stefan T. Radev, Bhanu Prasanna Koppolu +3Simulation-Based InferenceNeural Posterior Estimation