stat.MLMar 20, 2026

On the role of memorization in learned priors for geophysical inverse problems

Authors: Ali Siahkoohi, Davide Sabeddu

Organizations: University of Central Florida

Abstract

Learned priors based on deep generative models offer data-driven regularization for seismic inversion, but training them requires a dataset of representative subsurface models -- a resource that is inherently scarce in geoscience applications. Since the training objective of most generative models can be cast as maximum likelihood on a finite dataset, any such model risks converging to the empirical distribution -- effectively memorizing the training examples rather than learning the underlying geological distribution. We show that the posterior under such a memorized prior reduces to a reweighted empirical distribution -- i.e., a likelihood-weighted lookup among the stored training examples. For diffusion models specifically, memorization yields a Gaussian mixture prior in closed form, and linearizing the forward operator around each training example gives a Gaussian mixture posterior whose components have widths and shifts governed by the local Jacobian. We validate these predictions on a stylized inverse problem and demonstrate the consequences of memorization through diffusion posterior sampling for full waveform inversion.

Figures & tables

Explore similar work

CardsList
  1. Priors learned from legacy reconstructions inherit undetectable overconfidence

    Jul 23, 2026Ali Siahkoohi, Sina AlemohammadUncertainty QuantificationBayesian Inverse Problems

  2. A Gibbs posterior sampler for inverse problem based on prior diffusion model

    Feb 11, 2026Jean-François GiovannelliMarkov Chain Monte CarloBayesian Inverse Problems

  3. Latent Diffusion Posterior Sampling with Surrogate Likelihood Guidance for PDE Inverse Problems

    Jun 25, 2026Yuanzhe Wang, Alexandre M. TartakovskyLatent Diffusion ModelsBayesian Inverse Problems