stat.MLDec 29, 2025

Energy-Tweedie: Score meets Score, Energy meets Energy

Authors: Andrej Leban

Organizations: Department of Statistics, University of Michigan, Ann Arbor, MI, United States

Abstract

Denoising and score estimation are classically linked through Tweedie's formula, which relates the posterior mean under Gaussian noise to the Stein score of the noisy marginal. In this work, we extend this perspective beyond Gaussian noise to a broad class of Gibbs (energy-based) noise distributions, with the generalized Gaussian family as an example. We derive the Energy-Tweedie identity: when the denoising posterior is viewed through the lens of scoring rules, the path derivative of a kernel scoring rule defined by the noise potential recovers the Stein score of the noisy marginal. Thus, the familiar correspondence between Gaussian noise, posterior means, squared loss, and Tweedie's formula is lifted to a distributional correspondence between Gibbs noise distributions, full posterior laws, kernel scoring rules, and the Energy-Tweedie identity, which gives a Tweedie-style relation for each noise potential. Among its consequences, this identity gives a posterior-samples-to-score route to score estimation, yields a principled criterion for estimating unknown noise parameters, and enables diffusion-style sampling along user-chosen paths through the noise-parameter space, supplying the score-based perspective on recent generative methods trained with scoring rules.

Figures & tables

Appendix figures & tables27 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Diffusion-based Denoising Beats Vanilla Score Matching in Parameter Estimation: A Theoretical Explanation

    May 21, 2026Benedikt Lütke Schwienhorst, Nadja Klein, Johannes LedererScore MatchingParameter Estimation

  2. Mean-to-Score Discrete Diffusion: Posterior-Mean Denoisers for Score Entropy

    Jul 23, 2026Jingyuan Li, Xiaoyi Jiang, Yixuan Jiang +4Constrained Generative ModelingMarkov Models