cs.LGNov 2, 2026

The role of injected noise in diffusion model generalization

Authors: Vincent Emmerling, Felix Günther, David Kappel

Organizations: CITEC, Bielefeld University Bielefeld, Germany

Abstract

Diffusion models trained on distinct datasets can produce highly similar samples when prompted with the same noise input, suggesting that they learn a generalized data distribution. We investigate the role of noise injected during the sampling process, and show that it plays an important role in making or breaking this strong generalization effect. Based on this finding we investigate the robustness of sample similarity to changes in the injected noise, and find that its impact is largest in the sampling regime where broad structure already exists but the precise identity of the sample is not yet determined.

Figures & tables

Explore similar work

CardsList
  1. Beyond Sample Copying: Structural Memorization in Diffusion Models

    Mar 12, 2026Tim Kaiser, Markus KollmannDiffusion Models

  2. Understanding diffusion models requires rethinking (again) generalization

    May 7, 2026Pierre Marion, Yu-Han WuMemorization in Generative ModelsDiffusion Models