cs.LGMar 9, 2026

Sparse Scheduled Diffusion Guidance for Inverse Problems

Authors: Abduragim Shtanchaev, Albina Ilina, Yazid Janati, Arip Asadulaev, Martin Takac, Eric Moulines

Organizations: MBZUAI, Abu Dhabi, United Arab Emirates · Institute of Foundation Models · EPITA, Paris, France

Abstract

Pretrained diffusion models are effective priors for Bayesian inverse problems, but posterior sampling with these priors is often costly because data-consistency guidance is applied throughout the full reverse trajectory. Existing methods have shown that vector-Jacobian products through the denoiser can sometimes be avoided, yet they typically still rely on dense guidance through the full trajectory or expensive inner solves. We introduce Sparse Scheduled Diffusion Guidance for Inverse Problems (Spin), a solver that avoids starting posterior sampling from pure noise. Spin first samples from a posterior time-marginal at an intermediate timestep t∗t_*, and then uses that state as a warm start for a guided reverse diffusion process. At guidance time, instead of enforcing the measurement constraint at every denoising step, Spin applies lightweight corrections only at scheduled timesteps where the denoiser can still clean up artifacts. The resulting procedure decouples prior refinement from data consistency: the prior supplies denoising, while lightweight pixel-space optimization enforces the measurement constraint without backpropagation through the denoiser or decoder. Across linear and nonlinear inverse problems on FFHQ and ImageNet, Spin achieves competitive reconstruction quality with a substantially better runtime--memory profile, running 2x faster on pixel-space models and up to 50x faster on latent diffusion models, with lower memory costs.

Figures & tables

Appendix figures & tables35 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Noise-Adaptive Diffusion Sampling for Inverse Problems Without Task-Specific Tuning

    Apr 18, 2026Yingzhi Xia, Setthakorn Tanomkiattikun, Liangli Zhen +1Markov Chain Monte CarloBayesian Inverse Problems

  2. Provable diffusion-based posterior sampling for linear inverse problems via DDIM

    Jul 21, 2026Yuchen Jiao, Na Li, Changxiao Cai +2Diffusion Models for Image RestorationBayesian Inverse Problems

  3. Triadic Dynamics Aware Diffusion Posterior Sampling for Inverse Problems: Optimizing Guidance and Stochasticity Schedules

    May 26, 2026Junseo Bang, Dong Ju Mun, Hoigi Seo +2Diffusion Model GuidanceDiffusion Timestep Scheduling