cs.CVNov 6, 2026

FANO: Anchored Forward-Noise Optimization for Diffusion Inverse Problems

Authors: Shilong Han, Hongxia Wang

Organizations: College of Science, National University of Defense Technology

Abstract

Pre-trained diffusion models have become a widely adopted zero-shot prior for image inverse problems, among which annealed decoupling methods achieve leading reconstruction performance on nonlinear tasks. We find, however, that annealed methods that directly optimize the denoiser input xtx_t exhibit radial drift in later layers: within-layer optimization drives the noise-component norm of xtx_t away from its typical value, pushing the denoiser out of its high-performance regime and degrading reconstruction quality. To address this, we propose FANO (Anchored Forward-Noise Optimization). At each annealing layer, FANO fixes the previous denoiser estimate as an anchor and optimizes only the forward noise ee, whose distribution is known, instead of xtx_t, thereby preserving the forward-diffusion structure of the denoiser input. The standard Gaussian prior on ee concentrates its norm near the typical value, and deviations degrade denoiser performance. We accordingly decompose ee in polar coordinates into a direction and a radial magnitude, and apply a soft potential to regulate the radius, keeping xtx_t in the high-density region of the forward distribution. On multiple linear and nonlinear inverse problems, FANO matches the strongest current baselines on linear tasks and achieves consistent improvements on nonlinear tasks.

Figures & tables

Appendix figures & tables12 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Sparse Scheduled Diffusion Guidance for Inverse Problems

    Mar 9, 2026Abduragim Shtanchaev, Albina Ilina, Yazid Janati +3Diffusion-Based Inverse ProblemsDiffusion Posterior Sampling

  2. Compression Asymmetry and Trajectory Binding in Noise-Anchored Diffusion Inversion

    Jul 8, 2026Yongseong Park, Joeun Kim, HoEun Kim +1Diffusion Model InversionDiffusion-Based Inverse Problems

  3. Exact Posterior Score Estimation for Solving Linear Inverse Problems

    Jun 15, 2026Abbas Mammadov, Ozgur Kara, Kaan Oktay +5Diffusion Models for Image RestorationDiffusion-Based Inverse Problems