cs.CVNov 17, 2026

Harnessing Image Diffusion Prior for Photo-Realistic Video Restoration

Authors: Fanghua Yu, Hongyu An, Jinfan Hu, Xinqi Lin, Zhiyuan You, Jian Wang, Hongyang Li, Chao Dong, 

Organizations: The University of Hong Kong · Shenzhen Loop Area Institute · INSAIT, Sofia University “St. Kliment Ohridski” · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · 

Abstract

Recent image generation models produce photo-realistic results with rich details, but transferring their powerful priors to video restoration remains difficult due to temporal inconsistency from stochastic detail synthesis. Existing video restoration methods improve temporal coherence but often sacrifice visual fidelity, leaving a gap between image-level quality and video-level stability. We propose a generative video restoration method that bridges this gap by enabling temporally consistent detail synthesis from image generation priors. Our method combines noise energy rebalancing to suppress structure-disturbing low-frequency stochasticity, motion-aligned noise warping to propagate details along object motion, a self-supervised denoising encoder to mitigate encoder-induced temporal uncertainty, and decoupled temporal attention to model cross-frame dependencies. Together, these components preserve fidelity, enhance fine-grained realism, and maintain temporal consistency. Extensive experiments show that our method substantially outperforms existing video restoration approaches in visual quality, detail richness, and temporal stability.

Figures & tables

Appendix figures & tables16 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Taming Noise Initialization for Zero-shot Video Restoration with Image Diffusion Priors

    Oct 27, 2026Chong Wang, Zixuan Fu, Hao Cheng +3Temporal Consistency in Video RestorationVideo Restoration

  2. DVFace: Spatio-Temporal Dual-Prior Diffusion for Video Face Restoration

    Apr 16, 2026Zheng Chen, Bowen Chai, Rongjun Gao +7Video Diffusion ModelsImage Restoration

  3. FastVR: Efficient Streaming Video Restoration with One-Step Diffusion

    Sep 29, 2026Xiaoxu Chen, Qin Yang, Haoran Bai +2Diffusion TransformerVideo Restoration