cs.CVNov 11, 2026

Learning Motion-Appearance Coupling Priors for Solving Video Inverse Problems

Authors: Anselm Krainovic, Reinhard Heckel

Organizations: School of Computation, Information and Technology Technical University of Munich Munich Center for Machine Learning

Abstract

Reconstructing video from degraded measurements requires priors that capture both frame appearance and temporal dynamics. Many recent approaches combine pretrained image diffusion priors with motion guidance, sidestepping the costs of training large video models. Temporal consistency is often enforced via photometric losses or warping-based constraints, which implicitly assume that motion explains frame-to-frame or latent-to-latent changes up to small deviations, an assumption that fails under occlusions, lighting changes, and non-rigid deformation. In this paper, we propose to learn the coupling between motion and frame appearance as a generative prior. We learn the distribution of motion-induced appearance residuals with a conditional diffusion model and use it to regularize reconstruction in video inverse problems. Our motion-appearance prior acts as a plug-in regularizer for diffusion-based video reconstruction, preserving the benefits of image diffusion models while remaining compatible with existing appearance regularization techniques. Experiments on dynamic video inverse problems show that reconstruction with a learnt motion-appearance coupling prior outperforms photometric-consistency and noise-warping baselines, and that the approach also transfers to cardiac MRI reconstruction.

Figures & tables

Appendix figures & tables18 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Learning Context-Adaptive Motion Priors for Masked Motion Diffusion Models with Efficient Kinematic Attention Aggregation

    Mar 8, 2026Junkun Jiang, Jie Chen, Ho Yin Au +13D Human Motion ReconstructionMasked Diffusion Models

  2. Harnessing Image Diffusion Prior for Photo-Realistic Video Restoration

    Nov 17, 2026Fanghua Yu, Hongyu An, Jinfan Hu +6Video RestorationTemporal Consistency in Video Restoration

  3. InstantViR: Real-Time Video Inverse Problem Solver with Distilled Diffusion Prior

    Nov 18, 2025Weimin Bai, Suzhe Xu, Yiwei Ren +4Diffusion-Based Inverse ProblemsVideo Diffusion Models