cs.CVMar 10, 2026

ConfCtrl: Enabling Precise Camera Control in Video Diffusion via Confidence-Aware Interpolation

Authors: Liudi Yang, George Eskandar, Fengyi Shen, Mohammad Altillawi, Yang Bai, Chi Zhang, Ziyuan Liu, Abhinav Valada

Organizations: University of Freiburg · Huawei Heisenberg Research Center (Munich) · Technical University of Munich · Ludwig Maximilian University of Munich

Abstract

We address the challenge of novel view synthesis from only two input images under large viewpoint changes. Existing regression-based methods lack the capacity to reconstruct unseen regions, while camera-guided diffusion models often deviate from intended trajectories due to noisy point cloud projections or insufficient conditioning from camera poses. To address these issues, we propose ConfCtrl, a confidence-aware video interpolation framework that enables diffusion models to follow prescribed camera poses while completing unseen regions. ConfCtrl initializes the diffusion process by combining a confidence-weighted projected point cloud latent with noise as the conditioning input. It then applies a Kalman-inspired predict-update mechanism, treating the projected point cloud as a noisy measurement and using learned residual corrections to balance pose-driven predictions with noisy geometric observations. This allows the model to rely on reliable projections while down-weighting uncertain regions, yielding stable, geometry-aware generation. Experiments on multiple datasets show that ConfCtrl produces geometrically consistent and visually plausible novel views, effectively reconstructing occluded regions under large viewpoint changes.

Figures & tables

Explore similar work

CardsList
  1. Stabilizing Camera-Controlled Novel View Synthesis at Inference Time

    Sep 3, 2026Prajwal Singh, Arjun Badola, Seema Kumari +2Camera-Controlled Video GenerationVideo Diffusion Models

  2. GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis

    Mar 16, 2026Minjun Kang, Inkyu Shin, Taeyeop Lee +3Camera-Controlled Video GenerationVideo Diffusion Models

  3. PE-Field 4D: Video Generation Models as Canvas

    Jul 17, 2026Yunpeng Bai, Haoxiang Li, Qixing HuangCamera-Controlled Video GenerationDiffusion Transformer