cs.CVOct 23, 2026

Distortion-Aware Spatiotemporal Learning for Real-Time Wide-Angle Video Rectification

Authors: Lang Nie, Yihan Yang, Wenbo Nie, Hongguang Zhu, Yang Wei, Chunyu Lin, Bin Xiao

Organizations: CQUPT · BJTU · CityU Macau

Abstract

While wide-angle lenses provide an expanded field of view (FoV), they exhibit severe nonlinear distortion near image boundaries, unnaturally stretching people in these regions. Existing methods mostly focus on facial regions, require high computational costs, and lack temporal modeling, resulting in incomplete full-body rectification, impractical real-time deployment, and noticeable inter-frame shakes. To tackle these issues, we propose FastVC, an efficient full-body video rectification framework driven by distortion-aware spatiotemporal learning. Grounded in lens physics, FastVC introduces a distortion-aware thin-plate spline (DA-TPS) module that nonlinearly remaps control points into a peripheral-dense layout, enabling more accurate geometric fitting without additional computational cost. We further develop a dual-level spatiotemporal learning scheme for causal and stable video rectification. At the model level, neighborhood spatiotemporal attention (NST) aggregates local context and selectively fuses historical features with low overhead. At the optimization level, sparse spatiotemporal supervision applies spatial alignment only to anchor frames, decoupling frame-wise accuracy from temporal stability. Besides, we contribute the first benchmark dataset for wide-angle full-body video correction. Extensive experiments show that FastVC achieves state-of-the-art rectification fidelity and visual stability at 57.0 FPS.

Figures & tables

Explore similar work

CardsList
  1. Rectification Reimagined: A Unified Mamba Model for Image Correction and Rectangling with Prompts

    Dec 21, 2025Linwei Qiu, Gongzhe Li, Xiaozhe Zhang +2All-in-One Image Restoration

  2. Learning Projection-Aware 360-Degree Image Rectification via Dual-Projection Fusion

    Nov 30, 2025Yuhao Shan, Qianyi Yuan, Jingguo Liu +3Parameter Estimation

  3. InstantViR: Real-Time Video Inverse Problem Solver with Distilled Diffusion Prior

    Nov 18, 2025Weimin Bai, Suzhe Xu, Yiwei Ren +4Diffusion-Based Inverse ProblemsVideo Diffusion Models