cs.CVNov 10, 2026

RECALL: Real-Time Recalibration of Multi-Camera Rigs via Learned OEM-Anchored Residuals

Authors: Mario Alberto Tapia de la Cruz, Charalambos Poullis

Organizations: Immersive and Creative Technologies (ICT) Lab, Concordia University Montreal, Canada

Abstract

Multi-camera rigs ship pre-calibrated from the manufacturer, but their calibration goes stale each time the rig is repositioned, and drifts continuously through wear, thermal cycling, and vibration. Recovering it on-the-fly is hard: classical bundle adjustment needs a fresh multi-view capture and a global optimization whose cost grows with the rig, ruling out real-time use. In this paper we present RECALL, a feed-forward method that recalibrates a movable multi-camera rig in a single pass. From the nominal OEM calibration as an anchor and a brief observation of a known object, it predicts each camera's current intrinsics and extrinsics, written as a shared global rotation of the rig composed with a small per-camera drift. Instead of regressing the calibration in one shot, RECALL refines its estimate with a learned, rig-coupled recurrent operator that reprojects through a differentiable projection and applies attention across the cameras at each step, and solves for the shared rotational gauge in-network with a learned Gauss-Newton step rather than regressing it. Because the ground truth is synthesizable, we train entirely on data generated on-the-fly and need no captured dataset. On a synthetic 10-camera benchmark, RECALL is more accurate than per-camera and rig-coupled joint bundle adjustment (0.26∘0.26^\circ vs 0.47∘0.47^\circ rotation, 5.45.4 vs 8.98.9 px focal) and runs about 105×10^5\times faster at about 0.120.12 ms per rig. On real data (TotalCapture, CMU Panoptic) it matches or beats offline rig-coupled bundle adjustment on absolute and relative rotation while running four-to-five orders of magnitude faster, and on the Panoptic surround rig it also matches the strongest image-only foundation models (VGGT, VGGT-ΩΩ, π3π^3) on relative pose while staying metric and about 15×15\times more accurate in focal length. Code: https://github.com/theICTlab/RECALL-multicam

Figures & tables

Explore similar work

CardsList
  1. Calousel: Extrinsic Calibration of Non-overlapping Multi-camera Systems from Pure Rotation

    Jun 24, 2026Gwanhyeong Song, Chaehyeon Song, Ayoung KimMulti-View GeometryCamera Pose Estimation

  2. Multi-Camera Self-Calibration in Sports Motion Capture: Leveraging Human and Stick Poses

    Apr 19, 2026Fan Yang, Changsoo Jung, Ryosuke Kawamura +1Multi-View GeometryCamera Pose Estimation