cs.RONov 19, 2026

Multiple-Camera Tracking of Rigid Objects

Authors: Frédérick Martin, Radu Horaud

Organizations: INRIA Rhône-Alpes and GRAVIR-IMAG 655, av. de l’Europe 38330 Montbonnot Saint Martin, France.

Abstract

In this paper we describe a method for tracking rigid objects using one or several cameras. The tracking process consists of aligning a 3-D model representation of an object with image contours by measuring and minimizing the image error between predicted model points and image contours. The tracker behaves like a visual servo loop where the internal and external camera parameters are updated at each new image acquisition. We study in detail the Jacobian matrix associated with this minimization process in the presence of both point-to-point and point-to-contour matches. We establish the minimal number of matches that are needed as well as the singular configurations leading to a rank-defficient Jacobian matrix. We find a mathematical link between the point-to-point and point-to-contour cases. Based on this link we show that the latter has the same kind of singularities than the former. Moreover, we study multiple camera configurations which optimize the robustness of the method in the presence of single-camera singularities, bad, noisy, or missing data. Extensive experiments done with a complex ship part and with up to three cameras validate the method. In particular we show that the tracker may well be used as a camera calibration procedure.

Figures & tables

Explore similar work

CardsList
  1. Object Pose from 2-D to 3-D Point and Line Correspondences

    Oct 14, 2026Thai Quynh Phong, Radu Horaud, Adnan Yassine +1Object Pose Estimation

  2. Efficient Online 3D Multi-Camera Multi-Object Tracking and Pose Estimation

    Apr 16, 2026Linh Van Ma, Tran Thien Dat Nguyen, Juhua Hu +2Visual Object TrackingObject Pose Estimation

  3. RECALL: Real-Time Recalibration of Multi-Camera Rigs via Learned OEM-Anchored Residuals

    Nov 10, 2026Mario Alberto Tapia de la Cruz, Charalambos PoullisCamera CalibrationMulti-View Geometry