cs.RONov 16, 2026

Polygraph: Large-Scale Multi-Session Trajectory Optimization using Pose Graphs

Authors: Petar Lukovic, Tian Yi Lim, Marc Pollefeys, Pablo Speciale, Hermann Blum, Zuria Bauer

Organizations: ETH Zurich, Switzerland. · Microsoft Spatial AI Lab, Zurich, Switzerland. · University of Bonn and Lamarr Institute for Machine Learning and Artificial Intelligence, Germany.

Abstract

Robots, vehicles, and wearable devices often traverse the same environment many times. Each pass produces its own trajectory from onboard visual or visual-inertial odometry. These trajectories are locally accurate but drift over time and live in unrelated coordinate frames. Turning many such independent trajectories into one globally consistent set is the large-scale multi-session trajectory optimization problem. Existing solutions largely work offline. All sessions must be available up front, one session is fixed as the reference frame, and a single fused map is then optimized. This paper presents Polygraph, a multi-session trajectory optimization pipeline that processes sessions online, one keyframe and one spatial cluster at a time, and never builds a 3D map. Keyframes are grouped into local clusters. When a cluster closes, it is matched against every other session through learned image retrieval. Candidate pairs are verified with sparse feature matching, monocular metric depth, and robust pose estimation. A two-tier consensus gate admits a cross-session edge into the shared pose graph only once independent evidence corroborates it. A cheap incremental solve keeps the graph current, and a periodic robust batch solve prunes outliers. We evaluate Polygraph on stereo outdoor driving, HoloLens and iPad indoor traversals, legged indoor locomotion with a Boston Dynamics Spot, and large-scale outdoor vehicle and handheld routes. Against the closest prior work on the same GPU model, using its reported timings, Polygraph runs faster, commits fewer loop-closure edges, and matches or improves on accuracy.

Figures & tables

Explore similar work

CardsList
  1. Fast Pose Tracking of Rigid Objects with Compact Pose Graph Optimization

    Oct 8, 2026Xiaojie Zhang, Tom Fischer, Viktor Larsson +1Object Pose EstimationPose Graph Optimization

  2. OrthoTrack: Continuous 6-DoF UAV Trajectory Estimation Anchored in Public Orthophotos

    Jun 24, 2026Oussema Dhaouadi, Zuria Bauer, Johannes Michael Meier +3UAV NavigationCamera Pose Estimation

  3. Topology-Aware Decision Making for Multi-Session Localization and Mapping

    Feb 19, 2026Lorenzo Montano-Olivan, Julio A. Placed, Luis Montano +1Simultaneous Localization and MappingMap-Based Localization