cs.CVFeb 5, 2026

Geometric Observability Index: An Operator-Theoretic Framework for Per-Feature Sensitivity, Weak Observability, and Dynamic Effects in SE(3) Pose Estimation

Authors: Joe-Mei FengSheng-Wei YuHsin-Hsiung Kao

Organizations: Department of Mathematics, Tamkang University, New Taipei, Taiwan · Department of Information Management, Central Police University, Taoyuan, Taiwan

Abstract

We introduce the Geometric Observability Index (GOI), a per-feature sensitivity measure for pose estimation on SE(3). For a Gauss-Newton curvature matrix H=E[JWJ]H=E[J^\top WJ] and a Riemannian metric GG on the Lie algebra, the index is the GG-norm of the influence a single measurement exerts on the estimated pose: GOI(z)=AOO1POφ(z)G\mathrm{GOI}(z)=\|\mathcal{A}_{OO}^{-1}P_O\,\varphi(z)\|_G, where ψ(z)=JWr(z)ψ(z)=J^\top Wr(z) is the score, φ=G1ψ\varphi=G^{-1}ψ its gradient representative, A=G1H\mathcal{A}=G^{-1}H the curvature operator (self-adjoint in the GG-inner product), O=range(A)O=\mathrm{range}(\mathcal{A}) the observable subspace, and AOO\mathcal{A}_{OO} its restriction. This single object (i) equals the norm of the M-estimator influence function, (ii) is governed by the Fisher information, which coincides with the curvature, (iii) exposes weak observability through the smallest eigenvalue λminλ_{\min}, which (iv) also governs finite-sample stability. Operationally the theory cuts both ways. The index is the exact per-measurement attribution: it predicts the true leave-one-out pose shift with log-correlation r=1.00r=1.00. But we also prove that the influence standardized by its inlier null covariance collapses exactly to the classical chi-square residual statistic: residual gating is the leverage-corrected influence test, explaining its robustness from first principles, while raw-influence gating conflates a measurement's information with its harm and over-rejects high-leverage inliers in weakly observable geometry. Experiments on synthetic problems, five TUM RGB-D dynamic sequences, and two KITTI odometry sequences confirm the picture: the two criteria coincide under well-conditioned geometry, and raw-influence gating degrades significantly at cond(H)104\mathrm{cond}(H)\approx 10^4, as the leverage analysis predicts for noise-dominated weak directions. All quantitative claims are validated; code is released.

Explore similar work

May 3, 2026eess.SY

Observability Conditions and Filter Design for Visual Pose Estimation via Dual Quaternions

This paper presents a dual quaternion framework for 6-DOF visual target tracking that addresses key limitations of perspective-n-point (PnnP) solvers: sensitivity to noise and outliers, and inability to propagate estimates through measurement dropouts. A nonlinear observability analysis is performed using a Lie algebraic approach, deriving sufficient conditions for local observability under two sensing modalities: relative position vector and unit vector measurements. For the unit vector case, the classical collinear feature point degeneracy of the perspective-three-point problem is recovered through rank analysis of the observability codistribution matrix, providing a control-theoretic interpretation of a previously geometric result. A dual quaternion Lie group unscented Kalman filter is then developed, directly modeling relative dynamics without assumptions about cooperative measurements or slowly-varying motion. Simulations demonstrate improved pose estimation accuracy and robustness to occlusions compared to an off-the-shelf PnnP solver. Results are broadly applicable to visual-inertial navigation, simultaneous localization and mapping, and PnnP solver development.
Nicholas B. Andrews, Kristi A. Morgansen
Apr 30, 2026cs.CV

Adaptive Geodesic Conformal Prediction for Egocentric Camera Pose Estimation

Egocentric pose estimation for Augmented Reality (AR) and assistive devices requires not just accurate predictions but guaranteed uncertainty regions. Conformal prediction (CP) provides such guarantees without retraining, but we show that standard CP with a single fixed threshold achieves nominal 90% overall coverage while covering only ~60% of the hardest 25% of frames (Q4) -- a ~30 percentage-point conditional coverage gap consistent across 12 participants, 3 predictors, and 3 horizons (108 evaluations) on EPIC-Fields. We further show that a geodesic SE(3) nonconformity score identifies physically harder frames than Euclidean scoring, with only 15-26% Q4 overlap and 2-3x higher ground-truth camera displacement for geodesic Q4 frames. To close the coverage gap, we propose DINOv2-Bridge adaptive CP: a two-stage difficulty estimator trained on a single source participant that transfers cross-participant without any images at test time, improving Q4 coverage from ~0.75 to ~0.93 while maintaining overall coverage at the 90% target.
Aishani Pathak, Hasti Seifi
Aug 9, 2026cs.RO

Protection Levels for Vision-Based Pose Estimation

Vision-based navigation complements Global Navigation Satellite Systems, but certification demands integrity guarantees that account for faulty measurements. Previous work presented a probabilistic computer vision pipeline for runway-based pose estimation with fault detection inspired by Receiver Autonomous Integrity Monitoring. This work extends that framework by deriving protection levels, which provide probabilistic bounds on pose error that remain valid under undetected faults. We present an algorithm for computing protection levels for the nonlinear Perspective-nn-Point problem applied to an aviation setting. The algorithm covers all six degrees of freedom of the aircraft pose (position and orientation) directly. We analyze the effect of measurement redundancy, pixel-level prediction uncertainty, and runway distance on the resulting protection levels. To make the results tangible, we demonstrate tradeoffs in the protection levels on an illustrative runway example.
Olivia Beyer Bruvik, Romeo Valentin, Marc R. Schlichting +2