cs.RODec 16, 2025

SUPER - Sensitivity-based Uncertainty-aware Performance and Risk Assessment in Visual Inertial Odometry

Authors: Johannes A. Gaus, Daniel Häufle, Woo-Jeong Baek

Organizations: Hertie Institute for Clinical Brain Research & Center for Integrative Neuroscience, University of Tübingen, Germany. · Intelligent Process Automation and Robotics Lab (IPR), Karlsruhe Institute of Technology (KIT), Germany, Artificial Intelligence Institute (AIIS), Seoul National University, Republic of Korea.

Abstract

This paper presents SUPER (Sensitivity-based Uncertainty-aware PErformance and Risk assessment), a bounded controller that adapts visual measurement information in visual-inertial odometry at runtime. Building on multi-view landmark dispersion from stereo observations, SUPER projects track consistency into pixel space and combines it with the reprojection residual to gate a temporally smoothed, bounded information update. Because the controller operates inside nondeterministic optimizers, we additionally propose an action-verification protocol based on factor-level logs, inactive-instrumented controls, and same-linearization replay. We evaluate SUPER in Ceres and g2o backends on EuRoC, TUM-VI, UMA-VI, and TartanAir under controlled visual corruptions, with a frozen policy and prospective confirmation. SUPER is computationally efficient and selectively active, but does not establish a general accuracy improvement: all 13 split-level confidence intervals cross zero, and effects are heterogeneous across corruption families. The action-verification protocol reliably distinguishes controller-induced state changes from solver variability.

Figures & tables

Explore similar work

Sep 30, 2026

LBDU-VIO: Learned Bias Dynamics and Uncertainty for Visual-Inertial Odometry with Unreliable Vision

Visual-inertial odometry (VIO) for aerial robots relies on high rate inertial measurement unit (IMU) propagation between visual updates. However, conventional multi state constraint Kalman filters (MSCKFs) use random walk bias assumptions and fixed noise parameters, which can limit robustness when visual information is unreliable. To address this problem, we propose LBDU-VIO, a learning-augmented MSCKF with learned continuous time bias dynamics and an IMU uncertainty model. A neural ordinary differential equation (ODE) models continuous time bias dynamics to propagate the filter's bias states, replacing their random walk model. The IMU uncertainty model predicts motion adaptive measurement noise covariances for covariance propagation. Both models are trained with pose supervision without direct labels. Experiments on real world EuRoC and TUM-VI benchmarks show lower errors than representative visual-inertial baselines, including a 25.1% reduction in mean relative position error compared with S-MSCKF on EuRoC sequences with 10s visual outage.
Nov 15, 2026

A Geometric Observer for Visual-Inertial Odometry using Optical-Flow Constraints

This paper presents a geometric observer for monocular visual-inertial odometry driven by individual optical-flow constraints. For each tracked point, the bearing and its rotationally compensated derivative give a depth-free homogeneous constraint on the body-frame velocity. These constraints enter the innovation of an observer on the gravity-augmented group SE3(3)\mathbb{SE}_3(3) through a Riccati gain, without estimating depths or reconstructing the direction of motion. The auxiliary gravity state makes the six-dimensional body-frame velocity-gravity error dynamics independent of the attitude correction, and their uniform observability is shown to be equivalent to persistent excitation of a matrix formed from the inertial bearings and their derivatives. Under this condition, the body-frame velocity and gravity errors converge globally and uniformly exponentially, and a gravity-based attitude correction renders the combined velocity, gravity, and reduced-attitude error almost globally asymptotically stable and locally uniformly exponentially stable. Simulations illustrate the excitation condition, recovery from initial errors, and sensitivity to perturbed measurements.
Oct 14, 2026

Smart Fusion for Adaptive Visual-IMU Weighting in cuVSLAM Sparse Bundle Adjustment

In cuVSLAM, visual and inertial measurement unit (IMU) residuals are fused in sparse bundle adjustment (SBA) with a weighting fixed by pre-calibrated noise covariances, leaving no mechanism to adapt the visual-inertial balance at runtime. We introduce a scalar α≥1α\geq1 that upscales the visual information matrix relative to the IMU preintegration constraint. Across the candidate set {1.0,2.0,5.0,10.0,20.0}\{1.0,2.0,5.0,10.0,20.0\}, the resulting trajectories form two empirical performance regimes. The IMU-TRUST regime contains α∈{1,2}α\in\{1,2\} near the calibrated baseline, while the VISION-TRUST regime contains α∈{10,20}α\in\{10,20\}. The intermediate value α=5α=5 is treated as a transition case. Differences within each regime are small relative to those observed between the regimes. This structure motivates reducing αα-selection to a binary decision. We train a lightweight Visual Quality Estimator (VQE), implemented as a multilayer perceptron with 914 trainable parameters. It maps a 10-dimensional visual quality feature vector assembled from statistics already maintained by the tracker to a per-SBA regime prediction. The proposed method reduces mean RMSE APE by 27.7%27.7\% and by 14.9%14.9\% under leave-one-out cross-validation (LOOCV) on EuRoC MAV and TUM-VI Room, respectively.