Visual-Inertial Odometry

Also known as VIO

Overview

Visual-inertial odometry (VIO) estimates a moving camera’s position and orientation by combining visual constraints with high-rate inertial measurements, enabling metric navigation when GPS is unavailable. Systems commonly use filtering methods such as MSCKF and error-state Kalman filters, or sliding-window and factor-graph optimization with IMU preintegration, feature tracking, and careful initialization. Newer approaches add learned feature tracking or depth, uncertainty-aware weighting, and continuous-time fusion; they are evaluated on benchmarks such as EuRoC, TUM-VI, and KITTI, as well as in specialized environments. A central challenge is improving robustness to poor lighting, dynamic scenes, sensor outages, and degenerate motion while maintaining observability, estimator consistency, and real-time operation on embedded hardware.

Latest papers

64 papers8 papers in the last four weeks, down 38% on the four weeks before. 0.1% of all new papers.

Feb 11, 2026

MDE-VIO: Enhancing Visual-Inertial Odometry Using Learned Depth Priors

Traditional monocular Visual-Inertial Odometry (VIO) systems struggle in low-texture environments where sparse visual features are insufficient for accurate pose estimation. To address this, dense Monocular Depth Estimation (MDE) has been widely explored as a complementary information source. While recent Vision Transformer (ViT) based complex foundational models offer dense, geometrically consistent depth, their computational demands typically preclude them from real-time edge deployment. Our work bridges this gap by integrating learned depth priors directly into the VINS-Mono optimization backend. We propose a novel framework that enforces affine-invariant depth consistency and pairwise ordinal constraints, explicitly filtering unstable artifacts via variance-based gating. This approach strictly adheres to the computational limits of edge devices while robustly recovering metric scale. Extensive experiments on the TartanGround and M3ED datasets demonstrate that our method prevents divergence in challenging scenarios and delivers significant accuracy gains, reducing Absolute Trajectory Error (ATE) by up to 28.3%. Code will be made available.
Feb 2, 2026

Onboard UAV State Estimation for Fast Flights Without External Localization Systems: A2RL Drone Racing Finalist Approach

Fast flights with aggressive maneuvers in cluttered GNSS-denied environments require fast, reliable, and accurate UAV state estimation. In this paper, we present an approach for onboard state estimation of a high-speed UAV using a monocular RGB camera and an IMU. Our approach fuses data from Visual-Inertial Odometry (VIO), an onboard landmark-based camera measurement system, and an IMU to produce an accurate state estimate. Using onboard measurement data, we estimate and compensate for VIO drift through a novel mathematical drift model. State-of-the-art approaches often rely on more complex hardware (e.g., stereo cameras or rangefinders) and use uncorrected drifting VIO velocities, orientation, and angular rates, leading to errors during fast maneuvers. In contrast, our method corrects all VIO states (position, orientation, linear and angular velocity), resulting in accurate state estimation even during rapid and dynamic motion. Our approach was thoroughly validated through 1600 simulations and numerous real-world experiments. Furthermore, we applied the proposed method in the A2RL Drone Racing Challenge 2025, where our team advanced to the final four out of 210 teams and earned a medal.
Jan 2, 2026

DefVINS: Visual-Inertial Odometry for Deformable Scenes

Deformable scenes violate the rigidity assumptions underpinning classical visual--inertial odometry (VIO), often leading to over-fitting to local non-rigid motion or to severe camera pose drift when deformation dominates visual parallax. In this paper, we introduce DefVINS, the first visual-inertial odometry pipeline designed to operate in deformable environments. Our approach models the odometry state by decomposing it into a rigid, IMU-anchored component and a non-rigid scene warp represented by an embedded deformation graph. As a second contribution, we present VIMandala, the first benchmark containing real images and ground-truth camera poses for visual-inertial odometry in deformable scenes. In addition, we augment the synthetic Drunkard's benchmark with simulated inertial measurements to further evaluate our pipeline under controlled conditions. We also provide an observability analysis of the visual-inertial deformable odometry problem, characterizing how inertial measurements constrain camera motion and render otherwise unobservable modes identifiable in the presence of deformation. This analysis motivates the use of IMU anchoring and leads to a conditioning-based activation strategy that avoids ill-posed updates under poor excitation. Experimental results on both the synthetic Drunkard's and our real VIMandala benchmarks show that DefVINS outperforms rigid visual--inertial and non-rigid visual odometry baselines. Our source code and data will be released upon acceptance.
Dec 16, 2025

SUPER - Sensitivity-based Uncertainty-aware Performance and Risk Assessment in Visual Inertial Odometry

This paper presents SUPER (Sensitivity-based Uncertainty-aware PErformance and Risk assessment), a bounded controller that adapts visual measurement information in visual-inertial odometry at runtime. Building on multi-view landmark dispersion from stereo observations, SUPER projects track consistency into pixel space and combines it with the reprojection residual to gate a temporally smoothed, bounded information update. Because the controller operates inside nondeterministic optimizers, we additionally propose an action-verification protocol based on factor-level logs, inactive-instrumented controls, and same-linearization replay. We evaluate SUPER in Ceres and g2o backends on EuRoC, TUM-VI, UMA-VI, and TartanAir under controlled visual corruptions, with a frozen policy and prospective confirmation. SUPER is computationally efficient and selectively active, but does not establish a general accuracy improvement: all 13 split-level confidence intervals cross zero, and effects are heterogeneous across corruption families. The action-verification protocol reliably distinguishes controller-induced state changes from solver variability.