Organizations: I3S, CNRS, Université Côte d’Azur 06900 Sophia Antipolis, France · Département d’informatique et d’ingénierie, Université du Québec en Outaouis Gatineau, QC J8X 3X7, Canada · Department of Electrical Engineering, Lakehead University Gatineau, QC J8X 3X7, Canada · Institut Universitaire de France (IUF)
This paper presents a geometric observer for monocular visual-inertial odometry driven by individual optical-flow constraints. For each tracked point, the bearing and its rotationally compensated derivative give a depth-free homogeneous constraint on the body-frame velocity. These constraints enter the innovation of an observer on the gravity-augmented group SE3(3) through a Riccati gain, without estimating depths or reconstructing the direction of motion. The auxiliary gravity state makes the six-dimensional body-frame velocity-gravity error dynamics independent of the attitude correction, and their uniform observability is shown to be equivalent to persistent excitation of a matrix formed from the inertial bearings and their derivatives. Under this condition, the body-frame velocity and gravity errors converge globally and uniformly exponentially, and a gravity-based attitude correction renders the combined velocity, gravity, and reduced-attitude error almost globally asymptotically stable and locally uniformly exponentially stable. Simulations illustrate the excitation condition, recovery from initial errors, and sensitivity to perturbed measurements.
Figures & tables
Figure 1: Optical-flow-based VIO. The onboard camera observes static landmarks, whose apparent image motion is estimated by optical-flow, while the IMU provides the vehicle’s inertial measurements.
Figure 2: Depth-free constraint from one feature with si=0 , viewed in the plane νi⊥ . The circle is a section of the unit bearing sphere; the dashed tangent contains both si and πbivB , which point in opposite directions.
Figure 3: Observer construction on SE3(3) . The measured flow coefficients and the estimated inverse group column form the visual residual. The residual, the Riccati gain, and the estimated gravity column determine the Lie-algebra innovation, which corrects the group state.
Figure 4: Ideal measurements, n=8 : velocity-error norm and minimum eigenvalue of Nδ(t):=δ−1∫t−δtN(s)ds , with δ=4πs (complete windows only). Velocity errors are floored at 10−8m/s for display. Straight translation violates the excitation condition despite the changing attitude.
Figure 5: Recovery on the figure-eight, n=8 : 100 randomized initial states per condition, noise-free and at nominal noise. Curves are pointwise medians, bands empirical 5th–95th percentiles; values below 10−8 are floored. Reduced attitude excludes the unobservable yaw.
Figure 6: Matched-initialization odometry on the figure-eight, n=8 , at nominal and fourfold noise (100 trials each) and without noise. Position error is in the common initial frame, unaligned.
Monocular visual-inertial odometry (VIO) cannot recover metric scale from vision alone; scale must be resolved through inertial measurements. We present a trajectory-dependent observability analysis showing that translational acceleration, produced by curvature, not constant-speed straight-line travel, is the fundamental source that couples scale to the inertial state. This relationship is formalized through the gravity-acceleration asymmetry in the IMU model, from which we derive rank conditions on the observability matrix and propose a lightweight excitation metric computable from raw IMU data. Controlled experiments on a differential-drive robot with a monocular camera and consumer-grade IMU validate the theory, with straight-line motion yielding 9.2% scale error, circular motion 6.4%, and figure-eight motion 4.8%, with excitation spanning four orders of magnitude. These results establish trajectory design as a practical mechanism for improving metric scale recovery.
Hadush Hailu, Bruk Gebregziabher, Siddhartha Gudipudi +1
Computer Science, Maharishi International University, Iowa, USA · Electrical Engineering and Computing, University of Zagreb, Zagreb, Croatia · Computer Science, Iowa State University, Iowa, USA +1
We present AnchorFlow-VIO, an open-source Basalt-derived monocular visual-inertial odometry system, and evaluate a uniform configuration on LaMAria. The system uses one grayscale camera and one IMU, combining factory IMU correction, a fixed timing adjustment, windowed initialization and fixed-template patch tracking. Server evaluation of all 63 test recordings yields control-point scores of 47.2, 37.1, 24.8, 35.1 and 15.6 for Short, Medium, Long, Low light and Moving platform. Test pose recalls at 5 m are 84.6%, 69.1%, 53.9% and 62.9% for the four categories reporting dense recall. On ten training recordings, mean control-point score is 41.38 and all 265,694 image timestamps receive poses, including 204 filled poses. One training platform recording diverges and scores zero. A paired four-record comparison favors fixed over rolling templates on three recordings, while reversing that ranking on the fourth. Increasing feature density also yields mixed results. Ten fresh runs at prospectively fixed 30 s and 120 s offsets expose substantial start sensitivity: a low-light recording scores 6.14 at the earlier start and 42.00 at the later start. These results characterize the limits of the frozen system and show why complete output, feature counts and selected successful runs are insufficient evidence of robust localization. Source code, frozen configuration and reproducible submission tools are publicly available; training ablations are reported separately from the submitted test evaluation.
Conventional visual--inertial odometry (VIO) assumes that observations from cameras and an inertial measurement unit (IMU) are jointly consistent in an inertial reference frame. However, this assumption breaks down under non-inertial conditions. Inside accelerating or rotating carriers, visual observations of the interior reflect carrier-relative motion, while IMU measurements contain additional carrier-induced components, which can compromise conventional fusion. We therefore present NIF-VIO for localization relative to the local environment across inertial and non-inertial reference frames. It adapts visual--inertial fusion based on measurement consistency. As inertial conditions change, early constraint isolation is combined with local reoptimization to limit error propagation before inconsistency confirmation and repair the affected local geometry. Under non-inertial conditions, a compact model with temporally shared parameters is introduced to account for carrier motion while preserving inertial information that complements visual constraints. Experiments on public benchmarks and a self-collected dataset demonstrate that NIF-VIO achieves competitive performance under inertial conditions and improved localization accuracy and availability under non-inertial conditions.
Zichao Shu, Lijun Li, Zhuochen Li +2
Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China · University of Chinese Academy of Sciences, Beijing 100049, China · GravityXR, Ningbo 315040, China +2