cs.ROOct 30, 2026

Visual-Inertial RGB-D SLAM with Encoders for a Differential Wheeled Robot

Authors: Zhanghao Zhu, Yutaka Kaizu, Kenichi Furuhashi, Kenji Imou

Organizations: Graduate School of Agricultural and Life Sciences, The University of Tokyo, 1-1-1, Yayoi, Bunkyo-ku, Tokyo 113-8657, Japan

Abstract

Recent years have seen multiple impressive results in visual-inertial odometry (VIO) techniques, by which accurate state estimation can be achieved via the extended Kalman filter (EKF) or nonlinear optimization. However, these approaches are rarely open source, and they tend to fail in real experiments due to the temporary lack of feature points and fast motion. Therefore, in this study, we used encoders to overcome the temporary failure of purely vision-based simultaneous localization and mapping (SLAM). Here, we propose a generative measurement model for encoders and derive an expression for the maximum a posteriori (MAP) estimate and necessary Jacobians for optimization. We use our theory to present a novel tightly coupled visual-inertial encoder RGB-Depth (RGB-D) SLAM system. Tests on our system on an in-house dataset confirmed that our modeling effort led to accurate (with a root mean squared error (RMSE) of approximately 2-7 cm) and robust state estimation in real time. The source code and our dataset containing the encoder information have been published for verification.

Explore similar work

CardsList
  1. Elevator-VIGS: Separating Elevator Motion from Robot Motion in Visual-Inertial Gaussian Splatting SLAM

    Sep 20, 2026Rui Zhou, Zihan Zhu, Wei Zhang +3Simultaneous Localization and Mapping3DGS SLAM

  2. ROFT-VINS: Robust Feature Tracking-based Visual-Inertial State Estimation for Harsh Environment

    Mar 19, 2026Sanghyun Park, Soohee HanVisual-Inertial OdometryVisual Object Tracking

  3. DL-VINS-Factory: A Modular Framework for Learned Visual Front-Ends in Visual-Inertial SLAM

    Jul 2, 2026Shoon Kit Lim, Melissa Jia Ying Chong, Ting Yang LingVisual-Inertial SLAMVisual-Inertial Odometry