cs.RONov 7, 2026

Model-Based Imitation Learning For Monocular Vision-Based Navigation

Authors: Basant Sharma, Prajyot Jadhav, Saqi Hussain Kalan, Arun Kumar Singh

Organizations: Institute of Technology, University of Tartu, Tartu, Estonia.

Abstract

Reliable navigation with a single monocular limited field-of-view camera is challenging because the lack of depth measurements and limited spatial awareness complicate collision checking. Existing approaches to tackle these challenges fall into two categories. Model-based planners can incorporate explicit collision-avoidance guidance which leads to better generalization but are often computationally expensive and require manual tuning of the algorithmic parameters. In contrast, end-to-end approaches trained by imitation learning can be flexible but typically encode safety only implicitly and thus can suffer from high collision rates in novel scenarios. In this paper, we present a middle ground through model-based imitation learning. The model-based part is a learned collision model that can map a sequence of past images and a candidate control sequence to a distribution of worst-case obstacle clearance. This predictive distribution in turn is used to define a collision-risk cost in a trajectory optimization formulation. The imitation component uses human demonstrations to learn scene-dependent balancing of collision risk with other task costs such as goal progress. We also use it to learn the algorithmic parameters (e.g., a warm start) of our optimizer to accelerate the solution process. We show that our approach can demonstrate highly reliable navigation in cluttered environments on robots with different embodiments. We also demonstrate a substantial reduction in collision rate over recent end-to-end and model-based baselines.

Figures & tables

Appendix figures & tables9 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. NavOL: Navigation Policy with Online Imitation Learning

    May 12, 2026Xiaofei Wei, Chun Gu, Li ZhangVisual NavigationRobot Navigation

  2. CanonNav: Disentangling Navigation Behavior from Camera Geometry in Cross-Platform Visual Navigation

    Aug 31, 2026Dong-Wook Kim, Ji-Hoon Hwang, E-In Son +2Visual NavigationSafe Robot Navigation

  3. Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfaces

    Jul 13, 2026Edward Beng Wai Tan, Siew-Kei LamVisual NavigationRobot Policy Learning