cs.RONov 18, 2026

Navigating Robots from Unknown and Uncalibrated Exocentric Cameras via Map Estimation

Authors: Raul Steinmetz, Raphael Druon, Yusuke Yoshiyasu, Akihisa Ohya, Ayanori Yorozu

Organizations: Authors are with the Intelligent Robot Laboratory, University of Tsukuba, Japan. · Authors are with the Computer Vision Research Team, Artificial Intelligence Research Center (AIRC), National Institute of Advanced Industrial Science and Technology (AIST), Japan.

Abstract

Exocentric cameras, mounted on walls or ceilings in indoor environments, offer wider vantage points and are less easily occluded than robot-mounted cameras, making them an appealing alternative for perception in robot navigation algorithms. Previous methods that use such cameras, however, require their pose and intrinsics to be known before deployment, demanding calibration that is time-consuming, requires specialized personnel, and must be repeated whenever a camera moves or a new room is navigated. We propose Robot-centric Obstacle Maps from Unknown and uncalibrated eXocentric cameras (ROMUX), an agent that navigates a robot toward point goals while avoiding obstacles using exocentric cameras that are both uncalibrated, meaning the system does not require their pose or intrinsic information as input, and unknown, meaning it is not fit to a specific camera during training and does not require pre-deployment fine-tuning. We train a cross-view transformer on large-scale simulation data to predict metric robot-centric obstacle maps from exocentric images, without conditioning image tokens on camera information. A small policy trained with Proximal Policy Optimization (PPO) then navigates on the predicted maps toward a goal coordinate relative to the robot. We benchmark our agent in simulation with cameras randomized per episode, and it matches the success rates of a PPO policy that navigates from a robot-mounted camera. Further, ROMUX works with one camera or multiple cameras with partial views and has been transferred zero-shot to a real robot using a camera at varying positions and orientations across various room layouts.

Figures & tables

Explore similar work

CardsList
  1. Robot Navigation and Obstacle Avoidance from Randomly Positioned External Cameras

    Nov 12, 2026Raul Steinmetz, Jair Augusto Bottega, Ayanori Yorozu +1Visual Robot NavigationIndoor Robot Navigation

  2. Robostral Navigate

    Jul 22, 2026Abdelaziz Bounhar, Abhijeet Somani, Aditi Kabra +273Vision-Language NavigationRobot Navigation