cs.RONov 9, 2026

Incorporating World Models in Decision Making for Next Best View Selection in Active Sensing

Authors: Nikita Sarawgi, Omey M. Manyar, Satyandra K. Gupta

Organizations: GrayMatter Robotics Inc.

Abstract

Efficient robotic 3D reconstruction requires selecting views that contribute new surface measurements with few physical captures. Pretrained world models can guide this choice, but a predicted surface may not produce valid depth measurements under the operating conditions of the deployed sensor. We present a deployment adaptation methodology for next-best-view selection that learns a sensor-return adapter from limited local calibration data while keeping the pretrained predictor fixed. The adapter estimates measurement dropout over each predicted surface, allowing the selection method to favor views likely to fill gaps in the measured reconstruction. In a real-robot experiment with a structured-light sensor, the adapted method achieves higher measured surface coverage with 60% fewer captures than nominal selection. The adapted method recovers a surface region that the nominal method repeatedly targets but fails to measure. These results suggest that robots can reuse pretrained predictive models while adapting their decisions to local operating conditions in data-scarce environments.

Figures & tables

Explore similar work

CardsList
  1. Coverage Optimization for Camera View Selection

    Apr 6, 2026Timothy Chen, Adam Dai, Maximilian Adang +2Active View SelectionNext-Best-View Planning

  2. A Bayesian Approach for Task-Specific Next-Best-View Selection with Uncertain Geometry

    May 6, 2026Jingsen Zhu, Silvia Sellán, Alexander TereninNext-Best-View Planning3D Reconstruction

  3. GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstruction

    Jul 31, 2026Yan Song, Zhihao Li, Chenglong Li +3Next-Best-View Planning3D Reconstruction