Decide Before You Move: Diffusion-Generated Search Reference for Zero-Shot Open-Vocabulary Object Navigation in Semi-Static Environments
Organizations: School of Information Science and Technology, ShanghaiTech University, Shanghai, China. · the University of Bonn and the Lamarr Institute, Bonn, Germany.
Abstract
Open-world navigation requires a robot to locate a user-specified target in an indoor scene under open-vocabulary queries. Realistic indoor environments are semi-static: walls and furniture largely persist while smaller objects move, relocate, or vanish between visits. Prior-map systems answer queries from object poses recorded at reconstruction time, which expire as soon as objects move, whereas online methods re-derive where to look from current observations every few steps, often through expensive calls to a vision--language model. Assuming that walls and large furniture do not move, we keep their map to plan paths, but use a target--furniture co-occurrence prior to decide where to search. We present PreNav, an ObjectNav framework on semi-static environments. Rather than invoking a vision-language model at each step, PreNav generates a single global search reference before the robot moves: an LLM converts target--furniture co-occurrence into a spatial prior, a conditional diffusion model turns that prior and the persistent structure into an ordered centerline with a band around it, and the robot approaches the target once it is detected online. Experiments on a Gibson ObjectNav benchmark show that PreNav outperforms a strong online baseline under matched structural priors, using a generator trained only on room-level ScanNet++ scenes and applied to floor-level Gibson without fine-tuning. Real-world experiments under object relocation and open-vocabulary queries further validate the approach.
Figures & tables
| Category | Mask R-CNN | SAM 3 | 3DSG oracle |
|---|---|---|---|
| chair | 70 | 73 | 98 |
| oven | 79 | 91 | 96 |
| potted plant | 80 | 54 | 81 |
| refrigerator | 41 | 71 | 75 |
| tv | 54 | 57 | 74 |
| vase | 33 | 34 | 66 |
| Ref. gen. (s) | Mask R-CNN | 3DSG oracle | ||||
|---|---|---|---|---|---|---|
| Method | Mean | P95 | SR | SPL | SR | SPL |
| TSP | 25.705 | 169.893 | 71.0 | 39.6 | 82.7 | 44.0 |
| Diffusion | 0.995 | 1.029 | 70.3 | 39.8 | 82.5 | 46.6 |