Is It Still There? Place-Registered Verification Makes VLMs Reliable Scene-Change Detectors
Organizations: Department of Computer Science, Loughborough University, United Kingdom
Abstract
A robot that returns to a space must tell which objects were added, removed or moved since its last visit, while its trajectory, viewpoints and lighting differ between the two visits. We find that multi-image vision-language models (VLMs) fail at this task mainly because they cannot find the place where an object was. A VLM recognises what each frame shows but cannot check whether an object is still at its place in the other capture. It therefore reports objects that only one capture shows and misses most removed and moved objects. We propose STILL, which reformulates change detection as object verification at a registered place. 3D geometry registers the place of each change hypothesis in the other capture, and one VLM answers, from a scene view and a local place view, whether the object is still at that place, trained with supervision of the same form. Under the official SceneDiff protocol, STILL raises the main metric obj/sc AP from 24.0 to 37.8, and from 11.6 to 20.6 on the egocentric kitchen subset without any kitchen training data. It improves F1 by more than 21 points over a VLM fine-tuned on the same annotations and adds only about 11% to the runtime.
Figures & tables
Appendix figures & tables15 assets
Supplementary material from the paper’s appendix.
Appendix
| Version | places found (%) | SD-V AP | SD-K AP | SD-V | SD-K |
|---|---|---|---|---|---|
| locate in the 10-frame layout | 6.8 / 32.2 | 56.4 | 41.9 | -3.5 | -5.1 |
| + zoomed refinement | 12.0 / 48.5 | 54.5 | 41.9 | -2.9 | -4.9 |
| object masked (context only) | 13.1 / 33.2 | 54.9 | 39.4 | -3.4 | -6.9 |
| + changed 4, KC-3D localisation | 19.6 / 50.9 | 53.6 | 39.9 | -3.4 | -4.2 |
| + wide context, second pass | 22.5 / 50.6 | 53.8 | 42.6 | -1.3 | -4.5 |
| + RL, verification reward (v2b) | 21.7 / 51.1 | 53.0 | 42.6 | -2.1 | -4.5 |
| Zero-shot Qwen3-VL-8B | Qwen3.5-9B fine-tuned on the same data | STILL |
|---|---|---|
| ✗ added: mirror (v2 f1) | ✗ removed: yellow bottle (v1 f2) | ✓ added: gray chair (v2 f2, score 0.140) |
| ✗ added: light stand (v2 f1) | ✗ removed: tissue (v1 f3) | ✓ added: white chair (v2 f2, score 0.062) |
| ✗ added: laptop (v2 f3) | ✗ removed: cardboard box (v1 f4) | ✓ added: laptop (v2 f5, score 0.046) |
| ✗ added: power strip (v2 f4) | ✗ removed: toolbox (v1 f4) | added: white chair (v2 f1, score 0.026) |
| ✗ removed: vertical blinds (v1 f1) | ✗ moved: white chair (v1 f5) | added: laptop (v2 f3, score 0.013) |
| ✗ removed: plant (v1 f1) | ✗ removed: curtain (v1 f1) | added: gray chair (v2 f1, score 0.009) |