ERA: Error-Resistant Autonomous Object Navigation with Predicted Depth
Organizations: Shanghai Jiao Tong University · Tsinghua University
Abstract
Depth and 3D foundation models can predict geometry from RGB images, allowing zero-shot object navigation without a depth sensor. However, when predicted depth is mapped as if it came from a sensor, view-dependent errors accumulate in the map, remove exploration goals, and end the search before the agent can observe and correct them. We propose ERA, a training-free object navigation system that replaces the depth sensor with depth predicted from RGB images and poses. ERA follows a paradigm we call Move with Error: movement provides new views that correct map errors, and the corrected map enables further movement. It realizes this paradigm with revisable occupancy and with exploration from reachable viewpoints, which continues the search when no frontier remains, and verifies the target across views before stopping. On three benchmarks, ERA achieves state-of-the-art performance among training-free methods without depth sensors. Its map and exploration components also raise VLFM's success from 10.8% to 61.7% under the same predicted depth. We further deploy ERA on a real robot.
Figures & tables
| VLFM [ 37 ] | L3MVN [ 38 ] | |||
|---|---|---|---|---|
| Depth | SR | SPL | SR | SPL |
| sensor | 68.2 | 34.5 | 63.2 | 27.5 |
| predicted | 10.8 | 7.5 | 29.2 | 13.7 |
| HM3D v1 | HM3D v2 | MP3D | ||||||
| Method | Depth sensor | Training-free | SR | SPL | SR | SPL | SR | SPL |
| SemExp [ 6 ] | ✓ | ✗ | – | – | – | – | 36.0 | 14.4 |
| ZSON [ 16 ] | ✗ | ✗ | 25.5 | 12.6 | – | – | 15.3 | 4.8 |
| PixNav [ 3 ] | ✗ | ✗ | 37.9 | 20.5 | – | – | – | – |
| ESC [ 42 ] | ✓ | ✓ | 39.2 | 22.3 | – | – | 28.7 | 14.2 |
| L3MVN [ 38 ] | ✓ | ✓ | 50.4 | 23.1 | 63.2 † | 27.5 † | 34.9 | 14.5 |
| Sensor | DA3 | VGGT | ||||
| System | SR | SPL | SR | SPL | SR | SPL |
| VLFM [ 37 ] | 68.2 | 34.5 | 10.8 | 7.5 | 8.3 | 6.1 |
| + revisable occupancy | – | – | 50.7 | 25.8 | 52.4 | 28.5 |
| + reachable viewpoints | – | – | 61.7 | 30.2 | 59.8 | 31.5 |
| L3MVN [ 38 ] | 63.2 | 27.5 | 29.2 | 13.7 | 26.5 | 13.2 |
| + revisable occupancy | – | – | 54.8 | 24.3 | 56.3 | 25.3 |
| Variant | SR | SPL |
|---|---|---|
| ERA (full) | 70.1 | 30.6 |
| w/o free-space clearing | 13.9 | 6.4 |
| frontier goals only | 32.6 | 18.1 |
| w/o target verification | 67.6 | 29.9 |
| With sensor depth | ||
| ERA (full) | 70.7 | 33.7 |
| Runs | System | Success | SR |
|---|---|---|---|
| Three categories | ERA | 11 / 12 | 91.7 |
| Same starts | Base | 0 / 6 | 0 |
| + revisable occupancy | 1 / 6 | 16.7 | |
| + reachable viewpoints | 6 / 6 | 100 |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Map | Frames | Error | Real | Encl. | No frontier |
|---|---|---|---|---|---|
| ApexNav (released) | 32 | 86.6 | 99.8 | 28.6 | 82.6 |
| ApexNav | 16 | 68.2 | 99.1 | 13.9 | 75.3 |
| ApexNav | 8 | 53.5 | 96.9 | 6.0 | 60.9 |
| ApexNav | 4 | 46.0 | 92.3 | 4.9 | 47.4 |
| ApexNav | 2 | 46.2 | 84.5 | 4.7 | 38.1 |
| Revisable occ. | 2 | 24.3 | 88.8 | 0.0 | 45.1 |
| System | Depth | SR | SPL | Seen | Exh. |
|---|---|---|---|---|---|
| VLFM | sensor | 68.2 | 34.5 | 88.4 | 8.0 |
| VLFM | DA3 | 10.8 | 7.5 | 27.1 | 86.9 |
| + relaxed termination | DA3 | 17.7 | 11.0 | 36.9 | 74.2 |
| + revisable occupancy | DA3 | 50.7 | 25.8 | 70.0 | 24.8 |
| + reachable viewpoints | DA3 | 61.7 | 30.2 | 83.3 | 0.0 |
| VLFM | VGGT | 8.3 | 6.1 | 25.4 | 88.6 |
| Parameter | Symbol | Value |
| Depth and reliability | ||
| Keyframes per query | – | up to 5 |
| Keyframe window | – | 40 steps |
| Confidence quantile | 0.15 | |
| Uncertainty offset and slope | , | 0.03 m, 0.05 |
| Conflict tolerance | – | |
| Noise per action | Final pose error | |||||
|---|---|---|---|---|---|---|
| Level | Position | Heading | SR | SPL | ||
| None | – | – | – | – | 70.1 | 30.6 |
| Low | 1% | 0.10 m | 67.3 | 30.1 | ||
| Medium | 2% | 0.29 m | 69.9 | 30.8 | ||
| High | 5% | 0.96 m | 66.9 | 29.2 | ||
| Deployed | Ideal scale | |||||
|---|---|---|---|---|---|---|
| Depth model | Mean | Median | P90 | Mean | Median | P90 |
| DA3 | 11.0 | 7.3 | 21.4 | 4.0 | 2.5 | 9.0 |
| VGGT | 16.7 | 9.8 | 30.3 | 3.3 | 2.6 | 5.2 |
| Variant | SR | SPL | SR |
|---|---|---|---|
| ERA (full) | 70.1 | 30.6 | – |
| w/o target verification | 67.6 | 29.9 | |
| w/o position update | 68.2 | 30.6 | |
| w/o view-keeping approach | 69.3 | 30.4 | |
| w/o stopping checks | 69.8 | 30.8 |
| Run | Target | Start | In view | Path | Stop |
|---|---|---|---|---|---|
| 1 | chair | 6.5 m | ✗ | 6.1 m | 0.7 m |
| 2 | chair | 4.3 m | ✗ | 5.4 m | 0.7 m |
| 3 | trash can | 1.6 m | ✓ | 1.7 m | 0.7 m |
| 4 | trash can | 1.6 m | ✗ | 1.2 m | 0.7 m |
| 5 | chair | 3.7 m | ✓ | 3.4 m | 0.7 m |
| 6 | chair | 3.6 m | ✗ | 2.7 m | 1.0 m |