Evaluation of Visual Place Recognition Methods for Image Pair Retrieval in 3D Vision and Robotics
Organizations: Karlsruhe Institute of Technology, Institute of Photogrammetry and Remote Sensing, Karlsruhe, Germany · Delft University of Technology, Department of Intelligent Systems, The Netherlands
Abstract
Visual Place Recognition (VPR) is a core component in computer vision, typically formulated as an image retrieval task for localization, mapping, and navigation. In this work, we instead study VPR as an image pair retrieval front-end for registration pipelines, where the goal is to find top-matching image pairs between two disjoint image sets for downstream tasks such as scene registration, SLAM, and Structure-from-Motion. We comparatively evaluate state-of-the-art VPR families - NetVLAD-style baselines, classification-based global descriptors (CosPlace, EigenPlaces), feature-mixing (MixVPR), and foundation-model-driven methods (AnyLoc, SALAD, MegaLoc) - on three challenging datasets: object-centric outdoor scenes (Tanks and Temples), indoor RGB-D scans (ScanNet-GS), and autonomous-driving sequences (KITTI). We show that modern global descriptor approaches are increasingly suitable as off-the-shelf image pair retrieval modules in challenging scenarios including perceptual aliasing and incomplete sequences, while exhibiting clear, domain-dependent strengths and weaknesses that are critical when choosing VPR components for robust mapping and registration.
Figures & tables
| Method | Backbone | Descriptor size |
|---|---|---|
| CosPlace512 | ResNet18 | 512 |
| CosPlace2048 | ResNet101 | 2048 |
| EigenPlaces512 | ResNet18 | 512 |
| EigenPlaces2048 | ResNet101 | 2048 |
| MixVPR512 | ResNet50 | 512 |
| MixVPR4096 | ResNet50 | 4096 |
| Dataset | Method | P@1 | P@5 | P@10 | R@1 | R@5 | R@10 | mAP@5 | mAP@10 | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PatchNetVLAD | 25.00 | 21.25 | 17.50 | 25.00 | 37.50 | 43.75 | 25.10 | 26.27 | 1.102 | 0.105 | |
| CosPlace512 | 56.25 | 43.75 | 36.88 | 56.25 | 56.25 | 62.50 | 55.62 | 52.69 | 0.133 | 0.014 | |
| CosPlace2048 | 56.25 | 40.00 | 32.50 | 56.25 | 56.25 | 62.50 | 53.33 | 51.54 | 0.645 | 0.070 | |
| EigenPlaces512 | 56.25 | 47.50 | 36.88 | 56.25 | 56.25 | 62.50 | 54.37 | 54.35 | 0.134 | 0.016 | |
| EigenPlaces2048 | 56.25 | 45.00 | 35.62 | 56.25 | 62.50 | 62.50 | 57.19 | 53.67 | 0.649 | 0.070 | |
| T&T | MixVPR512 | 18.75 | 6.25 | 5.00 | 18.75 | 25.00 | 31.25 | 21.88 | 21.56 | 0.130 | 0.012 |
Visual Place Recognition
Visual Place Recognition matches camera observations to mapped places despite changes in viewpoint, lighting, weather, or time.
See all 84 papers