MOGeo: Beyond One-to-One Cross-View Object Geo-localization
Organizations: College of Computer Science and Software Engineering, Shenzhen University
Abstract
Cross-View Object Geo-Localization (CVOGL) aims to locate an object of interest in a query image within a corresponding satellite image. Existing methods typically assume that the query image contains only a single object, which does not align with the complex, multi-object geo-localization requirements in real-world applications, making them unsuitable for practical scenarios. To bridge the gap between the realistic setting and existing task, we propose a new task, called Cross-View Multi-Object Geo-Localization (CVMOGL). To advance the CVMOGL task, we first construct a benchmark, CMLocation, which includes two datasets: CMLocation-V1 and CMLocation-V2. Furthermore, we propose a novel cross-view multi-object geo-localization method, MOGeo, and benchmark it against existing state-of-the-art methods. Extensive experiments are conducted under various application scenarios to validate the effectiveness of our method. The results demonstrate that cross-view object geo-localization in the more realistic setting remains a challenging problem, encouraging further research in this area.
Figures & tables
| Data name | Split | Query | Reference | Instances |
|---|---|---|---|---|
| CMLocation-V1 | total | 12760 | 12760 | 31944 |
| training | 8371 | 8371 | 20931 | |
| validation | 2093 | 2093 | 5209 | |
| test | 2296 | 2296 | 5804 | |
| CMLocation-V2 | total | 12760 | 12760 | 31944 |
| training | 8371 | 8371 | 20931 |
| Method | Test | Validation | ||||||
|---|---|---|---|---|---|---|---|---|
| [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | |
| CMLocation-V1 | ||||||||
| FRGeo [ 31 ] | 8.06 | 1.05 | 2.74 | 0.17 | 7.20 | 0.92 | 2.53 | 0.05 |
| GeoDTR+ [ 34 ] | 7.44 | 0.45 | 3.83 | 0.17 | 8.62 | 0.77 | 4.30 | 0.53 |
| Sample4Geo [ 4 ] | 29.19 | 2.31 | 16.46 | 1.44 | 30.68 | 2.36 | 19.10 | 1.81 |
| DetGeo [ 24 ] | 56.03 | 55.00 | 39.68 | 38.32 | 56.29 | 55.33 | 39.80 | 38.93 |
| Method | Test | Validation | ||
|---|---|---|---|---|
| [email protected] | [email protected] | [email protected] | [email protected] | |
| CVOGL-SVI | ||||
| CVM-Net [ 7 ] | 4.73 | 0.51 | 5.09 | 0.87 |
| TransGeo [ 38 ] | 21.17 | 2.88 | 21.67 | 3.25 |
| FRGeo [ 31 ] | 8.12 | 1.31 | 7.80 | 0.87 |
| GeoDTR [ 35 ] | 32.37 | 6.06 | 31.53 | 5.31 |
| Method | Validation | |||||
|---|---|---|---|---|---|---|
| I ( ) | II ( ) | III ( ) | ||||
| [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | |
| CMLocation-V1 | ||||||
| DetGeo | 61.03 | 59.90 | 49.03 | 48.23 | 40.58 | 40.34 |
| VAGeo | 62.97 | 62.30 | 47.74 | 47.54 | 42.27 | 42.27 |
| Ours | 67.22 | 66.07 | 56.74 | 56.34 | 53.14 | 52.90 |
| Method | Test | Validation | ||
|---|---|---|---|---|
| [email protected] | [email protected] | [email protected] | [email protected] | |
| CVOGL-Drone | ||||
| Ours | 66.39 | 59.71 | 65.11 | 58.72 |
| w/o | 65.98 | 59.30 | 61.21 | 54.82 |
| w/o CVMF | 65.78 | 59.92 | 62.62 | 58.40 |
| w/o MOPE | 54.88 | 50.05 | 54.60 | 48.21 |
Cross-View Geo-Localization
Cross-view geo-localization matches ground, drone, or aerial images to maps or satellite views to estimate where they were captured.
See all 94 papers