Learning Administrative Boundary-Aware Location Encoders via Reverse Geocoding
Organizations: Instacart New York, NY, USA · Thomson Reuters Labs Seattle, WA, USA
Abstract
Location encoders learn compact representations of latitude--longitude coordinates for downstream geospatial prediction tasks. Existing approaches are pretrained using continuous or naturally occurring supervision, such as imagery, climate variables, or species distributions, and therefore do not explicitly capture administrative boundaries or place names, despite their strong influence on many real-world geospatial phenomena. We introduce, to our knowledge, the first method for learning administrative boundary-aware location encoders, using reverse-geocoded text as a self-supervised training signal. Our approach can be applied to existing location encoder architectures and consistently improves their downstream performance. We further introduce RevGeoRQ, a custom architecture tailored to reverse-geocoding supervision, which yields additional gains and exceeds contemporary location encoders on several downstream tasks. Finally, the use of human-interpretable reverse-geocoded strings and residual-quantized semantic IDs provides a more interpretable representation of geographic location than existing approaches. Code and model weights to be released soon.
Figures & tables
| Regression | Classification | ||||||||
| Model | air_temp | elevation | population | cali_housing | avg. [2pt]R 2 | country | eco regions | biome | avg. [2pt]acc. |
| Baseline | |||||||||
| Qwen0.6B | |||||||||
| SatCLIP | |||||||||
| Native | |||||||||
| TextRQ | |||||||||
| Model | top-1 | top-3 | top-5 | mean |
|---|---|---|---|---|
| Baseline | ||||
| Vision-only (Inception-v3) | ||||
| SatCLIP | ||||
| Native (L=40) | ||||
| TextRQ (L=10) | ||||
| Combined |
| Regression | Classification | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Model | air_temp | elevation | population | cali_housing | avg. [2pt]R 2 | country | eco regions | biome | avg. [2pt]acc. |
| Qwen-0.6B | |||||||||
| RQVAE-only (0.6B) | |||||||||
| SatCLIP-TextRQ (L=40, 0.6B) | |||||||||
| SatCLIP-TextRQ (L=10, 0.6B) | |||||||||
| SatCLIP-TextRQ (L=10, 4B) | |||||||||
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| SatCLIP | GeoCLIP | Climplicit | SINR | |
| Backbone variant | SatCLIP ViT16-L10 | GeoCLIP | Climplicit | SINR (Coords., 1000/class) |
| Training data | S2-100K | MP-16 Flickr | CHELSA land grid | iNaturalist |
| (# points) | (91,858) | ( 4.72M) | ( 224M) | ( 35.5M) |
| Budget | max_epochs =100 | max_steps =50k | max_steps =50k | max_epochs =50 |
| Optimizer | AdamW (betas ; eps ) | |||
| LR | peak , weight decay | |||
| Regression | Classification | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Model [2pt] (all TextRQ) | air_temp | elevation | population | cali [2pt]housing | avg. [2pt]R 2 | country | eco [2pt]regions | biome | avg. [2pt]acc. |
| SatCLIP (L=10) | |||||||||
| CLIP | |||||||||
| RQVAE | |||||||||
| GeoCLIP | |||||||||
| CLIP | |||||||||
| Model (dataset) | Total points | Distinct points | Distinct reverse [2pt]geocoded strings | Reduction rate [2pt](distinct points per string) |
|---|---|---|---|---|
| SatCLIP (S2-100K) | 91,858 | 91,858 | 21,188 | 4.3 |
| GeoCLIP (MP-16) | 4,723,695 | 2,875,487 | 81,997 | 35.1 |
| Climplicit (CHELSA) | 224,368,589 | 224,368,589 | 94,473 | 2,375.0 |
| SINR (iNat) | 35,500,262 | 27,862,308 | 101,411 | 274.7 |
Geospatial Representation Learning
Geospatial representation learning builds reusable embeddings of places, imagery, maps, mobility, and Earth data for spatial prediction and reasoning.
See all 128 papers