Ground-to-Satellite Knowledge Distillation for Crop Classification under Temporal and Geographic Shift
Organizations: Jülich Supercomputing Centre, Forschungszentrum Jülich, Germany · European Space Agency (ESA/ESRIN), Italy · University of Iceland, Iceland · University of Twente (ITC), the Netherlands
Abstract
Continuous and up-to-date crop type mapping is essential for agricultural monitoring but is often hampered by limited reference data. The growing availability of ground-level field photographs offers a promising way to address this challenge. When combined with satellite time series, these images provide complementary perspectives on the same parcel, capturing crop characteristics from distinctly different perspectives. However, field photographs are not always available for each satellite pixel at inference time, limiting their potential in scalable crop type mapping. We investigate whether ground photographs can provide privileged supervision for crop classification built on pretrained satellite embeddings. A photo teacher based on frozen CLIP features supervises classifiers trained on AlphaEarth and TESSERA representations; photographs are used only during training. On a paired field photo and satellite imagery dataset with 17 crop classes, knowledge distillation consistently improves over satellite-only classification; for frozen embeddings the margin grows under temporal shift, reaching up to +5.5 macro-F1 points, and widens in geographic holdouts (+3.7 vs +3.0 in-distribution). These results show that ground-view supervision can complement satellite embeddings and improve their robustness without changing inference requirements.
Figures & tables
| 2018 test | 2018 2022 transfer | ||||||
|---|---|---|---|---|---|---|---|
| Satellite branch | CE | KD | T | CE | KD | ||
| Frozen AlphaEarth | 63.5 | 66.5 | 52.6 | 56.0 | |||
| Frozen TESSERA | 66.7 | 71.7 | 57.6 | 63.1 | |||
| S2 SITS (scratch) | 62.0 | 65.2 | 54.0 | 56.4 | |||
| S1 S2 SITS (scratch) | 66.1 | 68.7 | 57.5 | 58.7 | |||
| TESSERA fine-tuned | 71.2 | 72.1 | 63.0 | 63.6 | |||
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | MacroF1% | WeightedF1% |
|---|---|---|
| Frozen AlphaEarth CE student [z] | 63.5 0.6 | 67.0 0.4 |
| + KD [z] | 66.5 0.3 | 68.6 0.4 |
| CE control [z] | 63.8 0.7 | 67.4 0.5 |
| + CLIP (InfoNCE) | 63.7 0.7 | 67.2 0.6 |
| + SupCon | 63.4 0.4 | 67.1 0.4 |
| Photo probe [CLIP, v] | 69.7 0.4 | 69.2 0.3 |
| Frozen AlphaEarth | Frozen TESSERA | S2 SITS (scratch) | S1+S2 SITS (scratch) | TESSERA fine-tuned | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Class | CE | +KD | CE | +KD | CE | +KD | CE | +KD | CE | +KD |
| Wheat | 70.0 0.9 | 71.3 0.9 | 74.0 0.2 | 76.0 0.7 | 71.4 1.3 | 73.7 0.8 | 73.4 2.2 | 76.3 1.0 | 77.2 1.1 | 78.3 0.6 |
| Maize | 87.8 0.4 | 89.0 0.2 | 89.0 0.3 | 89.5 0.2 | 88.6 0.8 | 90.0 0.3 | 89.9 0.4 | 91.1 0.3 | 91.4 0.4 | 91.3 0.4 |
| Barley | 55.6 1.1 | 55.6 0.9 | 64.3 1.0 | 63.6 0.6 | 57.4 1.3 | 57.9 1.2 | 59.6 0.6 | 60.8 0.8 | 65.5 0.8 | 64.8 0.9 |
| Other cereals | 46.6 0.5 | 46.6 0.4 | 51.4 0.9 | 49.8 1.2 | 44.1 0.8 | 43.3 1.1 | 48.6 0.6 | 49.3 0.9 | 53.5 1.3 | 53.6 1.0 |
| Rapeseed | 77.4 1.6 | 79.4 0.6 | 80.6 1.0 | 83.3 0.3 | 79.0 0.1 | 79.8 0.5 | 82.1 0.9 | 84.0 0.5 | 82.1 0.5 | 83.4 0.4 |
| Frozen AlphaEarth | Frozen TESSERA | S2 SITS (scratch) | S1+S2 SITS (scratch) | TESSERA fine-tuned | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Class | CE | +KD | CE | +KD | CE | +KD | CE | +KD | CE | +KD |
| Wheat | 64.2 0.4 | 65.8 0.9 | 65.9 1.2 | 70.8 1.1 | 64.0 1.4 | 66.4 0.6 | 66.6 2.5 | 69.7 0.9 | 71.2 1.5 | 72.3 0.5 |
| Maize | 78.5 0.9 | 83.3 0.2 | 86.3 0.4 | 88.3 0.2 | 83.8 0.7 | 85.7 0.9 | 85.8 0.6 | 87.2 0.2 | 88.1 0.3 | 88.6 0.3 |
| Barley | 48.0 1.9 | 48.3 0.2 | 55.5 0.5 | 57.3 1.1 | 49.5 1.0 | 50.1 0.3 | 52.3 0.8 | 53.1 0.8 | 57.7 1.4 | 58.5 0.4 |
| Other cereals | 42.2 1.5 | 42.7 1.9 | 47.6 1.6 | 48.3 1.5 | 41.9 1.7 | 41.9 1.8 | 46.0 1.1 | 46.2 0.5 | 50.3 1.4 | 49.0 1.9 |
| Rapeseed | 68.4 1.1 | 69.6 0.4 | 71.8 0.9 | 73.5 0.5 | 67.8 1.2 | 70.1 0.8 | 73.3 0.2 | 74.2 0.1 | 72.7 0.5 | 74.3 0.5 |
Agricultural Remote Sensing
Agricultural remote sensing uses satellite and airborne observations to map crops and fields and monitor yield, soil, and crop health.
See all 84 papers