EarthJev: Calibrated, Non-Generative Answers to Natural-Language Questions about Sentinel-2 Land Cover
Organizations: Department of Electrical Engineering and Information Technology (DIETI), University of Naples Federico II, Via Claudio, 21, Naples, 80125, Italy
Abstract
Vision-language models for remote sensing answer questions about satellite images by generating text: every answer costs a decoding loop, has to be parsed back to an option, and comes without a usable probability. We present EarthJev, a 0.8B-parameter model that answers typed questions about multispectral Sentinel-2 patches without generating any token. All 12 bands enter the vision encoder of Qwen3.5-0.8B through a widened input layer initialised from the RGB kernels, and, following the open OneJev recipe, the answer is read from the logits of the option letters at a single position and trained with cross-entropy plus Brier score. Under a pre-specified analysis plan, we compare it with the same backbone fine-tuned to generate the answer and with three multimodal language models fine-tuned with LoRA, all trained on the same 70,890 questions from 5% of BigEarthNet v2.0 and timed in one job on the same GPU; VQA models that classify over a fixed answer vocabulary are reported as a reference for the cost of answering only the questions seen in training. EarthJev answers a question in 19.9 ms, 4.3 to 8.7 times faster than the multimodal language models and 6.8 times faster than its own backbone used generatively; when all the questions about an image are asked together, it answers them in 42.8 ms, 3.7 to 10.1 times faster than the batched generative models. On 36,028 test questions it reaches 86.0% accuracy (three seeds), 0.6 and 1.2 points below the two 2B multimodal models and 3.5 points below the remote-sensing EarthDial-4B, with answers that are valid by construction and calibrated probabilities (ECE 0.006). Replacing the nine non-RGB bands with their mean costs 4.5 points, so the model uses the multispectral input, and in an ablation training the whole vision encoder raises accuracy to 88.4% at the same cost. Code and model: https://github.com/CosmoIknosLab/EarthJev
Figures & tables
| CORINE test (36,028 q.) | RSVQAxBEN | Latency per question | ||||
| Model | Params | Acc. (%) | ECE | Acc. (%) | p50 (ms) | Slower |
| Ours | ||||||
| EarthJev (ours) | 0.8B | 86.0 ±0.1 | 0.006 | 81.0 ±0.6 | 19.9 | – |
| Same backbone and input, generative fine-tuning | ||||||
| Qwen3.5-0.8B, generative | 0.8B | 86.8 ±0.2 | 0.005 | 80.5 ±0.6 | 134.7 | 6.8 |
| Multimodal LLMs, LoRA fine-tuning | ||||||
| One question per request | All questions of an image | ||||||||
| Model | Params | Input | p50 (ms) | p95 (ms) | Slower | Image (ms) | Per q. (ms) | Slower | Mem. (GB) |
| Ours | |||||||||
| EarthJev (ours) | 0.8B | 12 bands | 19.9 | 20.1 | – | 42.8 | 7.9 | – | 3.5 |
| Same backbone and input, generative fine-tuning | |||||||||
| Qwen3.5-0.8B, generative | 0.8B | 12 bands | 134.7 | 144.4 | 6.8 | 191.9 | 36.9 | 4.5 | 2.2 |
| Multimodal LLMs, LoRA fine-tuning | |||||||||
| CORINE test (36,028 questions) | RSVQA- | BigEarthNet.txt | ||||||||||
| Model | Params | Input | All | Dom. | Pres. | Share | Loc. | Comp. | ECE | xBEN | Binary | MC |
| Ours | ||||||||||||
| EarthJev (ours) | 0.8B | 12 bands | 86.0 ±0.1 | 83.6 | 93.2 | 82.9 | 66.1 | 87.9 | 0.006 | 81.0 | 59.6 | 40.1 |
| Same backbone and input, generative fine-tuning | ||||||||||||
| Qwen3.5-0.8B, generative | 0.8B | 12 bands | 86.8 ±0.2 | 85.0 | 93.6 | 83.7 | 66.6 | 88.5 | 0.005 | 80.5 | 59.3 | 17.1 |
| Multimodal LLMs, LoRA fine-tuning | ||||||||||||
| CORINE | RSVQAxBEN | BigEarthNet.txt | ||||
| Variant | Acc. | [95% CI] | Acc. | [95% CI] | Acc. | [95% CI] |
| EarthJev (seed 0) | 85.9 | – | 80.3 | – | 50.8 | – |
| whole vision encoder trained | 88.4 | +2.5 [+2.2, +2.8] | 83.0 | +2.7 [+2.2, +3.1] | 51.1 | +0.3 [-0.4, +1.1] |
| new channels start from the mean RGB kernel | 84.3 | -1.6 [-2.0, -1.3] | 80.3 | +0.0 [-0.4, +0.5] | 47.5 | -3.3 [-4.1, -2.5] |
| acquisition date and country in the state | 86.4 | +0.5 [+0.1, +0.8] | 81.9 | +1.5 [+1.2, +1.9] | 50.7 | -0.1 [-0.9, +0.6] |
| + 81,000 EuroSAT-MS questions | 86.5 | +0.6 [+0.3, +0.9] | 78.9 | -1.5 [-1.9, -1.1] | 49.2 | -1.5 [-2.3, -0.8] |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Type | Template | Split |
|---|---|---|
| dominant | Which land-cover class covers most of this image? | seen |
| What is the dominant land cover in this Sentinel-2 patch? | seen | |
| Which CORINE land-cover class occupies the largest area here? | seen | |
| Looking at this satellite image, which kind of land covers the biggest part of it? | unseen | |
| presence | This image contains {c}. | seen |
| Is there any {c} in this patch? | seen |
Remote Sensing Visual Question Answering
Remote sensing visual question answering (VQA) studies how AI answers natural-language questions about satellite, aerial, and other Earth-observation imagery.
See all 39 papers