Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
Organizations: Beijing, China Aerospace Information Research Institute, CAS · Beijing, China Space Engineering University · Beijing, China Capital Normal University
Abstract
While Multimodal Large Language Models (MLLMs) excel in general vision-language tasks, their application to remote sensing change understanding is hindered by a fundamental "temporal blindness". Existing architectures lack intrinsic mechanisms for multi-temporal contrastive reasoning and struggle with precise spatial grounding. To address this, we first introduce Delta-QA, a comprehensive benchmark comprising 180k visual question-answering samples. Delta-QA unifies pixel-level segmentation and visual question answering across bi- and tri-temporal scenarios, structuring change interpretation into four progressive cognitive dimensions. Methodologically, we propose Delta-LLaVA, a novel MLLM framework explicitly tailored for multi-temporal remote sensing interpretation. It overcomes the limitations of naive feature concatenation through three core innovations: a Change-Enhanced Attention module that systematically isolates and amplifies visual differences, a Change-SEG module utilizing Change Prior Embedding to extract differentiable difference features as input for the LLM, and Local Causal Attention to prevent cross-temporal contextual leakage. Extensive experiments demonstrate that Delta-LLaVA decisively outperforms leading generalist MLLMs and specialized segmentation models in complex change deduction and high-precision boundary localization, establishing a unified framework for earth observation intelligence.
Figures & tables
| Category | Dataset | Frame Number | Land-Cover Type | Containing Pixel Mask | Textual QA/Caption | Task Type | Interactive Prompt | Resolution | Annotation Scale |
| Semantic Change Detection | SECOND ( Yang et al., 2021 ) | 2 | 6 | ✔ | ✘ | Mask | ✘ | 0.5-3 | 4662 Image Pairs |
| Landsat ( Yuan et al., 2022 ) | 2 | 4 | ✔ | ✘ | Mask | ✘ | 30 | 8468 Image Pairs | |
| WUSU ( Yuan et al., 2022 ) | 3 | 11 | ✔ | ✘ | Mask | ✘ | 1 | 1116 Image Pairs | |
| LevirSCD ( Zhang et al., 2025a ) | 2 | 16 | ✔ | ✘ | Mask | ✘ | 1-2 | 3225 Image Pairs | |
| JL1 ( Chang Guang Satellite Technology Co., Ltd., 2026 ) | 2 | 5 | ✔ | ✘ | Mask | ✘ | 0.75 | 6000 Image Pairs | |
| Change Detection and Understanding | SECOND-CC ( Karaca et al., 2025 ) | 2 | 6 | ✔ | ✔ | Caption | ✘ | 0.5-3 | 30205 Captions |
| Methods | SCD Overall Metrics | Non-Background Class IoU | ||||||||
| mIoU | OA | SeK | L. Veg. | Grnd. | Tree | Water | Build. | Play. | ||
| Specialized SCD Models | ||||||||||
| SAM-DINO-SegEarth-OV ( Li et al., 2026a ) | 60.85 | 91.74 | 13.53 | 33.88 | 21.14 | 24.31 | 13.37 | 13.31 | 35.26 | 17.69 |
| SAM-DINOv2-SegEarth-OV ( Li et al., 2026a ) | 63.59 | 92.51 | 15.24 | 37.51 | 21.36 | 27.95 | 15.47 | 15.15 | 38.79 | 22.85 |
| SAM2-DINOv2-SegEarth-OV ( Li et al., 2026a ) | 61.86 | 92.11 | 14.26 | 35.33 | 20.05 | 19.80 | 16.45 | 14.30 | 36.78 | 23.81 |
| ChangeMamba ( Chen et al., 2024a ) | 72.85 | 88.16 | 21.55 | 54.81 | 32.49 | 41.17 | 27.62 | 37.81 | 54.83 | 36.42 |
| Methods | Choice QA (Accuracy) | Open-Ended QA (METEOR & CIDEr) | ||||||||||||||
| H-CIC | P-CIC | H-CQS | H-CTI | H-CSA | P-CQS | P-CTI | P-CSA | |||||||||
| Single | Multi | Single | Multi | M | C | M | C | M | C | M | C | M | C | M | C | |
| Commercial Generalist MLLMs | ||||||||||||||||
| GPT-4.1 ( OpenAI, 2025 ) | 60.20 | 31.38 | 57.86 | 29.20 | 16.40 | 28.02 | 15.77 | 30.26 | 14.21 | 28.77 | 17.22 | 32.30 | 16.80 | 27.61 | 15.13 | 25.38 |
| GPT-4o ( Hurst et al., 2024 ) | 57.71 | 30.75 | 48.72 | 28.42 | 15.79 | 26.98 | 18.25 | 28.03 | 14.89 | 26.08 | 15.83 | 31.15 | 18.57 | 29.11 | 15.14 | 24.23 |
| Gemini 2.5 Flash ( Comanici et al., 2025 ) | 61.69 | 31.00 | 53.48 | 29.07 | 16.18 | 27.21 | 13.89 | 29.64 | 14.60 | 27.51 | 17.15 | 30.45 | 15.35 | 30.74 | 15.67 | 26.19 |
| Model Variant | SCD Overall Metrics | Choice QA (Avg. Acc.) | Open-Ended QA (Avg.) | |||||
| mIoU | OA | SeK | Single | Multi | METEOR | CIDEr | ||
| Full Model | 69.72 | 92.42 | 19.18 | 53.51 | 61.03 | 42.38 | 30.13 | 55.59 |
| w/o CPE | 57.23 (-12.49) | 90.09 (-2.33) | 8.76 (-10.42) | 40.22 (-13.29) | 50.85 (-10.18) | 31.89 (-10.49) | 21.97 (-8.16) | 41.01 (-14.58) |
| w/o CEA | 61.13 (8.59) | 90.71 (-1.71) | 11.19 (-7.99) | 44.38 (-9.13) | 55.29 (-5.74) | 35.45 (-6.93) | 26.31 (-3.82) | 44.12 (-11.47) |
| w/o LCA | 64.32 (-5.40) | 91.23 (-1.19) | 15.50 (-3.68) | 48.91 (-4.60) | 56.83 (-4.20) | 36.04 (-6.34) | 27.26 (-2.87) | 46.81 (-8.78) |
| Component | Parameters | Computational Time | ||||
| Total (M) | % of Total | Trainable (M) | % of Train. | Time (ms) | Ratio (%) | |
| LLM | 5505.52 | 92.10 | 2015.59 | 88.82 | 13539.22 | 96.83 |
| Visual Encoder | 205.85 | 3.40 | 0.00 | 0.00 | 193.55 | 1.38 |
| Frozen Change-SEG | 14.93 | 0.20 | 0.00 | 0.00 | 142.01 | 1.02 |
| Trainable Change-SEG | 14.80 | 0.20 | 14.80 | 0.65 | 78.50 | 0.56 |
| CEA | 147.26 | 2.50 | 147.26 | 6.49 | 23.62 | 0.17 |