LandslideFM: A Foundation Model Towards Unified Landslide Perception and Understanding
Organizations: Faculty of Data Science, City University of Macau, 999078, SAR Macao, China · Data Science in Earth Observation, Technical University of Munich, Munich, 80333, Germany · Department of Automation, Tsinghua University, Beijing, 100084, China
Abstract
Intelligent landslide detection is essential for disaster prevention. However, existing models primarily focus on isolated visual tasks, require extensive labeled data, and lack deep analytical and scene-understanding capabilities. To address these limitations, we propose LandslideFM, the first unified foundation model that connects visual perception tasks with contextual interpretation of landslides. Specifically, LandslideFM adapts to multiple visual tasks via a Source-Agreement Graduated Trust semi-supervised learning framework that leverages limited labeled data alongside abundant unlabeled data. Furthermore, predicted landslide regions provide explicit spatial guidance to a Vision-Language Model adapted through parameter-efficient fine-tuning, enabling comprehensive landslide reasoning. To support training and evaluation in this domain, we also present LandslideVL, the first benchmark for intelligent landslide analysis, combining visual imagery and newly introduced textual prompts. Comprehensive experiments across public datasets and LandslideVL demonstrate that LandslideFM achieves superior quantitative and qualitative performance. Most importantly, LandslideFM surpasses general-purpose VLMs in specialized landslide reasoning and scene analysis. Our code is released at https://github.com/wangshanwen001/LandslideFM.
Figures & tables
| Property | BJL [ 40 ] | GVLM [ 41 ] | Jiuzhai Valley [ 42 ] |
| Geographical coverage | Bijie, Guizhou, China | 17 regions across six continents | Jiuzhai Valley, Sichuan, China |
| Image acquisition period | May–August 2018 | 2010–2021 | August–September 2017 |
| Imagery source | TripleSat satellite | Google Earth imagery | UAV imagery |
| Source data types | Optical RGB imagery | Bitemporal optical imagery | Optical RGB imagery |
| Spatial resolution (m) | 0.8 | 0.59 | 0.5 |
| Original data volume | 2,773 image patches | 17 bitemporal image pairs | 1,752 image patches |
| Datasets | Method | Precision | Recall | F1 |
| BJL | ResNet101 [ 49 ] | 96.08 | 93.33 | 94.69 |
| DenseNet [ 50 ] | 95.12 | 92.18 | 93.63 | |
| ViT [ 51 ] | 96.41 | 95.45 | 95.93 | |
| DINO_v2 [ 43 ] | 96.25 | 95.81 | 96.03 | |
| LandslideFM (1/8) | 96.74 | 95.96 | 96.35 | |
| LandslideFM (Full) | 99.08 | 98.70 | 98.89 |
| Datasets | Method | Precision | Recall | F1 | IoU |
| BJL | Faster R-CNN [ 39 ] | 55.88 | 74.03 | 63.69 | 65.91 |
| DETR [ 52 ] | 57.87 | 74.04 | 64.96 | 65.97 | |
| DINO_v2 [ 43 ] | 73.33 | 79.08 | 76.10 | 68.69 | |
| LandslideFM (1/8) | 72.16 | 77.62 | 74.79 | 67.65 | |
| LandslideFM (Full) | 75.16 | 80.13 | 77.56 | 69.85 | |
| GVLM | Faster R-CNN [ 39 ] | 37.88 | 50.32 | 43.22 | 48.66 |
| Ratio | Method | mPrecision (%) | mRecall (%) | mF1 (%) | mIoU (%) | Kappa (%) |
| 1/8 | FixMatch [ 54 ] | 75.74 | 82.63 | 79.04 | 66.37 | 56.93 |
| UniMatch [ 55 ] | 76.42 | 82.79 | 79.48 | 68.73 | 58.26 | |
| AllSpark [ 56 ] | 78.81 | 84.60 | 81.60 | 71.89 | 62.80 | |
| UniMatch_v2 [ 57 ] | 84.53 | 89.18 | 86.79 | 77.90 | 73.26 | |
| 3D SCAM [ 40 ] | 70.66 | 79.77 | 74.94 | 64.74 | 48.56 | |
| Semi-LM [ 53 ] | 78.80 | 85.98 | 82.23 | 73.62 | 63.99 |
| Ratio | Method | mPrecision (%) | mRecall (%) | mF1 (%) | mIoU (%) | Kappa (%) |
| 1/8 | FixMatch [ 54 ] | 75.68 | 80.42 | 77.98 | 66.23 | 55.51 |
| UniMatch [ 55 ] | 74.43 | 81.20 | 77.67 | 66.57 | 54.58 | |
| AllSpark [ 56 ] | 76.20 | 81.62 | 78.82 | 68.45 | 57.21 | |
| UniMatch_v2 [ 57 ] | 90.58 | 87.94 | 89.24 | 80.54 | 78.14 | |
| 3D SCAM [ 40 ] | 72.38 | 77.72 | 74.96 | 66.09 | 49.50 | |
| Semi-LM [ 53 ] | 85.22 | 85.78 | 85.50 | 77.32 | 70.95 |
| Models | landslide_exists | has_building | has_road | has_water | has_vegetation | ||||||||||
| P | R | F1 | P | R | F1 | P | R | F1 | P | R | F1 | P | R | F1 | |
| Qwen2.5-VL-3B [ 58 ] | 59.35 | 98.54 | 74.08 | 99.79 | 55.54 | 71.36 | 98.13 | 37.01 | 53.75 | 99.15 | 16.84 | 28.79 | 99.21 | 75.14 | 85.51 |
| Qwen2.5-VL-7B [ 58 ] | 70.74 | 98.56 | 82.36 | 97.96 | 27.43 | 42.86 | 96.28 | 41.00 | 57.51 | 93.92 | 44.74 | 60.61 | 99.46 | 84.69 | 91.48 |
| Qwen3-VL-8B [ 59 ] | 72.81 | 97.44 | 83.34 | 98.76 | 46.19 | 62.94 | 97.80 | 53.37 | 69.06 | 95.86 | 50.66 | 66.29 | 99.04 | 87.93 | 93.15 |
| Kimi-VL-A3B [ 60 ] | 56.37 | 98.84 | 71.79 | 99.64 | 38.97 | 56.03 | 97.04 | 67.37 | 79.53 | 86.36 | 23.24 | 36.63 | 99.43 | 99.74 | 99.58 |
| LandslideFM (Ours) | 97.71 | 98.88 | 98.29 | 92.08 | 95.66 | 93.83 | 89.04 | 91.96 | 90.48 | 87.87 | 85.79 | 86.82 | 99.51 | 99.87 | 99.69 |
| Models | mPrecision | mRecall | mF1 | |
| Average | Qwen2.5-VL-3B [ 58 ] | 91.13 | 56.61 | 62.70 |
| Qwen2.5-VL-7B [ 58 ] | 91.67 | 59.28 | 66.96 | |
| Qwen3-VL-8B [ 59 ] | 92.85 | 67.12 | 74.96 | |
| Kimi-VL-A3B [ 60 ] | 87.77 | 65.63 | 68.71 | |
| LandslideFM (Ours) | 93.24 | 94.43 | 93.82 |
| Method | BLEU | ||||||
| Qwen2.5-VL-3B [ 58 ] | 0.12 | 4.64 | 27.04 | 7.87 | 11.06 | 37.92 | 17.02 |
| Qwen2.5-VL-7B [ 58 ] | 0.24 | 4.29 | 30.20 | 7.44 | 9.64 | 41.20 | 15.55 |
| Qwen3-VL-8B [ 59 ] | 0.57 | 5.17 | 30.92 | 8.63 | 12.79 | 41.83 | 19.27 |
| Kimi-VL-A3B [ 60 ] | 0.17 | 4.12 | 30.82 | 7.27 | 9.39 | 41.07 | 15.08 |
| LandslideFM (Ours) | 13.16 | 35.44 | 32.83 | 32.50 | 45.40 | 42.05 | 41.94 |
| Dataset | Network | mF1 | mIoU | kappa |
| BJL | Without SAGT | 78.46 | 69.35 | 55.76 |
| No Graduated | 84.84 | 76.40 | 68.60 | |
| Full SAGT | 88.93 | 80.47 | 77.34 | |
| GVLM | Without SAGT | 85.41 | 77.29 | 70.72 |
| No Graduated | 90.35 | 83.45 | 79.20 | |
| Full SAGT | 92.87 | 87.33 | 85.72 |