DisasterAgent: An Evidence-Driven Agent for Verifiable Disaster Report Generation From Remote Sensing Imagery
Organizations: Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China · the School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100190, China · the University of Chinese Academy of Sciences, Beijing 100190, China · the National Key Laboratory of Target Cognition and Application Technology (TCAT), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China
Abstract
Remote sensing disaster assessment is moving from simple damage classification toward comprehensive report-level analysis. In this setting, responders need not only damage descriptions but also verifiable evidence to guide response and recovery. Recent vision-language models (VLMs) and tool-augmented agents offer strong multimodal reasoning and perception, but they struggle to provide the evidence required for high-stakes verification. To address these limitations, we propose DisasterAgent, an evidence-driven agent that uses a Perception-Augmentation-Generation workflow to generate verifiable disaster reports from bitemporal optical imagery. DisasterAgent first invokes a specialized vision expert toolkit in the perception phase to build a Spatiotemporal Perception Graph (STPG), serving as a structured memory to store and organize disaster-induced changes across space and time. Evidence-based Augmentation (EA) then extracts evidence from the STPG, attaching inline citations that form a closed evidence loop from each statement to the supporting visual evidence. Extensive experiments on the DisasterM3 and RSCC benchmarks demonstrate that DisasterAgent consistently outperforms general-domain VLMs, remote sensing-specialized models, and existing remote sensing agents. Notably, compared with the original model, it improves the average score for disaster report generation on DisasterM3 by 13.5% and ST5-SCS on RSCC by 15.34%, providing a more accurate and verifiable solution for disaster emergency response. The code will be available at https://github.com/ZhijianLi2003/DisasterAgent.
Figures & tables
| Vision Expert Tool | Function Description |
| Disaster Type Recognition [ 36 ] | Built upon DINOv3, this tool identifies the disaster type from bitemporal remote sensing images and supports 10 representative disaster categories, including earthquakes, floods, hurricanes, volcanoes, explosions, and conflicts. |
| Building Damage Analysis (4-class) [ 7 ] | Implemented with ChangeOS, this tool performs pixel-level building damage assessment based on the Joint Damage Scale, which integrates FEMA and HAZUS standards, and categorizes building conditions into four severity levels: no-damage, minor-damage, major-damage, and destroyed. |
| Building Damage Analysis (3-class) [ 8 ] | Based on ChangeMamba, this tool provides pixel-level structural damage perception following FEMA-oriented damage definitions, classifying buildings into three levels: intact, damaged, and destroyed. |
| Road Damage Analysis [ 8 ] | Powered by ChangeMamba, this tool extracts pixel-level road damage information from pre- and post-disaster imagery, distinguishing undamaged roads, flood-covered roads, and roads damaged by debris or rubble. |
| General Concept Segmentation [ 37 ] | Integrated with SAM3, this tool enables open-vocabulary object detection and segmentation for general disaster-related concepts, such as farmland, forest, water bodies, and other scene elements, supporting zero-shot generalization across diverse disaster scenarios. |
| RSCC [ 16 ] | DisasterM3 [ 17 ] | |
| Tasks | Change Captioning | Disaster Type Recognition Building Damage Counting Disaster Region Estimation Disaster Captioning Restoration Advice |
| Disaster Types | Earthquake, Flood Wildfire, Volcano Storm, Tsunami | Earthquake, Flood Hurricane, Volcano Explosion, Wildfire Tornado, Tsunami |
| Modality | Optical | Optical |
| Test Scale | 988 image pairs | 2,512 image pairs |
| Task | Evaluation Dimension | Score | Abbr. |
| Disaster Captioning | Damage Assessment Precision | DAP | |
| Damage Detail Recall | DDR | ||
| Factual Correctness | FC | ||
| Restoration Advice | Recovery Necessity | RN | |
| Action Priority Precision | APP | ||
| Strategic Completeness | SC |
| Method | N-Gram | Contextual Similarity | |
| ROUGE-L (%) | METEOR (%) | ST5-SCS (%) | |
| General VLM | |||
| Kimi K2.6 [ 52 ] | 11.14 | 10.98 | 52.29 |
| GLM-4.5V [ 53 ] | 13.24 | 10.64 | 50.57 |
| InternVL3.5-8B [ 27 ] | 12.05 | 10.84 | 47.98 |
| Qwen3.5-122B-A10B [ 51 ] | 12.27 | 10.59 | 50.20 |
| Method | DTR | BDC | DRE | Disaster Report Generation | |||||||
| Disaster Captioning | Restoration Advice | ||||||||||
| ACC | MAE | MAE | AVG | DAP | DDR | FC | AVG | RN | APP | SC | |
| General VLM | |||||||||||
| Kimi K2.6 [ 52 ] | 74.22 | 32.63 | 4.46 | 1.37 | 1.61 | 1.21 | 1.30 | 2.96 | 3.52 | 2.78 | 2.57 |
| MiniMax-M3 [ 56 ] | 68.84 | 26.50 | 3.81 | 2.03 | 2.31 | 1.80 | 1.97 | 2.79 | 3.37 | 2.58 | 2.42 |
| Qwen3.5-27B [ 51 ] | 70.25 | 30.05 | 4.81 | 1.88 | 2.16 | 1.65 | 1.81 | 2.86 | 3.47 | 2.67 | 2.44 |
| Group | STPG | EA | Disaster Captioning | Restoration Advice | AVG |
| w/o Toolkit | 1.88 | 2.86 | 2.37 | ||
| w/ Toolkit | 2.36 | 3.15 | 2.76 | ||
| ✓ | 2.59 | 2.96 | 2.78 | ||
| ✓ | ✓ | 2.87 | 3.22 | 3.05 |
| Task | Metric | Full | w/o (Remove) | Base | ||
| EEE | VGE | SCE | ||||
| Disaster Captioning | AVG | 2.87 | 2.56 | 2.85 | 2.58 | 1.88 |
| DAP | 3.20 | 2.94 | 3.22 | 2.87 | 2.16 | |
| DDR | 2.52 | 2.14 | 2.46 | 2.30 | 1.65 | |
| FC | 2.88 | 2.60 | 2.89 | 2.56 | 1.81 | |
| Restoration Advice | AVG | 3.22 | 3.08 | - | - | 2.86 |
| Metric | DisasterM3 | RSCC |
| Number of Samples | 2,004 | 988 |
| Samples with SCE Citations (%) | 94.86 | 85.32 |
| Mean STPG Entities per Sample | 182.37 | 35.84 |
| Mean SCE Citations per Sample | 3.40 | 1.93 |
| Mean Linked STPG Entities per SCE Citation | 5.23 | 8.02 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Disaster Damage Assessment
Disaster damage assessment uses imagery and geospatial data to locate, classify, and quantify damage for emergency response and recovery.
See all 52 papers