Wildfire-SSR: Geolocation-Aware Multimodal Fusion for Structure-Level Wildfire Risk Assessment
Organizations: Urban Resilience.AI Lab, Zachry Department of Civil and Environmental Engineering, Texas A&M University, College Station, TX · Artie McFerrin Department of Chemical Engineering, Texas A&M University, College Station, TX · Institute for Disaster Resilient Texas, Texas A&M University, Houston, TX
Abstract
Structure-level wildfire vulnerability assessment is critical for reducing losses in wildland-urban interface communities, yet existing methods often fail to combine parcel-scale ignition pathways with community-scale geographic coverage. This study introduces Wildfire-SSR (Satellite and Street-view for wildfire Risk), a geolocation-aware multimodal framework that integrates macro-scale satellite context with micro-scale street-view evidence. A Vision-Language Model extracts wildfire-relevant building and site attributes from pre-event street-view panoramas and converts them into structured semantic text. These features are spatially aligned with satellite imagery through a decoupled cross-attention fusion decoder, while a frozen satellite-pretrained DINOv3 encoder captures overhead visual context. Alternative geolocation embedding strategies are evaluated to anchor text-derived features within each satellite patch. The framework is tested on approximately 37,000 structures affected by the 2025 Eaton and Palisades fires in Los Angeles, using wildfire risk labels derived from relative post-event damage patterns to better represent inherent structural vulnerability. Rotary Positional Embedding provides the strongest spatial grounding, achieving a building localization F1 score of 0.6735 and a harmonic mean F1 score of 0.2476 for five-class pixel-level risk classification, outperforming unimodal baselines and an unanchored multimodal configuration. The model also shows a conservative bias in higher-risk classes, reducing severe-risk underestimation, and completes end-to-end assessment of the study area in 37 minutes on a single GPU. Wildfire-SSR reframes cross-view fusion as localized semantic alignment and provides a scalable tool for mitigation prioritization, resilience planning, and insurance-oriented wildfire risk assessment.
Figures & tables
| Geolocation Embedding | Trainable Param # (M) | Building Localization F1 Score | Building Wildfire Risk Classification F1 Score | |||||
|---|---|---|---|---|---|---|---|---|
| Minimal | Low | Moderate | High | Extreme | Harmonic Mean | |||
| Rotary Position Embedding | 100 | 0.6735 | 0.2330 | 0.2147 | 0.1747 | 0.6842 | 0.2462 | 0.2476 |
| Random Fourier Features | 100 | 0.6699 | 0.3588 | 0.2296 | 0.1048 | 0.5320 | 0.2385 | 0.2198 |
| Spatial Grid Mapping | 349 | 0.2284 | 0.3916 | 0.4012 | 0.0000 | 0.4027 | 0.2267 | 0.0000 |
| Metric | Minimal | Low | Moderate | High | Extreme | Harmonic Mean |
|---|---|---|---|---|---|---|
| Pixel-level F1 | 0.2330 | 0.2147 | 0.1747 | 0.6842 | 0.2462 | 0.2476 |
| Building-level F1 | 0.1561 | 0.1993 | 0.2241 | 0.7481 | 0.2173 | 0.2594 |
| Building-level Adjacent F1 | 0.2177 | 0.5058 | 0.2717 | 0.7705 | 0.2937 | 0.3861 |
| Building-level Upper Adjacent F1 | 0.1645 | 0.2146 | 0.2628 | 0.7670 | 0.2884 | 0.3022 |
| Model | Trainable Param # (M) | Building Localization F1 Score | Building Wildfire Risk Classification F1 Score | |||||
|---|---|---|---|---|---|---|---|---|
| Minimal | Low | Moderate | High | Extreme | Harmonic Mean | |||
| Satellite Imagery | 58 | 0.6527 | 0.0595 | 0.4181 | 0.1362 | 0.6976 | 0.1529 | 0.1450 |
| Street-view Text Descriptions | 100 | 0.0884 | 0.0445 | 0.0763 | 0.0517 | 0.5168 | 0.1159 | 0.0764 |
| (w/o Geolocation Embedding) | ||||||||
| Street-view Text Descriptions | 100 | 0.3296 | 0.2441 | 0.2361 | 0.2267 | 0.4376 | 0.0958 | 0.1964 |
| (Geolocation Embedding: RoPE) | ||||||||
| Model | Building Localization F1 Score | Building Wildfire Risk Classification F1 Score | |||||
|---|---|---|---|---|---|---|---|
| Minimal | Low | Moderate | High | Extreme | Harmonic Mean | ||
| Satellite Imagery + Risk Labels as Text | 0.6806 | 0.4748 | 0.3165 | 0.7516 | 0.7878 | 0.1516 | 0.3458 |
| (w/o Geolocation Embedding) | |||||||
| Satellite Imagery + Risk Labels as Text | 0.6618 | 0.6584 | 0.1976 | 0.4360 | 0.9187 | 0.8082 | 0.4466 |
| (Geolocation Embedding: RoPE) | |||||||
| Satellite Imagery + Risk Labels as Text | 0.6420 | 0.6092 | 0.3309 | 0.4261 | 0.9267 | 0.7727 | 0.5329 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| ID | Feature Name | Primary Category | Sub-Category | Contributing Feature? |
|---|---|---|---|---|
| B-01 | Roof Material | Building Shell | Roof Assembly | Yes |
| B-02 | Roof Condition | Building Shell | Roof Assembly | |
| B-03 | Roof Angle | Building Shell | Roof Assembly | Yes |
| B-04 | Debris in Gutter | Building Shell | Roof Assembly | |
| B-05 | Siding Material | Building Shell | Vertical Surfaces | Yes |
| B-06 | Siding-to-Ground Clearance Present | Building Shell | Vertical Surfaces | Yes |
Multimodal Fusion
Multimodal fusion combines information from different data types to improve prediction, perception, and decision-making.
See all 821 papers