Revisiting the Task of Building Damage Assessment by Satellite Imaging
Abstract
Natural disasters such as earthquakes, tropical storms, and floods cause extensive damage to buildings, and rapid, reliable damage maps are essential to guide emergency response. Automating this task, referred to as building damage assessment (BDA), from satellite imagery, has become an active research topic at the intersection of remote sensing, computer vision, and machine learning, particularly since supervised deep learning methods were shown to outperform earlier handcrafted approaches. Yet, despite a decade of intense activity and the release of several large-scale datasets, the field lacks a shared foundation. This chapter revisits the task of BDA from first principles, organized around three pillars: data, evaluation, and methods. We first clarify the candidate task for- mulations and argue for a sensor-agnostic, instance-based definition that tolerates missing pre-event imagery. We then review existing datasets along the axes of sensing modality, temporal configuration, and geographic coverage. On the evaluation side, we show that prevailing practices, largely based on a single aggregate score, are theoretically fragile, and we lay the foundations of a more informative, ranking-based, multi-score protocol. We further review methods ranging from task-specific deep networks to recent Earth observation foundation models, noticing that generalization to unseen events and regions remains an open difficulty. Finally, we discuss how these elements can inform the organization of a BDA challenge, including cross-validation, challenge, and private data-sharing setups designed to build trust between developers and users.
Figures & tables
| Formulation | Semantic level | Description |
|---|---|---|
| Detection and binary classification | image crop | Predict whether the crop contains a damaged building (positive class) or not. |
| Multi-class classification | image crop | Multi-class classification extends the binary setting by assigning each image crop to one of several damage categories. |
| Semantic segmentation | pixel-level | Assigns each pixel to one of several semantic classes, such as background, undamaged building, damaged building, or destroyed building. |
| Detection and instance segmentation | pixel-level | Localize all buildings using bounding boxes, polygons, or any shapes, and assign each instance a damage label. |
| Category (label) | Definition |
|---|---|
| Background (0) | All non-building pixels |
| Intact (1) | No visible signs of structural damage, water intrusion, shingle displacement, or burn marks |
| Damaged (2) | Partial structural damage to the building, such as missing roof members, visible cracks, or partial wall/roof collapse. Buildings may be partially burned, surrounded by water or mud, or affected by nearby volcanic flows. |
| Destroyed (3) | Completely collapsed, burned, partially/completely covered by water/mud, or no longer present |
| Category (label) | Definition |
|---|---|
| No Damage (0) | Undisturbed. No sign of water, structural or shingle damage, or burn marks. |
| Minor Damage (1) | Building partially burnt, water surrounding structure, volcanic flow nearby, roof elements missing, or visible cracks. |
| Major Damage (2) | Partial wall or roof collapse, encroaching volcanic flow, or surrounded by water/mud. |
| Destroyed (3) | Scorched, completely collapsed, partially/completely covered with water/mud, or otherwise no longer present. |
| CEMS ODM/IWG-SEM [ 27 ] | BRIGHT [ 17 ] | xBD [ 16 ] |
|---|---|---|
| Destroyed | Destroyed | Destroyed |
| Damaged | Damaged | Major Damage |
| Possibly damaged | Intact | Minor Damage |
| (No visible damage [ 27 ] ) | Background | No Damage |
| Dataset (year) | Task | Modality | Temporality | Region | Disaster type | No. of building | Annotation type |
|---|---|---|---|---|---|---|---|
| ABCD [ 12 ] ( [ 12 ] ) | Binary classification | Aerial image (PASCO) | Pre- and post- event | Japan | Tsunami | 22,171 | Image crop level |
| [ 28 ] ( [ 28 ] ) | Multi-class classification | Social media images | Post-event | 4 regions | Hurricane, typhoon, earthquake | 25,758 | Image-level (3 labels) |
| Cheng et al. [ 29 ] ( [ 29 ] ) | Multi-class classification | UAV aerial imagery | Post-event | Caribbean | Hurricane | 6,440 | Instance masks (2 labels) |
| [ 30 ] ( [ 30 ] ) | Multi-class classification | Street-view images + struct. data | Post-event | Florida, USA | Hurricane | 2,472 | Building-level (3-5 labels) |
| FloodNet [ 31 ] ( [ 31 ] ) | Classification, segmentation, VQA | UAV aerial imagery | Post-event | Texas, USA | Flood | 8,946 instances | Pixel-level semantic (9 labels) + VQA |
| RescueNet [ 32 ] ( [ 32 ] ) | Classification, semantic segmentation | UAV aerial imagery | Post-event | Florida, USA | Hurricane | 10,903 instances | Pixel-level segmentation masks + image-level (10 labels) |
| Benchmark | Task | Evaluation strategy | Score definition |
|---|---|---|---|
| xBD [ 16 ] | Multi-class classification | Per-class and Weighted | |
| QuickQuakeBuilding [ 10 ] | Binary classification | Precision, recall, , and AUROC | , , (alternative equivalent definition) |
| BRIGHT [ 17 ] | Classification, segmentation | Overall accuracy (OA), score, split into and , and mean intersection over union (mIoU) | |
| AI Model Challenge [ 43 ] | Detection (binary classification) | at the building level |
| Destroyed |
|---|
| Damaged |
| Potentially damaged (visible damages or debris in the surroundings) |
| No visible damage (undamaged) |
| Background |
| Setup | Data is known | Annotations are known |
|---|---|---|
| Cross-validation | Yes | Yes |
| Challenge | Yes | No |
| Private | No | No |
| Dimension | S1: Scientific scenario | S2: CfT scenario | S3: CfT scenario |
| (unannotated test) | (with golden samples) | (no golden samples) | |
| Test data released to participants | (without labels) | or | |
| Annotations / labels released | After deadline | Never | Before or during evaluation |
| Independent evaluator custody | (by organiser) | (strict) | |
| Training contamination risk | Low during challenge; high post-release | Very low | High |
| Deliberate benchmark gaming risk | Medium (label guessing possible) | Very low | High |
Building Damage Assessment
Building damage assessment uses aerial and satellite imagery to locate buildings and estimate disaster-related structural damage for response and recovery.
See all 24 papers