Multi-Sensor Mapping of Vulnerable Urban Settlements Using SAR, Multispectral, and Hyperspectral Imagery: A Case Study in Córdoba, Argentina
Authors: Luigi Russo, Anabella Ferral, Silvia Liberata Ullo, Paolo Gamba
Organizations: Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy · Instituto Gulich, UNC-CONAE-CONICET, Córdoba, Argentina · Department of Engineering, University of Sannio, 82100 Benevento, Italy
Informal settlements represent a major urban challenge in rapidly expanding cities, yet their identification from Earth Observation (EO) data remains difficult because of their heterogeneous appearance and incomplete official inventories. This work presents a multi-sensor deep learning (DL) framework for slum-likelihood mapping in Córdoba, Argentina, integrating high-resolution PlanetScope multispectral (MS) imagery, COSMO-SkyMed (CSK) Synthetic Aperture Radar (SAR) data, and medium-resolution PRISMA hyperspectral (HS) observations. The problem is formulated as a patch-level classification task using the official Registro Nacional de Barrios Populares (ReNaBaP) inventory as reference, and the models are evaluated through four geographically partitioned folds. SAR-only and MS-only baselines, their configurations with PRISMA HS support, and early fusion (EF), middle fusion (MF), and late fusion (LF) strategies are systematically compared. Results show that LF+HS provides the best overall balance between classification performance and spatial selectivity, while PRISMA contributes complementary spectral information alongside the higher-resolution MS and SAR representations. Beyond the standard evaluation against ReNaBaP, an external municipal vulnerability layer is used to interpret detections outside the official polygons, showing that several apparent false positives overlap broader vulnerable urban areas. Thermal analysis further shows that ReNaBaP settlements exhibit significantly higher surface temperatures than their immediate surroundings during a heatwave event, indicating localised surface-heat amplification. Taken together, these results suggest that multi-sensor EO fusion can support both the mapping of ReNaBaP settlements and the interpretation of broader urban vulnerability patterns.
Figures & tables
Fig. 1: Study area in Córdoba, Argentina, and EO data used in this work. The figure shows (a) PlanetScope RGB imagery acquired on 19 July 2025, (b) COSMO-SkyMed HH SAR backscatter acquired on 28 July 2025, (c) PRISMA false-colour composite generated from selected hyperspectral bands and acquired on 28 March 2021, and (d) the ReNaBaP polygons overlaid on PlanetScope RGB imagery. All panels refer to the same spatial extent and provide the basis for model training, prediction, and contextual evaluation.
Data source
Category
Acquisition date / version
Product / attributes
Spatial resolution / unit
Role in the workflow
COSMO-SkyMed
SAR image
28-07-2025
L1D GTC, single-pol HH backscatter
∼ 3 m
High-resolution SAR input
PlanetScope
Multispectral image
19-07-2025
Surface reflectance, 8 bands
∼ 3 m
High-resolution MS input
PRISMA
Hyperspectral image
28-03-2021
L2D surface reflectance, original 230-band cube
30 m
PCA-reduced spectral descriptors
Landsat-8 TIRS
Thermal image
03-01-2022
Collection 2 Level-2 Band 10 surface temperature product
100 m
Surface-temperature comparison
ReNaBaP
Reference polygons
2025
Official barrios populares inventory
Settlement polygons
Label derivation and reference-map comparison
CBA layer
Contextual polygons
2025
High-/low-vulnerability classes
Neighbourhood-scale units
Contextual interpretation
TABLE I: EO, reference and contextual datasets used in this study.
Fig. 2: Multi-sensor dataset construction workflow. Spatially aligned PS and CSK patches are extracted from the high-resolution data, while corresponding PRISMA subsets are cropped at native resolution and compressed into 16 PCA components. ReNaBaP polygons are then used for binary patch labelling, and the resulting samples are split into four geographically partitioned folds for OOF training and evaluation.
Fig. 3: PRISMA alignment and PCA-based compression. Each PS–CSK patch footprint is used to crop a native-resolution PRISMA subset, which is reduced from 230 spectral bands to 16 principal components.
Fig. 4: Patch labelling strategy based on the ReNaBaP-covered fraction within each patch. Patches with coverage ≥ 10% are labelled as ReNaBaP-positive patches, patches with 0% overlap are labelled as ReNaBaP-negative patches, and intermediate cases are discarded as ambiguous samples.
Fig. 5: Spatial CV folds used for the Córdoba study area. The four sectors define geographically partitioned folds used for OOF evaluation, while ReNaBaP polygons indicate the spatial distribution of reference settlements across the city.
Fold 1
Fold 2
Fold 3
Fold 4
Total
383
403
385
363
1534
24.97%
26.27%
25.10%
23.66%
100.00%
TABLE II: Spatial CV fold distribution.
Fig. 6: Multi-sensor fusion architectures compared in this study. (a) EF stacks the PS and CSK inputs before a single ResNet-18 backbone. (b) MF processes the PS and CSK inputs with independent encoders and combines their feature maps before classification. (c) LF keeps the SAR and MS representations separate until feature-vector concatenation. In all “+HS” configurations, the PCA-reduced PRISMA subset is encoded as a compact spectral embedding and appended to the final feature representation before classification.
Fig. 7: Methodological and interpretation workflow following the dataset construction stage. The upper part summarises the patch-level learning framework, model-training ablation, spatial OOF inference and city-wide slum-likelihood mapping. The lower part summarises the subsequent validation and interpretation steps, including ReNaBaP-based metric computation, contextual analysis of detections outside official polygons, vulnerability-discrimination assessment and complementary thermal interpretation. Note: The step numbering starts from 7 because this workflow continues the dataset-construction sequence shown in Fig. 2 .
Metric
SAR- and MS-based configurations
Multi-sensor fusion strategies
SAR
SAR+HS
MS
MS+HS
EF
EF+HS
MF
MF+HS
LF
LF+HS
Precision
0.3590
0.2623
0.4103
0.4267
0.2426
0.2828
0.3913
0.4737
0.4000
0.5455
Recall
0.4746
0.5424
0.5424
0.5424
0.6942
0.6949
0.6102
0.3051
0.6441
0.6102
F1-score
0.4088
0.3536
0.4672
0.4776
0.3596
0.4020
0.4768
0.3711
0.4935
0.5760
AUROC
0.8198
0.8757
0.8634
0.8837
0.8676
0.8929
0.8880
0.8298
0.8826
0.8674
Accuracy
0.9472
0.9237
0.9524
0.9544
0.9048
0.9205
0.9485
0.9602
0.9492
0.9654
TABLE III: Patch-level classification performance of SAR- and MS-based configurations and multi-sensor fusion strategies under spatial OOF evaluation. PRISMA HS information is included as a PCA-reduced spectral embedding when “+HS” is indicated. The best value for each metric is highlighted in bold.
Fig. 8: City-wide slum-likelihood maps obtained with the different ResNet-18 fusion strategies, with and without PRISMA HS support. Warmer colours indicate higher slum-likelihood scores. The comparison highlights the different spatial behaviours of the EF, MF, and LF models.
Fig. 9: City-wide slum-likelihood map obtained with the ResNet-18 LF+HS configuration. ReNaBaP settlements are shown as yellow polygons. The insets show examples of detected official settlements, including (a) Barrio Villa La Tela and (b) Barrio 12 de Septiembre, and areas with high slum-likelihood scores outside the adopted ReNaBaP inventory, including (c) Barrio El Chingolo and (d) Barrio José Ignacio Díaz 2A Secc.
Fig. 10: LF+HS slum-likelihood map overlaid with the adopted ReNaBaP inventory and the Municipality of Córdoba vulnerability layer. ReNaBaP polygons are shown in blue, high-vulnerability CBA neighbourhoods in yellow and low-vulnerability neighbourhoods in green. Several areas with high slum-likelihood scores outside ReNaBaP fall within broader areas identified by the municipality as vulnerable. The CBA polygons are used only for contextual interpretation and do not constitute additional slum reference labels.
Fig. 11: Distribution of maximum LF+HS slum-likelihood values within CBA high- and low-vulnerability neighbourhoods.
Fig. 12: ROC curve obtained using the maximum LF+HS slum-likelihood value within each CBA neighbourhood to discriminate between high- and low-vulnerability classes.
Fig. 13: Thermal analysis setup for ReNaBaP settlements and their surrounding areas. Official ReNaBaP polygons are shown in purple, while yellow areas indicate the 250 m buffer zones used for local temperature comparison after excluding the ReNaBaP polygons.
Remote sensing image understanding uses AI to interpret satellite and aerial imagery for objects, land cover, change, hazards, and spatial relationships.
Accurate mapping of informal settlements remains a major challenge in Sub-Saharan African (SSA) cities because optical imagery often fails to distinguish Informal Settlements (defined here as LCZ 7) from spectrally similar formal Compact Low-Rise areas (LCZ 3). This study presents a context-aware, reproducible Optical-SAR framework that improves informal settlement delineation using Sentinel-2 spectral features and Sentinel-1 structural information within an adapted Local Climate Zone (LCZ) taxonomy. We implement a three-tier SAR integration strategy: calibrated backscatter, GLCM textures, and a physics-guided feature engineered to capture the high structural disorder and weak radar return characteristic of SSA informal settlements. Using reference data across Nairobi and Eldoret (Kenya), we evaluate performance via a stratified hold-out protocol and a season-aware ablation study. Results show that SAR textures provide the dominant performance gain for LCZ 7 detection. The Optical-SAR model achieves overall accuracy of 0.816 (dry) and 0.807 (wet), significantly outperforming the WUDAPT baseline (OA 0.704) and reducing the critical LCZ 3 - LCZ 7 confusion to 7%. Seasonal analysis indicates that while optical-only separability varies with phenology, SAR-derived textures stabilize informal settlement mapping across seasons. These findings demonstrate that the incorporation of SAR-derived features yields consistent improvements for urban morphology mapping in data-scarce environments across seasons and across the evaluated source cities, while cross-city transfer remains limited without local adaptation strategies.
Peterson Chepkilot, Babak Memar, Paolo Gamba
Department of Civil, Building and Environmental Engineering, Sapienza University of Rome, 00184 Rome, Italy · Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy
Pixel-level slum mapping has long been constrained by limited cross-city generalisation, the absence of continuous density estimation, and weak global comparability. AlphaEarth Foundations (AEF), a globally consistent 64-dimensional annual surface embedding at 10 m, offers a new analysis-ready basis for lightweight slum monitoring, but its applicability to slum detection - an indirectly coupled task shaped by both built form and socio-economic processes - remains untested. We evaluate AEF on slum classification and sub-pixel density estimation across 12 cities and 69 city-year pairs (2017-2024), using GRAM pseudo-masks as supervisory labels. The evaluation spans four training strategies, two protocols (random split and 3x3 spatial block cross-validation), six auxiliary feature configurations, and five baseline models, complemented by representation-level analyses (PCA, SHAP) and full-AOI mapping. Five findings emerge. (1) Same-city cross-year training is optimal under both protocols (median spatial F1 = 0.616, R^2 = 0.466); temporal expansion outperforms cross-city transfer, indicating city-scale representational drift. (2) Regression R^2 is driven primarily by zero/non-zero boundary discrimination: positive-pixel R^2 is consistently negative across all cities, revealing limited capacity to model intra-pixel density gradients at 10 m. (3) PC36 is consistently top-ranked across tasks; classification saturates at k = 32 while regression remains unsaturated at k = 64. (4) POI features yield the largest density gain (Delta R^2 = +0.064). (5) For six cities meeting dual-task usability thresholds, full-AOI inference across 2017-2024 preserves slum cluster structure (mean SSIM = 0.926). The study delineates the capabilities and complementarity needs of foundation-model embeddings for slum monitoring.
Shuyang Hou, Ziqi Liu, Haoyue Jiao +7
State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan, China
Optical remote sensing imagery is frequently degraded by cloud and cloud-shadow contamination, which limits its reliability for near-real-time land use and land cover (LULC) mapping. Although synthetic aperture radar (SAR) can provide cloud-penetrating structural information, existing SAR-optical fusion methods often assume reliable optical observations and insufficiently address the semantic uncertainty introduced by cloud contamination. To address this issue, we propose CloudLULC-Net, an end-to-end heterogeneous SAR-optical fusion framework that directly predicts LULC maps from cloud-contaminated Sentinel-2 imagery and temporally adjacent Sentinel-1 SAR observations. The proposed network incorporates optical reliability modulation to suppress unreliable optical responses, heterogeneous information adaptive aggregation to model high-order spatial-channel interactions between optical and SAR representations, and a unified semantic mapping transformer to organize fused features in a LULC-oriented latent space. A semantic anchor-guided optimization strategy is further introduced to improve the consistency of intermediate semantic representations. To support this task, we construct CloudLULC-Set, a large-scale benchmark dataset containing 40,223 curated SAR-optical-label triplets with pixel-level LULC annotations across diverse geographic regions and cloud conditions. Experimental results show that CloudLULC-Net achieves an OA of 86.60%, an F1-score of 83.29%, and an mIoU of 73.51%, outperforming representative heterogeneous reconstruction-first and end-to-end SAR-optical mapping methods. Comparisons with existing global LULC products and analyses under different cloud-cover levels further demonstrate the robustness and practical value of CloudLULC-Net for target-date LULC mapping in cloud-prone regions.The project is publicly available at: https://github.com/RSIIPAC/CloudLULC
Jiangong Xu, Weibao Xue, Xiaoyu Yu +3
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China · Oriental Space Port Research Institute, Yantai, 265100, China · Hubei Luojia Laboratory, Wuhan, 430079, China +3