Fine-resolution land-use segmentation and synthetic image-label augmentation in the Kathmandu Valley
Organizations: Department of Electronics and Computer Engineering, Institute of Engineering, Thapathali Campus, Tribhuvan University, Kathmandu, 44600, Bagmati Province, Nepal
Abstract
Parcel-scale land-use data is missing for most rapidly urbanizing Global South cities, as current segmentation architectures rely on multispectral imagery and planned layouts. We introduce a hand-annotated six-class land-use corpus covering 202 km of Kathmandu Valley across 408 fine-resolution RGB scenes. The dataset is uniquely challenging: RGB spectral similarity is high, class imbalance approaches 100:1, and key structural features like rivers measure just two to three pixels wide at a standard hierarchical decoder's prediction stride. Evaluating five architectures reveals that standard random data splitting conceals massive spatial leakage. Switching to a strict sequence-block split drops performance by up to 0.095 mIoU. This penalty exceeds the performance gap between the architectures themselves. We modified the SegFormer baseline by integrating a half-resolution residual detail path, boundary-reliability reweighting, a topology-aware loss, and a presence-balanced sampler. Adding only 1.9% more parameters, the enhanced architecture improves mean IoU across every test fold, with gains concentrated in rare, thin-structure classes. However, both models achieve identical results on the external LoveDA benchmark. Finally, augmenting with diffusion-generated pairs at matched compute degraded accuracy across all architectures, especially harming rare classes it aimed to improve. This demonstrates that blindly incorporating synthetic data can severely damage performance, highlighting a critical need to rigorously evaluate and filter generated samples before training.
Figures & tables
| Control | True (m) | Measured (px) | GSD | Error (px) |
| Penalty area width | 40.32 | 134.50 | 0.2998 | 0.82 |
| Penalty area depth | 16.50 | 55.20 | 0.2989 | 0.49 |
| Goal area width | 18.32 | 59.85 | 0.3061 | 0.89 |
| Goal area depth | 5.50 | 17.81 | 0.3087 | 0.42 |
| Length-weighted | — | — | 0.3016 | — |
| Half-range | — | — | 0.0049 | — |
| Class | Share | Area | Tiles | Worst | Width | px @ |
| (%) | (km 2 ) | JM | (m) | |||
| Residential | 56.02 | 113.41 | 360 | 0.204 | — | — |
| Agricultural | 18.10 | 36.64 | 191 | 0.051 | — | — |
| Unused land | 12.97 | 26.25 | 225 | 0.051 | — | — |
| Forest | 10.39 | 21.02 | 132 | 0.476 | — | — |
| Road | 1.57 | 3.18 | 214 | 0.290 | 11.54 | 2.10 |
| Architecture | Sequence-block split | Random split | Gap | SD ratio | ||||||
| Fold 0 | Fold 1 | Fold 2 | Mean (SD) | Fold 0 | Fold 1 | Fold 2 | Mean (SD) | |||
| U-Net (R18) | 0.3213 | 0.4516 | 0.4228 | 0.3986 (0.0684) | 0.4533 | 0.4465 | 0.4484 | 0.4494 (0.0035) | 0.0508 | 19.5 |
| UNetFormer (R18) | 0.2795 | 0.5069 | 0.4736 | 0.4200 (0.1228) | 0.5263 | 0.5007 | 0.4905 | 0.5058 (0.0184) | 0.0858 | 6.7 |
| SegFormer-B0 | 0.2877 | 0.4657 | 0.4351 | 0.3962 (0.0952) | 0.4948 | 0.4736 | 0.4611 | 0.4765 (0.0170) | 0.0803 | 5.6 |
| SegNeXt-T | 0.3345 | 0.5701 | 0.5122 | 0.4723 (0.1228) | 0.5646 | 0.5498 | 0.5450 | 0.5531 (0.0102) | 0.0809 | 12.0 |
| Proposed | 0.3403 | 0.5582 | 0.5061 | 0.4682 (0.1138) | 0.5525 | 0.5650 | 0.5717 | 0.5631 (0.0097) | 0.0949 | 11.7 |
| Class | Block | Random | Penalty |
| Residential | 0.7093–0.7872 | 0.7969–0.8354 | 0.0669 |
| Agricultural | 0.4757–0.5311 | 0.4614–0.5324 | 0.0144 |
| Forest | 0.5694–0.5935 | 0.6027–0.6690 | 0.0593 |
| Road | 0.2461–0.3918 | 0.2886–0.4526 | 0.0573 |
| Unused land | 0.1899–0.2428 | 0.2893–0.3978 | 0.1301 |
| River | 0.0868–0.3305 | 0.1546–0.5155 | 0.1433 |
| Architecture | Mean IoU | River IoU | ||||||
| R0 | R1 | 95 % CI | R0 | R1 | 95 % CI | |||
| U-Net (R18) | 0.4572 | 0.4515 | 0.0057 | [ 0.0130, 0.0021] | 0.1587 | 0.1181 | 0.0406 | [ 0.0520, 0.0291] |
| UNetFormer (R18) | 0.5055 | 0.4897 | 0.0159 | [ 0.0292, 0.0022] | 0.3290 | 0.2281 | 0.1008 | [ 0.1225, 0.0778] |
| SegFormer-B0 | 0.4646 | 0.4575 | 0.0071 | [ 0.0180, 0.0037] | 0.1463 | 0.1138 | 0.0324 | [ 0.0457, 0.0209] |
| SegNeXt-T | 0.5675 | 0.5311 | 0.0364 | [ 0.0496, 0.0214] | 0.4535 | 0.3463 | 0.1072 | [ 0.1310, 0.0839] |
| Proposed | 0.5608 | 0.5560 | 0.0047 | [ 0.0170, 0.0078] | 0.4761 | 0.4723 | 0.0039 | [ 0.0416, 0.0351] |
| Class | Mean | CI excl. 0 | Layout fidelity | Contam. (%) | ||
| Synthetic | Real | Ratio | ||||
| River | 0.0570 | 4 / 0 | 0.0567 | 0.1339 | 0.424 | 47.2 |
| Road | 0.0310 | 3 / 0 | 0.2187 | 0.2991 | 0.731 | 39.1 |
| Residential | 0.0101 | 3 / 0 | 0.8143 | 0.8006 | 1.017 | 0 9.3 |
| Forest | 0.0058 | 0 / 0 | 0.6757 | 0.7472 | 0.904 | 16.2 |
| Agricultural | 0.0059 | 0 / 1 | 0.5436 | 0.5626 | 0.966 | 22.8 |
| Configuration | mIoU | mIoU | River | Road | Unused |
| Full model | 0.5582 | — | — | — | — |
| detail path | 0.5449 | 0.0133 | 0.0392 | 0.0295 | 0.0180 |
| sampler | 0.5509 | 0.0073 | 0.0030 | 0.0075 | 0.0262 |
| soft-clDice | 0.5522 | 0.0060 | 0.0162 | 0.0159 | 0.0004 |
| reweighting | 0.5564 | 0.0018 | 0.0077 | 0.0013 | 0.0024 |
| Sum of the four | — | 0.0284 | — | — | — |
Remote Sensing Image Segmentation
Remote sensing image segmentation labels land cover and objects in satellite, aerial, radar, and multispectral imagery.
See all 232 papers