A Large-Scale Remote Sensing Dataset and VLM-based Algorithm for Fine-Grained Road Hierarchy Classification
Organizations: School of Geospatial Engineering and Science, Sun Yat-Sen University, Zhuhai, 519082, China · Transport Bureau of Nanhai District, Foshan, 528200, China · Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China, Chengdu, 611731, China · United Nations University Institute in Macau, Macau S.A.R., China ·
Abstract
In this work, we present SYSU-HiRoads, a large-scale hierarchical road dataset, and RoadReasoner, a vision-language-geometry framework for automatic multi-grade road mapping from remote sensing imagery. SYSU-HiRoads is built from GF-2 imagery covering 3631 km2 in Henan Province, China, and contains 1079 image tiles at 0.8 m spatial resolution. Each tile is annotated with dense road masks, vectorized centerlines, and three-level hierarchy labels, enabling the joint training and evaluation of segmentation, topology reconstruction, and hierarchy classification. Building on this dataset, RoadReasoner is designed to generate robust road surface masks, topology-preserving road networks, and semantically coherent hierarchy assignments. We strengthen road feature representation and network connectivity by explicitly enhancing frequency-sensitive cues and multi-scale context. Moreover, we perform hierarchy inference at the skeleton-segment level with geometric descriptors and geometry-aware textual prompts, queried by vision-language models to obtain linguistically interpretable grade decisions. Experiments on SYSU-HiRoads and the CHN6-CUG dataset show that RoadReasoner surpasses state-of-the-art road extraction baselines and produces accurate and semantically consistent road hierarchy maps with 72.6% OA, 64.2% F1 score, and 60.6% SegAcc. The dataset and code will be publicly released to support automated transport infrastructure mapping, road inventory updating, and broader infrastructure management applications.
Figures & tables
| Dataset | Year | Source | Resolution | Image Size | Data Volume | Task | Multi-Grade | Access. |
| Massachusetts ( Mnih, 2013 ) | 2013 | Aerial Image | 1 m | 1,771 | Road Extraction | ✗ | ✓ | |
| CasNet ( Cheng et al., 2017 ) | 2017 | Google Earth | 1.2 m | 224 | Road Extraction | ✗ | ✗ | |
| DeepGlobe ( Demir et al., 2018 ) | 2018 | DigitalGlobe +Vivid | 0.5 m | 6,226 | Road Extraction | ✗ | ✗ | |
| CHN6-CUG ( Zhu et al., 2021b ) | 2021 | Google Earth | 0.5 m | 4,511 | Road Extraction | ✗ | ✓ | |
| LRSNY ( Chen et al., 2021 ) | 2021 | - | 0.5 m | 1,368 | Road Extraction | ✗ | ✓ | |
| Gansu Mountain ( Zhou et al., 2021 ) | 2021 | ZY-3 | 2 m | 255 | Road Extraction | ✗ | ✓ |
| Recall | Precision | IoU | F1-score | |
| LinkNet | 69.66 | 72.66 | 54.56 | 68.89 |
| D-LinkNet | 70.70 | 70.84 | 54.08 | 68.67 |
| SGCNNet | 64.63 | 73.06 | 51.71 | 66.07 |
| RCFSNet | 74.43 | 71.30 | 57.07 | 71.22 |
| MACUNet | 72.16 | 72.60 | 56.64 | 70.94 |
| FRCFNet | 70.22 | 71.34 | 54.17 | 68.70 |
| Recall | Precision | IoU | F1-score | |
| LinkNet | 37.39 | 73.03 | 33.93 | 44.97 |
| D-LinkNet | 58.75 | 72.76 | 50.02 | 61.94 |
| SGCNNet | 52.42 | 74.70 | 46.36 | 58.06 |
| RCFSNet | 63.25 | 62.47 | 46.79 | 58.67 |
| MACUNet | 52.35 | 69.67 | 43.26 | 55.29 |
| FRCFNet | 58.72 | 71.36 | 49.28 | 61.17 |
| Baseline | PMSE | FDE | Recall | Precision | IoU | F1-score |
| ✓ | 67.48 | 68.73 | 50.79 | 65.50 | ||
| ✓ | ✓ | 71.57 | 70.13 | 54.48 | 68.98 | |
| ✓ | ✓ | 75.16 | 68.39 | 55.24 | 69.81 | |
| ✓ | ✓ | ✓ | 73.46 | 71.89 | 57.16 | 71.21 |
| Category | Descriptors | Symbol | Used |
| Scale | Segment length | ✓ | |
| Scale | Mean road width | ✓ | |
| Shape | Straightness | ✓ | |
| Shape | Mean curvature | ✓ | |
| Shape | Orientation variability | – | |
| Context | Node degree (junctions) | ✓ |
| Variant | OA | mIoU | wF1 | mDice | SegAcc | |
| G | 66.8 | 54.1 | 41.6 | 58.2 | 50.9 | 52.3 |
| G + I | 68.3 | 55.9 | 43.1 | 59.6 | 52.3 | 54.0 |
| G + V | 71.9 | 60.5 | 48.1 | 63.1 | 56.9 | 58.9 |
| G + L | 67.5 | 55.0 | 42.2 | 58.9 | 51.5 | 53.2 |
| Full T-HRN | 72.6 | 61.3 | 48.9 | 64.2 | 57.8 | 60.5 |
| Variant | SegAcc | F1 | IoU | ||||||
| H | M | L | H | M | L | H | M | L | |
| CLIP-B/32 ( Radford et al., 2021 ) | 16.7 | 39.3 | 85.7 | 14.3 | 17.9 | 59.0 | 7.7 | 9.9 | 41.8 |
| CLIP-L/14 ( Radford et al., 2021 ) | 50.0 | 70.4 | 61.1 | 46.8 | 63.2 | 58.7 | 42.0 | 50.6 | 54.2 |
| DINOv2-ViT-B ( Oquab et al., 2023 ) | 58.3 | 76.5 | 88.9 | 55.9 | 71.8 | 82.7 | 38.8 | 56.0 | 70.6 |
| BLIP-Base ( Li et al., 2022a ) | 44.1 | 62.7 | 73.8 | 40.7 | 58.6 | 69.9 | 25.6 | 41.4 | 53.8 |
| SigLIP-Base ( Zhai et al., 2023 ) | 47.5 | 66.0 | 78.4 | 44.3 | 61.5 | 74.8 | 28.4 | 44.4 | 59.7 |