A Large-Scale Remote Sensing Dataset and VLM-based Algorithm for Fine-Grained Road Hierarchy Classification
Authors: Ting Han, Xiangyi Xie, Yiping Chen, Yumeng Du, Jin Ma, Aiguang Li, Jiaan Liu, Yin Gao
Organizations: School of Geospatial Engineering and Science, Sun Yat-Sen University, Zhuhai, 519082, China · Transport Bureau of Nanhai District, Foshan, 528200, China · Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China, Chengdu, 611731, China · United Nations University Institute in Macau, Macau S.A.R., China · Moganshan Geospatial Information Laboratory, Deqing, 313200 China
In this work, we present SYSU-HiRoads, a large-scale hierarchical road dataset, and RoadReasoner, a vision-language-geometry framework for automatic multi-grade road mapping from remote sensing imagery. SYSU-HiRoads is built from GF-2 imagery covering 3631 km2 in Henan Province, China, and contains 1079 image tiles at 0.8 m spatial resolution. Each tile is annotated with dense road masks, vectorized centerlines, and three-level hierarchy labels, enabling the joint training and evaluation of segmentation, topology reconstruction, and hierarchy classification. Building on this dataset, RoadReasoner is designed to generate robust road surface masks, topology-preserving road networks, and semantically coherent hierarchy assignments. We strengthen road feature representation and network connectivity by explicitly enhancing frequency-sensitive cues and multi-scale context. Moreover, we perform hierarchy inference at the skeleton-segment level with geometric descriptors and geometry-aware textual prompts, queried by vision-language models to obtain linguistically interpretable grade decisions. Experiments on SYSU-HiRoads and the CHN6-CUG dataset show that RoadReasoner surpasses state-of-the-art road extraction baselines and produces accurate and semantically consistent road hierarchy maps with 72.6% OA, 64.2% F1 score, and 60.6% SegAcc. The dataset and code will be publicly released to support automated transport infrastructure mapping, road inventory updating, and broader infrastructure management applications.
Figures & tables
Dataset
Year
Source
Resolution
Image Size
Data Volume
Task
Multi-Grade
Access.
Massachusetts ( Mnih, 2013 )
2013
Aerial Image
1 m
1,500×1,500
1,771
Road Extraction
✗
✓
CasNet ( Cheng et al., 2017 )
2017
Google Earth
1.2 m
600×600
224
Road Extraction
✗
✗
DeepGlobe ( Demir et al., 2018 )
2018
DigitalGlobe +Vivid
0.5 m
1,024×1,024
6,226
Road Extraction
✗
✗
CHN6-CUG ( Zhu et al., 2021b )
2021
Google Earth
0.5 m
512×512
4,511
Road Extraction
✗
✓
LRSNY ( Chen et al., 2021 )
2021
-
0.5 m
1,000×1,000
1,368
Road Extraction
✗
✓
Gansu Mountain ( Zhou et al., 2021 )
2021
ZY-3
2 m
256×256
255
Road Extraction
✗
✓
Table 1: Summary of existing datasets for road extraction and road network extraction from remote sensing images, compared to our proposed SYSU-HiRoads dataset. SYSU-HiRoads provides aligned pixel-level and vector-level annotations, along with multi-grade hierarchical road attributes.
Figure 1: Coverage Schematic of SYSU-HiRoads Dataset, which covers 3,631 km 2 of land in Henan, China. We use different colors to mark roads of various levels, with red, blue, and yellow representing high, medium, and low levels, respectively.
Figure 2: Representative examples of the SYSU-HiRoads Dataset, which contains road pixel-level and vector-level annotations. We use different colors to mark roads of various levels, with red, blue, and yellow representing high, medium, and low levels, respectively.
Figure 3: Overview of the proposed RoadReasoner framework. Given an input remote sensing image, the upper branch adopts FORCE-Net with the FDE and PMSE modules to extract a complete road mask within the ARR-WB scheme. The lower T-HRN branch receives the extracted road skeleton together with geometric attributes and converts them into textual prompts for a vision–language model (VLM), which infer a linguistic description of the road grade. The predicted grades are then fused with the reconstructed road mask to generate the final grade mask, where roads are color-coded according to their hierarchical classes.
Figure 4: Illustration of Frequency Domain Enhancement Block.
Figure 5: Illustration of Parallel Multi-Scale Feature Extraction Block.
Figure 6: Illustration of multiple backtracking strategy.
Recall
Precision
IoU
F1-score
LinkNet
69.66
72.66
54.56
68.89
D-LinkNet
70.70
70.84
54.08
68.67
SGCNNet
64.63
73.06
51.71
66.07
RCFSNet
74.43
71.30
57.07
71.22
MACUNet
72.16
72.60
56.64
70.94
FRCFNet
70.22
71.34
54.17
68.70
Table 2: Summary of the quantitative results on SYSU-HiRoad dataset. The best results are in bold . (%)
Figure 7: Visualizations of our FORCE-Net compared with different methods on SYSU-HiRoads dataset.
Recall
Precision
IoU
F1-score
LinkNet
37.39
73.03
33.93
44.97
D-LinkNet
58.75
72.76
50.02
61.94
SGCNNet
52.42
74.70
46.36
58.06
RCFSNet
63.25
62.47
46.79
58.67
MACUNet
52.35
69.67
43.26
55.29
FRCFNet
58.72
71.36
49.28
61.17
Table 3: Summary of the quantitative results on CHN6-CUG dataset. The best results are in bold . (%)
Figure 8: Visualizations of our FORCE-Net compared with different methods on CHN6-CUG Road dataset.
Baseline
PMSE
FDE
Recall
Precision
IoU
F1-score
✓
67.48
68.73
50.79
65.50
✓
✓
71.57
70.13
54.48
68.98
✓
✓
75.16
68.39
55.24
69.81
✓
✓
✓
73.46
71.89
57.16
71.21
Table 4: Results for ablation study on SYSU-HiRoads Dataset, where the best results are in bold . (%)
Figure 9: Visualization of ablation study for FORCE-Net. The White, Red, and Blue masks denote the true positive, false positive, and false negative pixels, respectively.
Figure 10: Display of the reconstruction process of the centerline.
Category
Descriptors
Symbol
Used
Scale
Segment length
L
✓
Scale
Mean road width
W
✓
Shape
Straightness
S
✓
Shape
Mean curvature
C
✓
Shape
Orientation variability
O
–
Context
Node degree (junctions)
D
✓
Table 5: Summary of geometric descriptors used in T-HRN. The ✓ indicates whether the descriptor is used in the final configuration.
Variant
OA
κ
mIoU
wF1
mDice
SegAcc
G
66.8
54.1
41.6
58.2
50.9
52.3
G + I
68.3
55.9
43.1
59.6
52.3
54.0
G + V
71.9
60.5
48.1
63.1
56.9
58.9
G + L
67.5
55.0
42.2
58.9
51.5
53.2
Full T-HRN
72.6
61.3
48.9
64.2
57.8
60.5
Table 6: Ablation study of T-HRN on SYSU-HiRoads. G: geometry, I: image features, V: CLIP VLM prior, L: GPT-v language output. The best results are in bold . (%)
Variant
SegAcc
F1
IoU
H
M
L
H
M
L
H
M
L
CLIP-B/32 ( Radford et al., 2021 )
16.7
39.3
85.7
14.3
17.9
59.0
7.7
9.9
41.8
CLIP-L/14 ( Radford et al., 2021 )
50.0
70.4
61.1
46.8
63.2
58.7
42.0
50.6
54.2
DINOv2-ViT-B ( Oquab et al., 2023 )
58.3
76.5
88.9
55.9
71.8
82.7
38.8
56.0
70.6
BLIP-Base ( Li et al., 2022a )
44.1
62.7
73.8
40.7
58.6
69.9
25.6
41.4
53.8
SigLIP-Base ( Zhai et al., 2023 )
47.5
66.0
78.4
44.3
61.5
74.8
28.4
44.4
59.7
Table 7: Ablation study of VLM in T-HRN in terms of road-grade prediction on SYSU-HiRoads. The best results are in bold . (%)
Figure 11: Visualizations of our RoadReasoner on representative cases of SYSU-HiRoads dataset. The red, blue, and yellow represent the high, medium, and low grade roads, respectively.
Road network segmentation from satellite imagery remains challenging due to large geographic variation in road appearance, occlusions, and domain shifts introduced by differing resolutions and sensors. Existing models, typically trained under narrow resolution--region combinations, generalise poorly to unseen environments such as rural settings, regions with distinct road materials, or imagery from new satellite platforms, often producing broken or disconnected predictions. Adapting these models to new domains usually requires retraining or fine-tuning, which is costly and risks catastrophic forgetting. In this work, we reframe global road extraction as a continual adaptation problem rather than an architectural one. Our framework combines cross-resolution knowledge distillation across a resolution-decreasing curriculum, multi-sensor training, and topology-aware supervision, yielding a single model that generalises across 0.3−1.0 m imagery from multiple satellite platforms across continents. On publicly available benchmarks, including City-Scale and Global-Scale, our model outperforms state-of-the-art results by up to 22 F1 points and 15 APLS points, while remaining the most efficient, with 3× faster inference. Our results suggest that improved robustness across diverse sub-meter satellite imagery can be achieved through targeted training strategies, such as data curricula, distillation, and topology-aware losses, rather than increasingly complex architectures.
Sanayya, Rakshith Sathish, Ashwathi Nambiar
SatSure Analytics India Pvt. Ltd., Bengaluru, India
Accurate road segmentation from aerial imagery is fundamental to many geospatial applications. However, existing datasets often suffer from limited scene diversity, low semantic granularity, and poor structural continuity, restricting their generalization across environments. To address these challenges, we introduce WorldRoadSeg-360K, the largest and most diverse road segmentation dataset to date, comprising 366,947 high-resolution images collected from 38 countries and 223 cities across various terrains and continents. WorldRoadSeg-360K serves as a comprehensive benchmark and reveals key challenges in handling diverse and structurally complex scenes. Automated approaches often struggle to preserve road connectivity, while current interactive methods lack efficient, topology-sensitive tools for real-world road editing. To this end, we present RoadGIE, establishing a novel interactive paradigm for road extraction in remote sensing. Unlike prior point- or box-based prompting strategies, RoadGIE supports connectivity-aware prompts, including clicks and scribbles, which inherently align with the topology of road networks. To improve structural consistency and mitigate performance degradation during iterative interactions, RoadGIE integrates an expert-guided prompting strategy and adapts the skeleton-based recall loss for interactive scenarios. RoadGIE achieves state-of-the-art performance in both segmentation accuracy and topological consistency on WorldRoadSeg-360K and other benchmarks, while maintaining efficient operation with only 3.7M parameters. The code are publicly available at: https://github.com/chaineypung/RoadGIE
Chenxu Peng, Chenxu Wang, Yimian Dai +3
NKIARI, Shenzhen Futian · VCIP, CS, Nankai University · AAIS, Nankai University +1
Extracting routable road networks from satellite imagery requires accurate topology recovery beyond pixel-level segmentation. Recent methods decompose the task into keypoint detection and connectivity prediction, but reliably inferring road connectivity under structural ambiguity remains challenging. Overpasses introduce non-planar crossings that can create false shortcuts, and occlusions break visual continuity, requiring long-range structural reasoning. We formulate road extraction as fully unobserved connectivity inference and construct a global but sparse Euclidean graph from detected keypoints to better leverage the long-term context. To improve link prediction, we transform this graph into its line graph and perform reasoning using a Graph Transformer. We propose an end-to-end pipeline that integrates vision-based segmentation, sparse graph construction, and structured inference. Our method explicitly models overpasses and uses topology-preserving vertex extraction to mitigate routing-critical errors. This approach achieves state-of-the-art performance on City-scale, SpaceNet, and Global-scale benchmarks in topology metrics including TOPO-F1 and APLS. In addition to quantitative gains, our method improves reconstruction of multi-level road structures crucial for real-world routing reliability. The code is available at: https://github.com/wzzzzzzy/LineGraph2Road.
Zhengyang Wei, Renzhi Jing, Yiyi He +1
Stanford University, Stanford CA 94305, USA · Georgia Institute of Technology, Atlanta GA 30332, USA