Organizations: Deep Space Exploration Laboratory, School of Information Science and Technology, University of Science and Technology of China (USTC), Hefei 230026, China
While existing unsupervised domain adaptation (UDA) methods greatly enhance target domain performance in semantic segmentation, they often neglect network calibration quality, resulting in misalignment between prediction confidence and actual accuracy---a significant risk in safety-critical applications. Our key insight emerges from observing that performance degrades substantially when soft pseudo-labels replace hard pseudo-labels in cross-domain scenarios due to poor calibration, despite the theoretical equivalence of perfectly calibrated soft pseudo-labels to hard pseudo-labels. Based on this finding, we propose DA-Cal, a dedicated cross-domain calibration framework that transforms target domain calibration into soft pseudo-label optimization. DA-Cal introduces a Meta Temperature Network to generate pixel-level calibration parameters and employs bi-level optimization to establish the relationship between soft pseudo-labels and UDA supervision, while utilizing complementary domain-mixing strategies to prevent overfitting and reduce domain discrepancies. Experiments demonstrate that DA-Cal seamlessly integrates with existing self-training frameworks across multiple UDA segmentation benchmarks, significantly improving target domain calibration while delivering performance gains without inference overhead.
Figures & tables
Fig. 1: Reliability Diagrams [ 51 ] . We observe that neural networks not only degrade in performance under cross-domain settings but also exhibit poor calibration. Although existing UDA methods, such as DACS [ 68 ] and DAFormer [ 27 ] , significantly improve target-domain performance, they still struggle to produce well-calibrated predictions. When integrated with our proposed DA-Cal, these methods achieve consistently improved calibration, leading to more reliable confidence estimates.
Fig. 2: Pipeline illustration of DA-Cal . Our framework consists of bi-level optimization: inner optimization (Steps 1-2) for calibrating predictions with Meta Temperature Network, and outer optimization (Step 3) for training the segmentation network with both calibrated soft and hard pseudo-labels. The supervised loss on source domain is omitted for clarity.
Figure 3
Method
DACS [ 68 ]
DAFormer [ 27 ]
MIC [ 28 ]
DiDA [ 42 ]
ECE ( ↓ )
NLL ( ↓ )
BS ( ↓ )
ECE ( ↓ )
NLL ( ↓ )
BS ( ↓ )
ECE ( ↓ )
NLL ( ↓ )
BS ( ↓ )
ECE ( ↓ )
NLL ( ↓ )
BS ( ↓ )
GTAv → Cityscapes
NoAdapt
0.2937
2.8097
0.8213
0.2098
1.7237
0.6262
0.1806
1.5172
0.6209
0.1806
1.5172
0.6209
No Calib.
0.2289
1.7445
0.5701
0.1255
0.9084
0.3456
0.1042
0.7659
0.3034
0.0907
0.7089
0.2864
Ensemble
0.1703
1.5054
0.5400
0.0914
0.7325
0.3212
0.0654
0.6971
0.2828
0.0609
0.6748
0.2733
MC Dropout
0.1896
1.6037
0.5579
0.1038
0.7814
0.3341
0.0712
0.7129
0.2924
-
-
-
TABLE I: Calibration Metrics of UDA on Autonomous Driving Scenarios. Note that these metrics on SYN. are calculated over 16 classes.
Method
DA-ISC [ 30 ]
CAFA [ 77 ]
ECE
NLL
BS
ECE
NLL
BS
VNC III → Lucchi (Subset1)
NoAdapt
0.3182
3.5611
0.6522
0.3182
3.5611
0.6522
No Calib.
0.2678
2.1510
0.5501
0.2167
2.0625
0.4445
Ensemble
0.1530
1.0610
0.4662
0.0869
0.7738
0.3544
TempScal-src
0.2011
0.8115
0.4726
0.1744
0.7489
0.3968
TABLE II: Calibration Metrics of UDA on Biomedical Imaging Scenarios, which are calculated only on the foreground.
Method
baseline
w/ DA-Cal
baseline
w/ DA-Cal
GTA. → CS.
SYN. → CS.
DACS* [ 68 ]
51.9
53.5
47.9
49.7
DAFormer [ 27 ]
68.3
69.4
60.9
62.2
MIC* [ 28 ]
75.5
76.3
67.1
68.0
VNC. → Lucchi
Mito.-R → Mito.-H
DA-ISC [ 30 ]
68.7
70.5
74.8
76.1
TABLE III: Segmentation Performance (mIoU) with DA-Cal. ∗ denotes the reproduced result.
Lhard
Lsoft
DA-Cal-PH
DA-Cal-BI
mIoU ( ↑ )
ECE ( ↓ )
✓
68.3
0.1255
✓
61.3
0.0857
✓
67.5
0.0681
✓
✓
68.6
0.1048
✓
✓
69.4
0.0578
✓
✓
69.1
0.0603
TABLE IV: Analysis of Different Implementation with DAFormer [ 27 ] on GTAv → Cityscapes.
Fig. 3: Comparison of DA-Cal and Baseline Methods on Reliability Diagrams.
Fig. 4: Ablation study on temperature scaling for GTAv. → CS. benchmark across different methods.
Fig. 5: Visualization of temperature maps on different benchmarks.
Base
EMA(MTN)
Warm-up ( λsoft )
mIoU (%) ↑
ECE ↓
✓
-
-
68.3
0.1255
-
-
-
68.7
0.0687
-
✓
-
68.9
0.0591
-
-
✓
69.2
0.0633
-
✓
✓
69.4
0.0578
TABLE V: Impact of EMA updates and warm-up calibration on DA-Cal performance.
MTN layers
1
2
3
4
mIoU (%) ↑
68.9
69.4
69.4
69.3
ECE ↓
0.0672
0.0610
0.0578
0.0569
Inner LR
0.1
0.05
0.01
0.001
mIoU (%) ↑
68.7
69.4
69.4
69.1
ECE ↓
0.0710
0.0593
0.0578
0.0649
TABLE VI: Hyperparameter sensitivity analysis for DA-Cal.
Method
GPU Memory (MB)
Training Time (h)
DAFormer
9,807
16.2
w/ DA-Cal
13,409
22.5
DACS
11,078
25.4
w/ DA-Cal
14,485
31.9
TABLE VII: Comparison of GPU memory and training time.
Mixing Strategy
GTA → CS.
VNC. → Lucchi
mIoU ↑
ECE ↓
mIoU ↑
ECE ↓
Baseline
-
68.3
0.2289
71.8
0.2167
ClassMix
Same
69.0
0.0638
72.0
0.0785
Random
69.3
0.0612
72.0
0.0774
Complementary
69.4
0.0578
72.1
0.0705
CutMix
Same
68.9
0.0641
72.6
0.0596
TABLE VIII: Comparison of mixing strategies with DAFormer on GTA → CS. and CAFA on VNC. → Lucchi.
Fig. 6: Visualization of learned temperature maps on different adaptation benchmarks: GTA. → CS. (synthetic-to-real), CS. → ACDC (clear-to-adverse weather), and VNC. → Lucchi (biomedical segmentation).
Fig. 7: Domain Discriminator Loss Curves With/Without GRL Gradients.
Fig. 8: Qualitative failure cases where calibration improves but segmentation does not (Tab. IV : Row 1 vs Row 3). We visualize four classes including frequent classes ( building , car ) and rare classes ( terrain , rider ). For each class, we compare the predictions produced by hard pseudo-label training (row 1) and the calibrated pseudo-label variant (DA-Cal-PH, row 3) using confidence-bin maps. Green indicates correctly segmented regions and red indicates incorrect regions. Although calibration is consistently improved (lower ECE), the IoU does not necessarily increase, illustrating that improved probabilistic calibration is not entirely equivalent to improved argmax segmentation accuracy in self-training-based UDA.
Semantic segmentation provides pixel-level scene understanding essential for autonomous driving and fine-grained perception tasks. However, training segmentation models requires costly, labor-intensive annotations on real-world datasets. Unsupervised Domain Adaptation (UDA) addresses this by training models on labeled synthetic data and adapting them to unlabeled real images. While conceptually simple, adaptation is challenging due to the domain gap, i.e., differences in visual appearance and scene structure between synthetic and real data. Prior approaches bridge this gap through pixel-level mixing or feature-level contrastive learning. Yet, these techniques suffer from two major limitations: (1) reliance on high-confidence pseudo-labels restricts learning to a subset of the target domain, and (2) prototype-based contrastive methods initialize class prototypes from source-trained models, yielding biased and unstable anchors during adaptation. To address these issues, we propose a dual-foundation UDA framework that leverages two complementary foundation models. First, we employ the Segment Anything Model (SAM) with superpixel-guided prompting to enable learning from a broader range of target pixels beyond high-confidence predictions. Second, we incorporate DINOv3 to construct stable, domain-invariant class prototypes through its robust representation learning. Our method achieves consistent improvements of +1.3% and +1.4% mIoU over strong UDA baselines on GTA-to-Cityscapes and SYNTHIA-to-Cityscapes, respectively.
Yerin Cheon, Aruna Balasubramanian, Francois Rameau
Stony Brook University, Stony Brook, NY, USA · SUNY Korea, The State University of New York, Korea
Unsupervised domain adaptation (UDA) for semantic segmentation remains challenging under adverse weather conditions because severe appearance changes enlarge the domain gap and degrade the reliability of pseudo labels in the target domain. To address this problem, we propose an Intra-Class Mixing Consistency (ICM) framework that enforces prediction consistency between an intra-class mixed image and its original counterpart. Unlike previous mixing-based consistency methods that combine regions across different images or domains and may introduce unrealistic semantic inconsistencies, ICM performs mixing within the same image and semantic class, preserving realistic semantic layout for consistency regularization. With ICM, we establish a new state-of-the-art performance for clear-to-adverse-weather unsupervised domain adaptation (UDA) in semantic segmentation. On the Cityscapes → ACDC benchmark, our method achieves 75.7% mIoU, outperforming the previous state of the art by +1.9 pp, demonstrating its effectiveness in mitigating class confusion under challenging environmental conditions. The code is provided in the supplementary material.
Manual dense annotation remains a major obstacle to deploying semantic segmentation models in new driving environments. Active domain adaptation (ADA) seeks label-efficient transfer by annotating only a selected portion of the target domain. Existing ADA methods commonly implement this process through multiple rounds of acquisition, annotation, and retraining. We study a practical one-shot image-level setting that selects and densely annotates a fixed target subset in a single round, followed by uninterrupted adaptation. Within this setting, we develop Target-Calibrated Active Domain Adaptation (TC-ADA) as a joint design of complete-image acquisition and target-calibrated adaptation. Stage1 uses visual representations from a vision foundation model (VFM) together with semantic predictions from a fixed unsupervised domain adaptation model to select representative and informative target images without target annotations. Stage2 jointly uses labeled source data, labeled target data, and the remaining unlabeled target data, while calibrating source and target supervision under limited target labels. Extensive experiments across five synthetic-to-real and real-to-real driving transfers show consistent improvements over representative ADA baselines. With only 23 to 46 labeled target images on four transfers and 140 on Mapillary, TC-ADA stays within 1.9 mean intersection over union (mIoU) points of target-only full supervision. Code will be available at https://github.com/ywher/TC-ADA.
Weihao Yan, Yeqiang Qian, Yueyuan Li +3
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai, 200240, China