Active domain adaptation researches focus on alleviating the annotation cost, which comprises source data and target data labelling, as well as enhancing the performance of unsupervised domain adaptation. However, optimizing the adaptation model based on the average accuracy can lead to the drop in performance of some difficult categories. To overcome this issue, a point-wise selection strategy built upon the influence function can be used to improve domain adaptation performance. In our work, we first address the sensitive and redundant aspects of point-wise selection, which can lead to overfitting of the acquisition function. We thus introduce a region-based approach that ensures the improvement of the adaptation model by maximizing a positive manifold coverage. An uncertainty score is further introduced to the selection mechanism to learn a better decision boundary for the target domain. In comprehensive experiments, our proposed method surpasses the first category-aware active domain adaptation baseline as well as existing active domain adaptation methods across multiple domain adaptation benchmarks. Our implementation is available at: https://github.com/nhtm2702/WHO IS NEXT.
Figures & tables
Figure 1: KDE plot for behavior of selection strategy of CAADA method in the 2nd active round with two categories, ”Batteries” and ”Trash Can”, in the Ar → Cl task of the OfficeHome dataset.
Figure 2: Illustration of different coverage types between CAADA, MaxHerding and our Positive Manifold method.
Figure 3: Our proposed category-aware active domain adaptation method focuses on individual categories via uncertainty-Guided Region Coverage.
Ar → Cl
Ar → Pr
Ar → Rw
Cl → Ar
Cl → Pr
Cl → Rw
Avg.
DANN
36.99 ± 0.52
51.83 ± 0.20
58.81 ± 0.22
36.54 ± 0.12
48.59 ± 0.35
59.17 ± 0.43
48.65
Random
47.19 ± 0.60
55.41 ± 0.55
70.14 ± 0.34
50.92 ± 0.36
65.08 ± 0.36
62.77 ± 0.33
58.58
CLUE
48.14 ± 0.76
59.34 ± 0.73
74.34 ± 0.60
54.23 ± 0.52
78.74 ± 0.89
66.92 ± 0.88
63.62
DUC
51.23 ± 0.34
61.81 ± 0.12
75.31 ± 0.23
56.41 ± 0.33
79.82 ± 0.24
70.02 ± 0.44
65.76
ISAL
64.84 ± 0.22
79.23 ± 0.12
78.66 ± 0.32
62.93 ± 0.54
81.24 ± 0.55
75.62 ± 0.32
73.75
CAADA
69.17 ± 0.12
88.42 ± 0.10
86.25 ± 0.22
68.89 ± 0.13
84.47 ± 0.15
82.74 ± 0.43
81.01
Table 1: Average per-category predicting accuracy (%) for our proposed method on Office-Home . Avg. column represents the average accuracy across all 6 tasks in the same table.
DomainNet-126
VisDA-2017
cl → pt
cl → rl
cl → sk
sk → cl
sk → pt
sk → rl
Avg.
S → R
DANN
34.18 ± 0.37
42.15 ± 0.32
36.12 ± 0.29
31.82 ± 0.41
56.59 ± 0.38
47.24 ± 0.37
41.35
47.84 ± 0.28
Random
36.25 ± 0.54
44.75 ± 0.43
40.74 ± 0.49
34.41 ± 0.53
58.31 ± 0.39
49.53 ± 0.31
44.00
54.19 ± 0.33
CLUE
38.06 ± 0.34
45.34 ± 0.36
42.28 ± 0.46
35.63 ± 0.48
60.12 ± 0.44
57.37 ± 0.43
46.47
58.54 ± 0.36
DUC
37.53 ± 0.37
48.91 ± 0.33
39.84 ± 0.29
36.12 ± 0.27
61.35 ± 0.33
58.26 ± 0.39
47.02
60.12 ± 0.40
ISAL
45.05 ± 0.19
56.94 ± 0.21
51.31 ± 0.16
40.34 ± 0.26
62.27 ± 0.30
61.64 ± 0.24
52.92
62.31 ± 0.17
Table 2: Average per-category predicting accuracy (%) for Category-Aware Active Domain Adaptation on DomainNet-126 and VisDA-2017 . Avg. column represents the average accuracy across all 6 tasks of DomainNet-126 in this table.
Figure 4: KDE plot for behavior of selection strategy of ours and CAADA in the 2nd active round with two categories, ”Batteries” and ”Trash Can”, in the Ar → Cl task of the OfficeHome dataset.
Figure 5: Comparison data distribution between CAADA and our selection method with the ”Curtains” category in the Ar → Cl task on the Office-Home dataset.
Figure 6: Classification loss on the validation set and predicting accuracy on the target domain in three different categories in the Ar → Pr task on Office-Home dataset.
Figure 7: Comparision between the coverage of our proposed method with the random sampling method on the target domain in two different categories in the Ar → Cl task on Office-Home dataset.
Model
Coverage
Region Wt.
Acc. (%)
Time (s)
CAADA
×
×
74.22±2.36
11407.54
Coverage Only
✓
×
80.83 ± 0.06
664.75
Coverage + Region Wt.
✓
✓
94.98 ± 0.05
1376.05
Table 3: Accuracy and runtime with different model components for domain adaptation task Rw → Pr on Office-Home dataset with three different seed runs.
Figure 8: Comparision between the uncertainty of selected samples of our proposed method with the Coverage Only sampling method on the target domain in two different categories in the Rw → Pr task on Office-Home dataset.
α
β
Acc. (%)
1
0
94.98 ± 0.01
1
1
94.90 ± 0.01
1
−1
94.97 ± 0.02
1
−0.5
94.98 ± 0.05
Table 4: Accuracy with different combinations of positive and negative manifolds for domain adaptation task Rw → Pr on the Office-Home dataset.
Active Test-Time Adaptation (ATTA) improves model robustness under domain shift by selectively querying human annotations at deployment, but existing methods use heuristic uncertainty measures and suffer from low data selection efficiency, wasting human annotation budget. We propose Conformal Prediction Active TTA (CPATTA), which first brings principled, conformal uncertainty with coverage-aware online calibration into ATTA. CPATTA employs smoothed conformal scores with a top-K certainty measure, an online weight-update algorithm driven by pseudo coverage, a domain-shift detector that adapts human supervision, and a staged update scheme that balances human-labeled and model-labeled data. Extensive experiments demonstrate that CPATTA consistently outperforms the state-of-the-art ATTA methods by around 5% in accuracy.
Tingyu Shi, Fan Lyu, Haihua Zhu +2
Computer Science and Engineering, University of California San Diego · New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences · College of Computer Science and Electronic Engineering, Hunan University
Manual dense annotation remains a major obstacle to deploying semantic segmentation models in new driving environments. Active domain adaptation (ADA) seeks label-efficient transfer by annotating only a selected portion of the target domain. Existing ADA methods commonly implement this process through multiple rounds of acquisition, annotation, and retraining. We study a practical one-shot image-level setting that selects and densely annotates a fixed target subset in a single round, followed by uninterrupted adaptation. Within this setting, we develop Target-Calibrated Active Domain Adaptation (TC-ADA) as a joint design of complete-image acquisition and target-calibrated adaptation. Stage1 uses visual representations from a vision foundation model (VFM) together with semantic predictions from a fixed unsupervised domain adaptation model to select representative and informative target images without target annotations. Stage2 jointly uses labeled source data, labeled target data, and the remaining unlabeled target data, while calibrating source and target supervision under limited target labels. Extensive experiments across five synthetic-to-real and real-to-real driving transfers show consistent improvements over representative ADA baselines. With only 23 to 46 labeled target images on four transfers and 140 on Mapillary, TC-ADA stays within 1.9 mean intersection over union (mIoU) points of target-only full supervision. Code will be available at https://github.com/ywher/TC-ADA.
Weihao Yan, Yeqiang Qian, Yueyuan Li +3
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai, 200240, China
With growing privacy and portability concerns, source-free domain adaptation requires only a source pre-trained model and an unlabeled target domain, allowing for effective adaptation to the target data. Most existing self-training methods focus on selecting and exploiting samples with reliable predictions, often neglecting others. Inspired by the finding that deep models learn clean samples faster than noisy ones, we propose a domain-division based progressive learning method named DPL. Specifically, our approach consists of two alternating stages, each beginning with the division of the target domain into easy-to-adapt and hard-to-adapt subdomains based on adaptation difficulty, followed by neighborhood-based pseudo label assignment. In stage one, we enhance classification accuracy through uncertainty-aware self-training and alignment of corresponding classes between subdomains. Stage two then applies tailored learning strategies to each subdomain, starting with consistency learning on the easy-to-adapt samples and progressing to utilizing local structural information for the more challenging ones, thereby mining the intrinsic properties of the target data. Extensive experiments on several widely used benchmarks validate the effectiveness of our approach, demonstrating superior performance compared to state-of-the-art methods. Our code is available at https://github.com/iamjingli/DPL.
Pan Liu, Jing Li, Meng Zhao +3
School of Computer Science and Engineering, Tianjin University of Technology, Tianjin 300384, China