cs.CVSep 28, 2026

WhiteCon: Semi-Supervised Domain Adaptation Regression Through Whitening Transform and Dual Consistency

Authors: Se Jin Sim, Seoung Bum Kim

Organizations: School of Industrial and Management Engineering Korea University, Seoul, Republic of Korea

Abstract

Domain adaptation is crucial for addressing distributional shifts that degrade model performance across domains. While most existing research has centered on classification, semi-supervised domain adaptation regression (SSDAR) for continuous-output tasks remains largely unexplored, particularly in practical scenarios with limited labeled target data. To address this gap, we propose semi-supervised domain adaptation regression through whitening transform and dual consistency (WhiteCon), which combines domain-specific whitening transform (DWT) and dual consistency regularization to enhance training stability and domain adaptation. DWT reduces the variance of the model parameters by transforming the feature covariance matrix into an identity matrix, thus stabilizing training under ordinary least squares assumptions. In addition, variance consistency regularization, as part of dual consistency regularization, aligns the variances of weak, strong, and mixup-augmented features to improve resilience against augmentation-induced perturbations. Empirical evaluations on various benchmark datasets under SSDAR settings demonstrate that the proposed WhiteCon achieves state-of-the-art performance compared to existing methods, effectively addressing domain shifts in regression tasks. The code for WhiteCon is available at https://github.com/sejin-sim/WhiteCon.

Explore similar work

CardsList
  1. DIRA-SS:Dynamic Domain Incremental Regularised Adaptation -- Self-Supervised

    Nov 13, 2023Abanoub Ghobrial, Kerstin EderDomain AdaptationSelf-Supervised Learning

  2. When few labeled target data suffice: a theory of semi-supervised domain adaptation via fine-tuning from multiple adaptive starts

    Jul 19, 2025Wooseok Ha, Yuansi ChenDomain AdaptationTarget Domain

  3. Variance-reduced Domain Adaptation using Paired Sampling

    Jul 22, 2026Andrea NapoliDomain AdaptationVariance Reduction