stat.MLFeb 2, 2026

Transfer Learning Through Conditional Quantile Matching

Authors: Yikun Zhang, Steven Wilkins-Reeves, Wesley Lee, Aude Hofleitner

Organizations: Department of Statistics, University of Washington, Seattle, USA · Central Applied Science, Meta, Menlo Park, USA

Abstract

We introduce a transfer learning framework for regression that leverages heterogeneous source domains to improve predictive performance in a data-scarce target domain. Our approach fits a conditional generative model to each source domain and calibrates a shared linear combination of the generated responses via conditional quantile matching at the observed target covariates. The calibration aligns the conditional response distributions while accommodating simultaneous shifts in both the covariate and conditional response distributions. The calibrated responses then serve as pseudo-labels to augment the target data for a broad class of downstream learning tasks. Theoretically, we derive an excess risk bound for an empirical risk minimizer (ERM) trained on the augmented data, separating the benefit of an enlarged training sample from errors due to density ratio estimation, source generator estimation, conditional calibration, and irreducible transfer bias. Empirically, simulations and real-data applications show that the proposed method can improve target-domain prediction when the transfer bias is small.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Conformal Calibration Transfer

    Sep 9, 2026Achref DoulaWeighted Conformal PredictionConformal Prediction