Overview

Transfer learning asks how a model trained on one task or domain can help with another, reducing the need for target-specific data and computation. Common approaches include pretraining followed by fine-tuning or parameter-efficient adapters, feature alignment for domain shifts, and knowledge transfer through distillation, model merging, or shared representations. Evaluations span zero-shot and few-shot transfer, cross-domain benchmarks in vision and language, and adaptation in settings such as clinical data, robotics, and scientific modeling. A central tension is that transferred knowledge can improve accuracy and sample efficiency or cause negative transfer; predicting when it will help, and separating reusable knowledge from dataset or architecture effects, remains difficult.

Latest papers

CardsList

455 papers33 papers in the last four weeks, down 49% on the four weeks before. 0.3% of all new papers.

  1. Generalization error of min-norm interpolators in transfer learning

    Jun 20, 2024Yanke Song, Kenneth Gu, Sohom Bhattacharya +1OOD GeneralizationCross-Domain Transfer Learning

  2. Guided Adversarial Robust Transfer Learning with Source Mixing

    Sep 12, 2023Xin Xiong, Zijian Guo, Tianxi CaiAdversarial RobustnessDistributionally Robust Optimization

  3. Limits of Transfer Learning

    Jun 23, 2020Jake Williams, Abel Tadesse, Tyler Sam +2Transfer Learning

  4. Taskonomy: Disentangling Task Transfer Learning

    Apr 23, 2018Amir Zamir, Alexander Sax, William Shen +3Transfer LearningTask Transferability Estimation