Domain Adaptation
Domain adaptation addresses the challenge of applying machine learning models trained on one dataset (the source domain) to a different dataset with a different distribution (the target domain). Current research focuses on techniques like adversarial training, knowledge distillation, and optimal transport to bridge this domain gap, often employing transformer-based models, generative adversarial networks (GANs), and various meta-learning approaches. This field is crucial for improving the robustness and generalizability of machine learning models across diverse real-world applications, particularly in areas with limited labeled data such as medical imaging, natural language processing for low-resource languages, and personalized recommendation systems. The development of standardized evaluation frameworks is also a growing area of focus to ensure fair comparison and reproducibility of results.
Papers
Data Contamination Report from the 2024 CONDA Shared Task
Oscar Sainz, Iker García-Ferrero, Alon Jacovi, Jon Ander Campos, Yanai Elazar, Eneko Agirre, Yoav Goldberg, Wei-Lin Chen, Jenny Chim, Leshem Choshen, Luca D'Amico-Wong, Melissa Dell, Run-Ze Fan, Shahriar Golchin, Yucheng Li, Pengfei Liu, Bhavish Pahwa, Ameya Prabhu, Suryansh Sharma, Emily Silcock, Kateryna Solonko, David Stap, Mihai Surdeanu, Yu-Min Tseng, Vishaal Udandarao, Zengzhi Wang, Ruijie Xu, Jinglin Yang
EUDA: An Efficient Unsupervised Domain Adaptation via Self-Supervised Vision Transformer
Ali Abedi, Q. M. Jonathan Wu, Ning Zhang, Farhad Pourpanah
SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain
Pierre Colombo, Telmo Pires, Malik Boudiaf, Rui Melo, Dominic Culver, Sofia Morgado, Etienne Malaboeuf, Gabriel Hautreux, Johanne Charpentier, Michael Desa
Improving Domain Adaptation Through Class Aware Frequency Transformation
Vikash Kumar, Himanshu Patil, Rohit Lal, Anirban Chakraborty
Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment
Théo Gnassounou, Antoine Collas, Rémi Flamary, Karim Lounici, Alexandre Gramfort
Domain Adaptation for Industrial Time-series Forecasting via Counterfactual Inference
Chao Min, Guoquan Wen, Jiangru Yuan, Jun Yi, Xing Guo
Memory-Efficient Pseudo-Labeling for Online Source-Free Universal Domain Adaptation using a Gaussian Mixture Model
Pascal Schlachter, Simon Wagner, Bin Yang
MC-PanDA: Mask Confidence for Panoptic Domain Adaptation
Ivan Martinović, Josip Šarić, Siniša Šegvić
Contrastive Adversarial Training for Unsupervised Domain Adaptation
Jiahong Chen, Zhilin Zhang, Lucy Li, Behzad Shahrasbi, Arjun Mishra
Calibrated Diverse Ensemble Entropy Minimization for Robust Test-Time Adaptation in Prostate Cancer Detection
Mahdi Gilany, Mohamed Harmanani, Paul Wilson, Minh Nguyen Nhat To, Amoon Jamzad, Fahimeh Fooladgar, Brian Wodlinger, Purang Abolmaesumi, Parvin Mousavi