Multi-Task Learning

Ask about this topic

Overview

Multi-task learning studies how one model can learn several related predictions at once, using shared information to improve accuracy, data efficiency, or deployment cost. Common designs combine a shared encoder with task-specific heads, adapters, or routed experts; other methods balance losses, adjust conflicting gradients, or group tasks by affinity. Applications range from dense vision benchmarks such as NYUv2 and Cityscapes to language, medical prediction, recommendation, and scientific modeling. The central tension is positive versus negative transfer: sharing can help when tasks have useful common structure, but differences in data, objectives, or capacity can cause gains for some tasks and losses for others.

Latest papers

CardsList

391 papers50 papers in the last four weeks, up 16% on the four weeks before. 0.3% of all new papers.

  1. AURORA: Adaptive Unified Representation for Robust Ultrasound Analysis

    Mar 19, 2026Ufaq Khan, L. D. M. S. Sai Teja, Ayuba Shakiru +4Medical Image AnalysisUltrasound Imaging

    MBZUAI, Abu Dhabi, UAE · NIT Silchar, India · Birmingham City University, UK

  2. Understanding Task Aggregation for Generalizable Ultrasound Foundation Models

    Mar 18, 2026Fangyijie Wang, Tanya Akumu, Vien Ngoc Dang +5Medical Imaging Foundation ModelsMulti-Task Learning

    Research Ireland Centre for Research Training in Machine Learning · School of Medicine, University College Dublin, Dublin, Ireland · Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain +4

  3. MoE-ACT: Scaling Multi-Task Bimanual Manipulation with Sparse Task-Conditioned Mixture-of-Experts Transformers

    Mar 16, 2026Kangjun Guo, Haichao Liu, Yanji Sun +3Bimanual Robotic ManipulationVisuomotor Policy Learning

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China · The Hong Kong University of Science and Technology, Hong Kong SAR, China

  4. Multi-Task Genetic Algorithm with Multi-Granularity Encoding for Protein-Nucleotide Binding Site Prediction

    Mar 16, 2026Yiming Gao, Liuyi Xu, Pengshan Cui +3Multi-Task LearningMulti-Scale Feature Fusion

    College of Information Science and Engineering, Northeastern University, Shenyang, 110819, China · School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China · Key Laboratory of Data Analytics and Optimization for Smart Industry, Ministry of Education, Northeastern University, Shenyang, 110819, China

  5. HMS-BERT: Hybrid Multi-Task Self-Training for Multilingual and Multi-Label Cyberbullying Detection

    Mar 13, 2026Zixin Feng, Xinying Cui, Yifan Sun +5Multi-Label ClassificationMulti-Task Learning

    School of AI and Advanced Computing, XJTLU Entrepreneur College (Taicang), Xi’an Jiaotong-Liverpool University, Suzhou 215123, China

  6. A Multitask Large Reasoning Model for Molecular Science

    Mar 13, 2026Pengfei Liu, Shuang Ge, Xiaobo Wang +6Scientific ReasoningMulti-Task Learning

    Guangzhou Key Laboratory of Forensic Multi-Omics for Precision Identification, Southern Medical University, Guangzhou, Guangdong, 510515, China · Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, Guangdong 518000, China · Guangdong Provincial Key Laboratory of Psychoactive Substances Monitoring and Safety, Anti-Drug Technology Center of Guangdong Province (National Anti-Drug Laboratory Guangdong Regional Center), Guangzhou, 510230, China +4

  7. Expert Pyramid Tuning: Efficient Parameter Fine-Tuning for Expertise-Driven Task Allocation

    Mar 13, 2026Jia-Chen Zhang, Zhen-Wei Yan, Yu-Jie Xiong +1Parameter-Efficient Fine-TuningLow-Rank Adaptation

    School of Electronic and Electrical Engineering, Shanghai University of Engineering Science 333 Longteng Road, Shanghai, China

  8. NeuroLoRA: Context-Aware Neuromodulation for Parameter-Efficient Multi-Task Adaptation

    Mar 12, 2026Yuxin Yang, Haoran Zhang, Mingxuan Li +6Parameter-Efficient Fine-TuningLow-Rank Adaptation

    Shanghai University · Fudan University

  9. Gaussian Process Regression-based Knowledge Distillation Framework for Simultaneous Prediction of Physical and Mechanical Properties of Epoxy Polymers

    Mar 12, 2026Sindu B. S., Jan HamaekersMaterials Property PredictionPolymer Property Prediction

    Special and Multifunctional Structures Laboratory, CSIR-Structural Engineering Research Centre, Taramani, Chennai, Tamil Nadu, India - 600113. · Fraunhofer Institute for Algorithms and Scientific Computing SCAI, Schloss Birlinghoven, 53757 Sankt Augustin, Germany

  10. Multi-Task Anti-Causal Learning for Reconstructing Urban Events from Residents' Reports

    Mar 12, 2026Liangkai Zhou, Susu Xu, Shuqi Zhong +1Structural Causal ModelsMulti-Task Learning

    Stony Brook University Stony Brook, New York, United States · Johns Hopkins University Baltimore, Maryland, United States

  11. UniPINN: A Unified PINN Framework for Multi-task Learning of Diverse Navier-Stokes Equations

    Mar 11, 2026Dengdi Sun, Jie Chen, Xiao Wang +1Physics-Informed MLMulti-Task Learning

    Key Laboratory of Intelligent Computing & Signal Processing (ICSP), Ministry of Education, School of Artificial Intelligence, Anhui University, Hefei 230601, China · Anhui Provincial Key Laboratory of Multimodal Cognitive Computing, School of Computer Science and Technology, Anhui University, Hefei 230601, China

  12. No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Space

    Mar 10, 2026Yundi Zhang, Sevgi Gokce Kafali, Niklas Bubeck +2Medical Image Representation LearningCardiac MRI

    Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany · Department of Computing, Imperial College London, United Kingdom · Munich Center for Machine Learning, Technical University of Munich, Germany

  13. A Unified Hierarchical Multi-Task Multi-Fidelity Framework for Data-Efficient Surrogate Modeling in Manufacturing

    Mar 10, 2026Manan Mehta, Zhiqiao Dong, Yuhang Yang +1Surrogate ModelingMultifidelity Modeling

    Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, United States · Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 41809, United States

  14. SurgFed: Language-guided Multi-Task Federated Learning for Surgical Video Understanding

    Mar 10, 2026Zheng Fang, Ziwei Niu, Ziyue Wang +5Surgical Video UnderstandingFederated Learning

    National University of Singapore, Singapore · Spectral AI Team, The Hong Kong University of Science and Technology (Guangzhou), China · Zhejiang University, China +1

  15. Multi-Kernel Gated Decoder Adapters for Robust Multi-Task Thyroid Ultrasound under Cross-Center Shift

    Mar 9, 2026Maziar Sabouri, Nourhan Bayasi, Arman RahmimThyroid Nodule DetectionUltrasound Image Segmentation

    Department of Astronomy and Physics, University of British Columbia, Vancouver, Canada · Department of Basic and Translational Research, BC Cancer Research Institute, Vancouver, Canada · Department of Radiology, University of British Columbia, Vancouver, Canada +1

  16. Real-Time Monocular Scene Analysis for UAV in Outdoor Environments

    Mar 9, 2026Yara AlaaEldinMonocular Depth EstimationSynthetic-to-Real Domain Adaptation

    University of Genova; DRIM; Ph.D. Program of National Interest in Robotics and Intelligent Machines; Administrative Headquarters: Università di Genova

  17. Efficient RGB-D Scene Understanding via Multi-task Adaptive Learning and Cross-dimensional Feature Guidance

    Mar 8, 2026Guodong Sun, Junjie Liu, Gaoyang Zhang +23D Scene UnderstandingSemantic Segmentation

    School of Mechanical Engineering, Hubei University of Technology, Wuhan, 430068, China · Hubei Key Laboratory of Modern Manufacturing Quality Engineering, Hubei University of Technology, Wuhan, 430068, China · Vehicle Measurement, Control and Safety Key Laboratory of Sichuan Province, Xihua University, Chengdu, 610039, China +2

  18. A Joint Neural Baseline for Concept, Assertion, and Relation Extraction from Clinical Text

    Mar 8, 2026Fei Cheng, Ribeka Tanaka, Sadao KurohashiClinical Information ExtractionRelation Extraction

    Kyoto University · Tokyo University of Technology · National Institute of Informatics

  19. Feed m Birds with One Scone: Accelerating Multi-task Gradient Balancing via Bi-level Optimization

    Mar 8, 2026Xuxing Chen, Yun He, Jiayi Xu +9Multi-Task LearningBilevel Optimization

    Meta

  20. PCOV-KWS: Multi-task Learning for Personalized Customizable Open Vocabulary Keyword Spotting

    Mar 5, 2026Jianan Pan, Kejie HuangKeyword SpottingMulti-Task Learning

    Zhejiang University, Hangzhou, China

  21. Asymptotic Behavior of Multi--Task Learning: Implicit Regularization and Double Descent Effects

    Mar 5, 2026Ayed M. Alrashdi, Oussama Dhifallah, Houssem SifaouDouble DescentNeural Network Generalization

    Department of Electrical Engineering, College of Engineering, University of Ha’il, P.O. Box 2440, Ha’il, 81441, Saudi Arabia · John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA · Department of Electrical and Electronic Engineering, King’s College London – Strand, London WC2R 2LS – London, UK

  22. Lightweight and Scalable Transfer Learning Framework for Load Disaggregation

    Mar 5, 2026L. E. Garcia-Marrero, G. Petrone, E. MonmassonNon-Intrusive Load MonitoringTransfer Learning

    Systèmes et Applications des Technologies de l’Information et de l’Energie laboratory, Cergy-Pontoise · Dipartimento di Ingegneria dell’Informazione ed Elettrica e Matematica Applicata/DIEM, University of Salerno, 84084 Fisciano

  23. TSEmbed: Unlocking Task Scaling in Universal Multimodal Embeddings

    Mar 5, 2026Yebo Wu, Feng Liu, Ziwei Xie +4Multimodal EmbeddingMultimodal Disentangled Representation Learning

    State Key Laboratory of IOTSC, University of Macau · OPPO Research Institute

  24. A Unified Framework for Joint Detection of Lacunes and Enlarged Perivascular Spaces

    Mar 4, 2026Lucas He, Krinos Li, Hanyuan Zhang +7NeuroimagingBrain MRI

    Hawkes Institute, University College London, UK · Unit for Lifelong Health and Aging, University College London, UK · Bioengineering Department and Imperial-X, Imperial College London, UK +6

  25. Crab+^{+}: A Scalable and Unified Audio-Visual Scene Understanding Model with Explicit Cooperation

    Mar 4, 2026Dongnuan Cai, Henghui Du, Chang Zhou +5Audio-Visual UnderstandingUnified Multimodal Models

    Gaoling School of Artificial Intelligence, Renmin University of China · Institute of Artificial Intelligence of China Telecom (TeleAI) · AI Technology Center, Online Video Business Unit, Tencent PCG +2

  26. CLIP-Guided Multi-Task Regression for Multi-View Plant Phenotyping

    Mar 4, 2026Simon Warmers, Muhammad Zawish, Fayaz Ali Dharejo +2Plant PhenotypingMulti-View Learning

    Computer Vision Lab, CAIDAS, IFI, University of Würzburg, Germany · Technological University Dublin, Ireland

  27. BD-Merging: Bias-Aware Dynamic Model Merging with Evidence-Guided Contrastive Learning

    Mar 4, 2026Yuhan Xie, Chen LyuModel MergingDistribution Shift Robustness

    MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics

  28. Trade-offs in Ensembling, Merging and Routing Among Parameter-Efficient Experts

    Mar 3, 2026Sanae Lotfi, Lucas Caccia, Alessandro Sordoni +2Language Model EnsemblesLanguage Model Merging

    1New York University · 2Microsoft Research

  29. Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning

    Mar 3, 2026Achleshwar Luthra, Yash Salunkhe, Tomer GalantiNeural CollapseTransfer Learning

    Department of Computer Science & Engineering, Texas A&M University.

  30. NeuroProlog: Multi-Task Fine-Tuning for Neurosymbolic Mathematical Reasoning via the Cocktail Effect

    Mar 3, 2026Pratibha Zunjare, Michael HsiaoLLM Mathematical ReasoningNeuro-Symbolic Reasoning

    Electrical and Computer Engineering, Virginia Tech, Blacksburg, USA