Multi-Task Optimization
Overview
Multi-task optimization studies how to improve several related tasks or objectives together, from training one model across datasets to searching for solutions across related optimization problems. Common approaches share representations or task information, balance losses, and use gradient surgery to reduce interference; multi-objective methods also use scalarization and Pareto-front search to expose trade-offs. Bayesian and evolutionary methods transfer information between tasks, sometimes using task graphs or learned task relationships. A central tension is that sharing can save data and computation but cause negative transfer when tasks differ, while conflicting objectives and mismatched loss scales make reliable balancing difficult.
Latest papers
51 papers4 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.