cs.LGMay 3, 2026

CoAction: Cross-task Correlation-aware Pareto Set Learning

Authors: Xinyue ChenYingxuan LiangYiqin HuangChikai ShangHai-Lin LiuFangqing Gu

Organizations: Guangdong University of Technology, Guangzhou, China · Xiamen University, Xiamen, China

Abstract

Pareto set learning (PSL) is an emerging paradigm in multi-objective optimization that trains neural networks to map preference vectors to Pareto optimal solutions. However, existing PSL methods primarily focus on solving a single multi-objective optimization problem at a time. This limitation not only increases computational costs in multi-objective multitask optimization scenarios by requiring a separate model for each task, but also fails to exploit the inter-task correlations across tasks. To address this, we propose a Cross-tAsk correlation-aware Pareto Set Learning (CoAction) framework, which leverages task-aware transformer to handle multiple tasks simultaneously. Specifically, by assigning task-specific embedding vectors to individual tasks, the model effectively distinguishes between tasks while facilitating knowledge sharing among them. We utilize a Transformer encoder as the backbone architecture to leverage its self-attention mechanism for capturing complex task dependencies. The proposed approach is evaluated on comprehensive multitask test suites covering both benchmark problems and real-world applications, demonstrating effectiveness and competitive performance in Hypervolume, Range, and Sparsity.

Explore similar work

CardsList
  1. Interactive Pareto navigation for deep multi-task learning

    Jun 17, 2026Augustina C. Amakor, Konstantin Sonntag, Sebastian PeitzPareto FrontierMulti--Task Learning

  2. Multi-Task Optimization over Networks of Tasks

    Apr 23, 2026Julian Hatzky, Thomas Bartz-Beielstein, A. E. Eiben +1Multi--Task LearningMulti-Objective Optimization