Multi-Objective Reinforcement Learning

Also known as MORL

Overview

Multi-objective reinforcement learning studies sequential decisions where goals such as safety, efficiency, fairness, and reward quality can conflict. Common approaches learn a set of Pareto-optimal policies or condition one policy on user preferences, using methods such as scalarization, vector-valued critics, policy-gradient updates, and multi-agent coordination. Researchers apply these methods in robotics, traffic and energy control, recommendation, and language-model alignment, evaluating trade-offs with Pareto-front coverage, hypervolume, and task-specific benchmarks. A central challenge is balancing reward signals without letting easier objectives dominate or causing reward hacking, while ensuring policies reliably respond to changing preferences.

Latest papers

CardsList

161 papers24 papers in the last four weeks, up 9% on the four weeks before. 0.2% of all new papers.

  1. CoSlice: Coordinated Multi-Agent Reinforcement Learning for 5G Network Slicing Allocation

    Nov 18, 2026Pengxin Wang, Nakjung Choi, Jingdi ChenNetwork SlicingWireless Resource Allocation

  2. Towards Optimism-Pessimism Trade-off in Model-based Offline-to-Online Reinforcement Learning

    Nov 17, 2026Guochen Zhou, Yijun Yang, Qiqi Duan +6Reinforcement LearningOffline-To-Online RL

  3. Foundation Pareto Flow Policy for Multi-Objective Reinforcement Learning

    Nov 15, 2026Zhanjiang Yang, Lijun Sun, Yueming Li +2Multi-Objective Reinforcement LearningRobotic RL

  4. Policy Optimization With Multiple Verifiers via Pareto Rankings

    Nov 14, 2026Kai Yamashita, Shohei Taniguchi, Hiroki Furuta +2RL for Language Model ReasoningReinforcement Learning with Verifiable Rewards

  5. Binding Mode Matters: Hotspot-Aware Drug Discovery via Explorative Preferences

    Nov 11, 2026Dingshuo Chen, Hao Yang, Kuangqi Zhou +5Molecular GenerationStructure-Based Drug Design

  6. BECON: Belief-Conditioned Constrained Multi-Objective Reinforcement Learning under Drifting Preferences and Budgets

    Nov 9, 2026Bui Trong Duc, Huynh Thi Thanh BinhMulti-Objective Reinforcement LearningPreference-Based RL

  7. LLM-based Multi-Criteria Deep Reinforcement Learning for Dynamic Efficient 5G UPF Selection

    Nov 8, 2026Abdelrahman Soliman, Ahmed Refaey Hussein, Lei LeiWireless CommunicationsMulti-Objective Reinforcement Learning

  8. Multi-Objective Adaptation After Deployment: A Position on World Models for Remote Robot Teams

    Nov 7, 2026Jamie Santos, Kagan TumerRobot Policy AdaptationWorld Models for Robotics

  9. RAGAM-AI: A Hybrid Reinforcement Learning based Agentic approach powered by Generative AI for Edge Resource Management

    Nov 4, 2026Shreya K. Chari, John S. Vardakas, Kostas Ramantas +1Edge ComputingMulti-Agent Resource Allocation

  10. RIDGE: State-Conditioned Reward Blending for Behavioral Coverage in Deep RL Game Agents

    Nov 3, 2026AL Muqshith Mohammed Shifan, Kevin Christopher Chua, Ali Neshati +2Behavioral Diversity in RLReward Design for RL

  11. FB-MOAC: A Reinforcement Learning Algorithm for Forward-Backward Markov Decision Processes

    Oct 29, 2026Mohsen Amidzadeh, Mario Di FrancescoMarkov Decision ProcessesMulti-Objective Reinforcement Learning

  12. Safe Multi-Objective Reinforcement Learning: Zero Constraint Violation and Primal-Averaging Convergence

    Oct 29, 2026Chenxi Li, Yao Shu, Siyang Gao +2Multi-Objective Reinforcement LearningReinforcement Learning

  13. Preference-Guided Cooperation in Multi-Objective Multi-Agent Reinforcement Learning

    Oct 26, 2026Qiyue Xia, J. Michael HerrmannMulti-Objective Reinforcement LearningMulti-Agent Reinforcement Learning

  14. Multi-Objective Reinforcement Learning Using Routed Ensembles and Trajectory Attribution

    Oct 26, 2026Zhenshuo Zhang, Ruoxuan Xiong, Hongyang R. ZhangMulti-Objective Reinforcement LearningReinforcement Learning

  15. GPDPO: Learning from Reward Conflicts via Group Pareto-Dominance Policy Optimization

    Oct 26, 2026Zixuan Xu, Haoxuan Chen, Jiangxin Sun +1Multi-Objective Language Model AlignmentMulti-Objective Reinforcement Learning

  16. Locked In: Multi-Objective RL for the AI Data Center Build-Out

    Oct 26, 2026Satyapragnya Kar, Rajarshi Das, PR PanigrahiMulti-Objective Reinforcement LearningData Center Energy Management

  17. Priority-Preserving Advantage Aggregation for Multi-Reward Policy Optimization

    Oct 26, 2026Xiangchi Yuan, Xingjian Diao, Zheyuan Liu +7Multi-Objective Reinforcement LearningRL Post-Training

  18. PPO vs. SAC: A Comparative Study for Cooperative Motion Control of Dual-Arm Space Robots

    Oct 23, 2026Nasim Fallahiarezoodar, Zheng H. ZhuSpace RoboticsBimanual Robotic Manipulation

  19. One Policy, Many Styles: Where to Aggregate Preferences for Steerable Humanoid Control?

    Oct 20, 2026Ziqian Huang, Yuzhuo Chen, Shimin Zhang +3Preference-Based RLHumanoid Robot Control

  20. Intra-Rubric Reward Divergence: Mitigating Rubric Hacking through Latent Dimension Recovery and Balancing

    Oct 19, 2026Jianqiang Xia, Han Xu, Dianxi ShiReward HackingRubric-Based RL

  21. VaDar: Implicit Goal Conditioning via Value Disaggregation

    Oct 19, 2026Shashwat Saxena, Mehul Goel, Sreyas Venkataraman +2Long-Horizon RLReinforcement Learning

  22. Pareto-Optimal RTL Code Generation via Multi-Objective Reinforcement Learning with Large Language Models

    Oct 16, 2026Koki Takeshita, Kenji Uebayashi, Hikaru Tomonari +6RTL Code GenerationElectronic Design Automation

  23. Each Reward to Its Relevant Tokens: Reward-Specific Token-Level Credit Assignment for Multi-Reward RL

    Oct 15, 2026Skylar Zhai, Haonan Wang, Zhining Liu +4RL for Language ModelsToken-Level Credit Assignment

  24. Multi-Reward Hacking: From Aggregation-Induced Drift to Trust-Anchored Defense

    Oct 15, 2026Yushu Li, Jiin Woo, Xiaoxiao Li +1Reward HackingRL for Language Models