Multi-Agent Reinforcement Learning

Also known as MARL

Overview

Multi-agent reinforcement learning studies how multiple decision-makers learn when each agent’s actions affect both the environment and other agents, across cooperative, competitive, and mixed-motive settings. Common approaches include centralized training with decentralized execution, independent or shared actor-critic policies, value factorization such as QMIX, self-play and game-solving methods, and graph-based communication or hierarchical policies. Researchers test these methods in benchmarks such as SMAC, MPE, Overcooked, and multi-agent MuJoCo, and apply them to robotics, traffic, wireless networks, energy systems, and language-agent workflows. A central challenge is scaling coordination and credit assignment while keeping learning stable under non-stationarity and policies robust, safe, and fair with unfamiliar partners and conditions.

Latest papers

CardsList

402 papers37 papers in the last four weeks, down 27% on the four weeks before. 0.3% of all new papers.

  1. When Cooperation Must Change: Semantic Strategy Unlearning in Multi-Agent Reinforcement Learning

    Nov 13, 2026Wenhan Wu, Linghan Chen, Yudong Gao +5Multi-Agent Reinforcement LearningCooperative MARL

  2. From Delegation to Coordination: Learning Efficient Multi-Agent Deep Research

    Nov 12, 2026Yuyang Wu, Yang Liu, Zequn Xie +8Multi-Agent CoordinationMulti-Agent Reinforcement Learning

  3. HALight: Heterogeneous Multi-Agent Reinforcement Learning for Traffic Signal Control under Lane-Level Missing Observations

    Nov 12, 2026Chenkai Hu, Yingqian Zhang, Ming Xie +3Traffic Signal ControlMulti-Agent Reinforcement Learning

  4. A Modular Perspective for Modeling MARL Systems

    Nov 9, 2026Tiziano Maisonhaute, Jean-Christophe Soulié, Fabien MichelMulti-Agent Reinforcement LearningMulti-Agent Systems

  5. M3FT: Micro-Macro-Micro Reasoning for Multi-Agent Cryptocurrency Perpetual Futures Trading

    Nov 7, 2026Jiashun Wang, Beile Wang, Guangyan Gan +5cryptocurrency tradingAlgorithmic Trading

  6. A Separation Principle for Cooperative Multi-Agent Reinforcement Learning

    Nov 6, 2026Lucia Pezzetti, Nicolas Lanzetti, Antonio Terpin +2Cooperative MARLMulti-Agent Reinforcement Learning

  7. CARGO: Causal Attribution and Responsibility-Guided Preventive Safe Multi-Agent Reinforcement Learning for Cooperative Driving

    Nov 6, 2026Jingjia Teng, Yang Li, Wenjie HuangSafe MARLRL for Autonomous Driving

  8. Discovering Update Rules for Opponent Shaping in General-Sum Games

    Nov 5, 2026Hong Jun Lee, Ziyan Wang, Jun Wang +2Game-Theoretic RLMulti-Agent Reinforcement Learning

  9. H^2MARL: Hierarchical Heterogeneous Multi-agent Reinforcement Learning for Humanoid Robot Control

    Nov 4, 2026Xuemin Hu, Kaixin Li, Qingqing Xia +4Humanoid Robot ControlMulti-Agent Reinforcement Learning

  10. Octopus: One Brain, Many Branches for Latent-KV Multi-Agent Reinforcement Learning

    Nov 3, 2026Tianming Sha, Junnan Li, Siqi ZhaoMulti-Agent Reinforcement LearningRL for LLM Agents

  11. Safeguarding Multi-Agent Reinforcement Learning for Connected and Automated Vehicles with Recursively Feasible Control Barrier Functions

    Nov 3, 2026Jianye Xu, Yousef Sayed, Bassam AlrifaeeSafe MARLControl Barrier Functions

  12. Finite-Sample Convergence in Networked Average Reward MARL: Decentralization Pitfalls and Entropy Remedies

    Nov 2, 2026Yizhou Zhang, Yashaswini Murthy, Laixi Shi +1Decentralized MARLMulti-Agent Reinforcement Learning

  13. An Axiomatic Framework for Reinforcement Learning in Open Multi-Agent Systems

    Nov 2, 2026Jianhong Wang, Yang Li, Samuel Kaski +1Multi-Agent Reinforcement LearningCooperative MARL

  14. KlaskTron: An Open-Source Platform for Physical Adversarial Multi-Agent RL

    Nov 2, 2026Aswin Ramachandran, Jona Schulz, Maurus Derungs +3Embodied Agent BenchmarksMulti-Agent Reinforcement Learning

  15. OmniPiano: Diverse Dexterous Piano-Playing Challenges for Standard, Robust, Safe, and Multi-Agent RL

    Oct 30, 2026Fan Xu, Fan Yang, Yifan Xu +7Robot Manipulation BenchmarksRobotic Manipulation

  16. EpiAgent: Epistemic Self-Play for LLM Agents

    Oct 29, 2026Xuanfa Jin, Xinyu Cui, Zhijian Ma +4LLM AgentsLLM Agent Training

  17. Reinforcement Learning for the Game of Balatro: A Fast Simulator and Two-Policy Training Approach

    Oct 28, 2026Ajay Vikram Periasami, Anjaneya Gupta, Ethan Cheng +1RL for Game AIMulti-Agent Reinforcement Learning

  18. CoSTA: Co-Evolving Self-Play Timeline Agents for Complex Temporal Knowledge Graph Question Answering

    Oct 28, 2026Haikun Liu, Zhichao Yan, Shaoru Guo +4Temporal KG Question GenerationKnowledge Graph Question Answering

  19. Does 3D Pose Improve Action Valuation in Football? An Empirical Study of Pose Representations and Learning Objectives

    Oct 28, 2026Rikuhei Umemoto, Kenjiro Ide, Soham Majumder +2Soccer AnalyticsMulti-Agent Reinforcement Learning

  20. Multi-Agent Reinforcement Learning for Global Climate Policy Cooperation

    Oct 27, 2026Anne Moll-Elsborg, Oskar Bohn Lassen, Francisco Camara PereiraMulti-Agent CoordinationMulti-Agent Reinforcement Learning

  21. Multi-Agent Reinforcement Learning of Co-Adaptive Hip Exoskeleton Control (MARL-Exo) for Metabolic Energy Reduction

    Oct 27, 2026Yifei Yuan, Jakob Wolf, Ghaith Androwis +1Hip Exoskeleton ControlAssistive Robotics

  22. Preference-Guided Cooperation in Multi-Objective Multi-Agent Reinforcement Learning

    Oct 26, 2026Qiyue Xia, J. Michael HerrmannMulti-Objective Reinforcement LearningMulti-Agent Reinforcement Learning

  23. Belief-Conditioned Multi-Agent Actor Critic for Decentralized LLM Collaboration

    Oct 26, 2026Tianle Chen, Shuo Liu, Christopher AmatoMulti-Agent LLM SystemsMulti-Agent Reinforcement Learning

  24. BE-CTDE: Blockchain-Enabled Multi-Agent Reinforcement Learning with Anomaly Detection and Token Economics

    Oct 25, 2026Chih-Wei Huang, Hsin-Chieh Lee, Yun-Chen Yu +3Multi-Agent Reinforcement LearningAdversarial MARL

  25. SpecMAGIC: Specification-Guided Multi-Task Generalization in Multi-Agent Reinforcement Learning

    Oct 21, 2026Zijian Guo, İlker Işık, H. M. Sabbir Ahmad +1Multi-Agent Reinforcement LearningMulti-Agent Coordination

  26. JaxMARL-BC: Multi-Agent Reinforcement Learning for Macroeconomic Modelling, in Seconds

    Oct 20, 2026Daniele Montagnani, Andrea Coletta, Antonietta Mira +1Multi-Agent Reinforcement LearningReinforcement Learning