Decentralized MARL

MARL: Multi-Agent Reinforcement Learning

Overview

Decentralized multi-agent reinforcement learning (MARL) studies how agents can coordinate when each acts on local observations rather than relying on a central controller with complete system information. Common approaches include independent policy or value learning, centralized training with decentralized execution, parameter sharing, graph-based message passing, and distillation of centralized experts; theory also uses potential games, consensus, and regret analysis to establish learning guarantees. Work spans benchmarks such as SMAC and MPE as well as robotics, traffic control, energy networks, and wireless resource allocation, with increasing attention to safety, changing team sizes, and limited communication. A central tension is that local policies can scale and tolerate failures, yet coordination, credit assignment, and global safety are difficult without richer communication or centralized training—and those supports can undermine the autonomy decentralization is meant to provide.

Latest papers

CardsList

130 papers7 papers in the last four weeks, down 61% on the four weeks before. 0.1% of all new papers.

  1. Communications-free Collective Intelligence Via Allocentric Belief

    Nov 18, 2026Cameron Mehlman, Arjun Mulchandani, Hovik Grigoryan +2Multi-Agent CoordinationMulti-Agent Systems

  2. Distilling Safety Filters for Filter-free Multi-agent RL

    Nov 14, 2026Srikar Babu Gadipudi, Somayeh Sojoudi, Claire J. TomlinSafe MARLSafety Filtering

  3. Physical-Risk-Aware Decentralized Agents for Constrained Vehicle Communications

    Nov 12, 2026Haoran Peng, William Weijia Zheng, Hang Liu +1V2X CommunicationRisk-Aware Control

  4. Finite-Sample Convergence in Networked Average Reward MARL: Decentralization Pitfalls and Entropy Remedies

    Nov 2, 2026Yizhou Zhang, Yashaswini Murthy, Laixi Shi +1Decentralized MARLMulti-Agent Reinforcement Learning

  5. RAMA: Retrieval-Augmented Multi-Agent Routing with Episodic Memory for LEO Satellite Networks

    Oct 30, 2026Xin Ming Li, Peng HuLEO Satellite NetworksReinforcement Learning

  6. Belief-Conditioned Multi-Agent Actor Critic for Decentralized LLM Collaboration

    Oct 26, 2026Tianle Chen, Shuo Liu, Christopher AmatoMulti-Agent LLM SystemsMulti-Agent Reinforcement Learning

  7. HA-DiPO: Diffusion Policy Optimization for Heterogeneous Cooperative Transport

    Oct 24, 2026Xuebin Li, Jinpeng Xiao, Zong Chen +4Multi-Robot Cargo TransportationCooperative MARL

  8. Probabilistic Energy Modeling Unifies Versatile Swarm Control

    Oct 22, 2026Xiang Zhou, Xiangyu Zhu, Xintong Wang +5Swarm RoboticsRobotic Control

  9. Learning Self-Orchestration in Decentralized Agent Swarms

    Oct 15, 2026Guowei Xu, Zhenting Qi, Amani Kiruga +2Multi-Agent OrchestrationMulti-Agent Coordination

  10. CALM: Decentralized Control of Cooperative Aerial Manipulation with Multi-Agent Reinforcement Learning

    Oct 13, 2026Jiaxi Huo, Petre Ricioppo, Fausto Francesco LizzioAerial ManipulationDecentralized MARL

  11. Reinforcement Learning Based Heterogeneous Task Allocation Under Spatio-Temporal Environmental Uncertainty for Multi-Robot Teams

    Oct 11, 2026Xi Lin, Yaxuan Li, Paul Szenher +1Multi-Robot Task AllocationDecentralized MARL

  12. Multi-Agent Coordination via Support-Preserving Distillation

    Oct 7, 2026Sangmin Lee, Youngju Na, Chanmi Lee +1Multi-Agent CoordinationOffline MARL

  13. Independent Multi-Agent Reinforcement Learning with Counterfactual Semantic-Social World Models

    Oct 6, 2026Fernando Martinez, Tao Li, Yingdong Lu +1Sequential MARLAction-Conditioned World Models

  14. Foundation Model-Aided Multi-Agent Reinforcement Learning for Wireless Random Access Network Optimization

    Oct 6, 2026Myeung Suk Oh, Zhiyao Zhang, Alvaro Velasquez +2Wireless Resource AllocationDecentralized MARL

  15. Visual Swarm Navigation via Deep Reinforcement Learning and Evolutionary Hybrid Design

    Oct 5, 2026Álvaro Díez, Fidel AznarSwarm RoboticsMulti-Robot Exploration

  16. Taylor Representations for Model-Free RL in Networked MDPs

    Oct 4, 2026Salah Chikhi, Abdelhaq Chaoui, Asuman Ozdaglar +1Markov Decision ProcessesRepresentation Learning for RL

  17. Fully Online Decentralized Learning in Stochastic Games with Unknown Independent Chains

    Oct 1, 2026S. Rasoul EtesamiGame TheoryOnline Mirror Descent

  18. MASkillBlender: Decentralized Whole-Body Coordination for Multi-Humanoid Loco-Manipulation via Skill Blending

    Oct 1, 2026Yifan Hu, Luhang Hong, Mingkang Long +5Humanoid Loco-ManipulationReinforcement Learning

  19. VERA: Verifiable Feasibility Representations with Counterfactual Credit for Constrained Multi-Agent Control

    Sep 30, 2026Bo Yin, Dongbo Li, Hongkai Chen +2Multi-Agent ControlConstrained RL

  20. Physics-Informed Multi-Agent Coordination for Hospital Patient Flow Optimization

    Sep 29, 2026Guoqing Zhang, Rafik Hadfi, Takayuki ItoMulti-Agent CoordinationHealthcare

  21. Fully Decentralized and Safety-Aware Multi-Agent Reinforcement Learning for Control on Networks

    Sep 28, 2026Theodore Rogalski, Shirantha WelikalaSafe MARLMulti-Agent Control

  22. ICMAPE: In-Context Multiagent Pure Exploration

    Sep 27, 2026Xinyi Hu, Alessio Russo, Aldo PacchianoRL ExplorationDecentralized MARL

  23. Reinforcement Learning of Communication in a Mesh of Small Language Models

    Sep 24, 2026Mehmet Kerem TurkcanMulti-Agent CommunicationRL for LLM Agents

  24. A Decentralized Partially Observable Team Decision Methodology with Delayed Information Sharing

    Sep 22, 2026Xiaoxing Ren, Thomas Parisini, Andreas A. MalikopoulosMarkov Decision ProcessesLinear Markov Decision Processes

  25. Fully Byzantine-Resilient Multi-Agent Reinforcement Learning

    Sep 22, 2026Haejoon Lee, Dimitra PanagouDecentralized MARLActor-Critic Methods

  26. Latent Telepathy: Multi-Robot Communication with Self-Supervised Perceptual Latents

    Sep 20, 2026Howard Wang, Han Zheng, Cathy WuMulti-Robot SystemsDecentralized MARL

  27. CoRe-MARL: Cooperative Redistribution Under Unknown Dynamics Using Recurrent Multi-Agent Reinforcement Learning

    Sep 16, 2026Naimur Rahman Chowdhury, Shatabdi Sen Prapti, Md. Salehin Seyam +1Partially Observable RLMulti-Agent Resource Allocation

  28. High-Probability Nash Regret for Decentralized Learning in Markov αα-Potential Games: Episodic and Fully Online Asynchronous Algorithms with Applications to Markov Congestion Games

    Sep 14, 2026S. Rasoul EtesamiPolicy GradientAsynchronous RL

  29. AssemblyGrid v1: A Benchmark for Multi-Robot Production with Temporary Coalitions, Local Information, and Geometric Constraints

    Sep 13, 2026Fouad Bahrpeyma, David Heik, Dirk ReicheltMulti-Robot Task AllocationCooperative MARL