Heterogeneous MARL

MARL: Multi-Agent Reinforcement Learning

Overview

Heterogeneous multi-agent reinforcement learning (MARL) studies coordination when agents differ in capabilities, goals, sensors, or dynamics, as in robot teams, traffic, and network control. Methods include role-conditioned and hierarchical policies, communication and graph-attention architectures, heterogeneous-agent policy optimization such as HAPPO and HATRPO, and scalable approaches based on mean fields or federated learning. Researchers evaluate these methods in settings including Isaac Lab robotics, CybORG cyber defense, and cooperative resource-allocation tasks, often measuring coordination, transfer, fairness, and constraint satisfaction. A central challenge is balancing shared learning and efficient coordination against the need for agent-specific policies that remain robust under changing teammates and environments.

Latest papers

CardsList

35 papers7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

  1. HALight: Heterogeneous Multi-Agent Reinforcement Learning for Traffic Signal Control under Lane-Level Missing Observations

    Nov 12, 2026Chenkai Hu, Yingqian Zhang, Ming Xie +3Traffic Signal ControlMulti-Agent Reinforcement Learning

  2. Cognitive Multi-Agent Search and Rescue: Language-Grounded Hierarchical Reinforcement Learning for Collaborative Robotics

    Nov 9, 2026Sepideh Ravanbakhsh, Hamidreza MoradiSearch-and-Rescue RoboticsMulti-Robot Coordination

  3. Exploration via Exploitation: The Blessing of Reward Diversity in Personalized Federated RL

    Nov 7, 2026Jiin Woo, Gauri Joshi, Yuejie ChiReinforcement LearningFederated RL

  4. Heterogeneous Co-Evolution Learning for Tool-Efficient Search Agents with Zero Labels

    Oct 29, 2026Qin-Wen Luo, Sheng Ren, Xiang Chen +6LLM Agent TrainingLLM Agent Efficiency

  5. HA-DiPO: Diffusion Policy Optimization for Heterogeneous Cooperative Transport

    Oct 24, 2026Xuebin Li, Jinpeng Xiao, Zong Chen +4Multi-Robot Cargo TransportationCooperative MARL

  6. JaxMARL-BC: Multi-Agent Reinforcement Learning for Macroeconomic Modelling, in Seconds

    Oct 20, 2026Daniele Montagnani, Andrea Coletta, Antonietta Mira +1Multi-Agent Reinforcement LearningReinforcement Learning

  7. Decentralized LLM Workflows via Sequential Auctions

    Oct 15, 2026Ian Gemp, Shubhendu Trivedi, Adam Fisch +7Agentic WorkflowsAutomated Bidding

  8. SHRED: Self-Play for Heterogeneous Road-Users without Expert Demonstrations

    Oct 14, 2026Wei-Jer Chang, Zhouchonghao Wu, Akshay Rangesh +3Self-Play RLAutonomous Driving Simulation

  9. On Symmetry for Characterizing Agent Heterogeneity in Multi-Agent Systems

    Oct 13, 2026Jianhong Wang, Jonathan LawryPartially Observable Stochastic GamesMulti-Agent Systems

  10. MARL-BattleGrounds: A Novel JAX-native Benchmark for Heterogeneous and Competitive Multi-agent RL

    Oct 10, 2026Ulixes Tariq Hawili, Subramanian Ramamoorthy, Yoann Altmann +1RL BenchmarksMulti-Agent Reinforcement Learning

  11. VISTA: An Attention-Based Multi-Agent Reinforcement Learning Architecture for Space Situational Awareness Sensor Tasking

    Sep 20, 2026Miguel Leiva-Vélez, Adalberto Claudio Quiros, Nicolas Gaston Rozado +2Active SensingSpace Situational Awareness

  12. Agentic AI Networking for Heterogeneous Unmanned Aerial Systems in Low-Altitude Wireless Networks

    Sep 17, 2026Nguyen Duc Minh Quang, Chang Liu, Shuangyang Li +1LLM-Guided RLWireless Communications

  13. Curriculum-Based Adversarial Heterogeneous Agent Reinforcement Learning for Autonomous Quad-Copter Landing in Maritime Settings

    Sep 11, 2026Allan Minh-Tam Nguyen, Sree Showrya Kotala, Stefan Banioi-Crijman +2Adversarial TrainingAerial Robotics

  14. A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning

    Sep 4, 2026Chongwen Dong, Mithun Paul Saint-Germain, Pinjari Asif +1Robot Policy LearningRobot Policy Adaptation

  15. BVR Sim: An Open and High-Throughput Environment for Heterogeneous Air-Combat Reinforcement Learning

    Aug 26, 2026Haocheng Sun, Mulai TanRL BenchmarksReinforcement Learning

  16. Co-RL: Unsupervised Reasoning Emerges from Diverse Cohort in Multi-agent RL

    Aug 18, 2026Yunhao Yang, Yuexin Bian, Yunjie Tian +6RL for Language Model ReasoningReinforcement Learning

  17. History Matters: Meta-policy Delegation with Heterogeneous Multi-agent Reinforcement Learning

    Aug 4, 2026Ziqing Lu, Avinash Reddy Mudireddy, Sarra Alqahtani +1Multi-Agent SystemsCooperative MARL

  18. Lagrangian or Lyapunov? Multi-Agent Reinforcement Learning under Coupled Finite-Horizon Constraints

    Aug 3, 2026Yeonseo Jeong, Wonhyeok Ko, Songnam HongStochastic OptimizationFair Resource Allocation

  19. Heterogeneous Policy Networks for Composite Robot Team Communication and Coordination

    Jun 18, 2026Esmaeil Seraj, Rohan Paleja, Luis Pimentel +7Multi-Robot CoordinationMulti-Agent Communication

  20. αα-fair heterogeneous agent reinforcement learning

    Jun 11, 2026Yao-hua Franck Xu, Tayeb Lemlouma, Jean-Marie Bonnin +1Algorithmic FairnessPolicy Optimization

  21. A GPU-Parallel Framework for Heterogeneous Multi-Task Reinforcement Learning

    Jun 2, 2026Rui Zhang, Qiwei Wu, Zhengyu Zhang +7Robotic RLLearning from Demonstration

  22. Collaborative Yet Personalized Policy Training: Single-Timescale Federated Actor-Critic

    May 14, 2026Leo Muxing Wang, Pengkun Yang, Lili SuFederated RLActor-Critic Methods

  23. Experience Sharing in Mutual Reinforcement Learning for Heterogeneous Language Models

    May 8, 2026Xiaoze Liu, Dhananjay Ram, Yuting Zhang +3RL for Language ModelsReinforcement Learning

  24. DC-Ada: Reward-Only Decentralized Sensor Adaptation for Heterogeneous Multi-Robot Teams

    Apr 5, 2026Saad AlqithamiGradient-Free OptimizationRobot Policy Adaptation

  25. Collaborative Task and Path Planning for Heterogeneous Robotic Teams using Multi-Agent PPO

    Apr 1, 2026Matthias Rubio, Julia Richter, Hendrik Kolvenbach +1Multi-Robot Task AllocationMulti-Robot Motion Planning

  26. Heterogeneous Self-Play for Realistic Highway Traffic Simulation

    Mar 31, 2026Jinkai Qiu, Alessandro Saviolo, Chaojie Wang +2Autonomous Driving SimulationAutonomous Driving Scenario Generation

  27. Learning Communication Between Heterogeneous Agents in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence

    Mar 17, 2026Alex Popa, Adrian Taylor, Ranwa Al MallahAutonomous Cyber DefenseHeterogeneous MARL