Multi Agent Particle

Multi-agent particle environments serve as crucial testbeds for developing and evaluating multi-agent reinforcement learning (MARL) algorithms, focusing on challenges like decentralized cooperation, efficient exploration, and handling heterogeneous agents with diverse objectives. Current research emphasizes improving MARL's sample efficiency and robustness through techniques such as graph neural networks (GNNs) for agent interaction modeling, intrinsic motivation to address sparse rewards, and novel exploration strategies like meta-exploration and diffusion models. These advancements hold significant implications for various real-world applications requiring coordinated autonomous systems, including robotics, traffic control, and resource management.

Papers

November 6, 2024

CPEG: Leveraging Consistency Policy with Consensus Guidance for Multi-agent Exploration
Yuqian Fu, Yuanheng Zhu, Haoran Li, Zijie Zhao, Jiajun Chai, Dongbin Zhao
Strong Consistency Efficient Exploration Cooperative Agent Multi Agent MuJoCo Multi Agent Particle Multi Agent Exploration Consensus Formation

October 21, 2024

FlickerFusion: Intra-trajectory Domain Generalizing Multi-Agent RL
Woosung Koh, Wonbeen Oh, Siyeol Kim, Suhin Shin, Hyeongjin Kim, Jaein Jang, Junghyun Lee, Se-Young Yun
Multi Agent Reinforcement Learning Domain Generalization Multi Agent Particle Multi Agent RL Inference Stage Trajectory Generalization

October 11, 2024

Kaleidoscope: Learnable Masks for Heterogeneous Multi-agent Reinforcement Learning
Xinran Li, Ling Pan, Jun Zhang
Reinforcement Learning Multi Agent Reinforcement Learning Multi Agent Challenge Parameter Sharing Multi Agent MuJoCo Multi Agent Particle Mask Learning

October 10, 2024

Variational Inequality Methods for Multi-Agent Reinforcement Learning: Performance and Stability Gains
Baraah A. M. Sidahmed, Tatjana Chavdarova
Multi Agent Reinforcement Learning System Performance Actor Critic Algorithm Variational Inequality Multi Agent Setting Multi Agent Particle Multi Agent Deep Deterministic Policy

October 2, 2024

Realizable Continuous-Space Shields for Safe Reinforcement Learning
Kyungmin Kim, Davide Corsi, Andoni Rodriguez, JB Lanier, Benjami Parellada, Pierre Baldi, Cesar Sanchez, Roy Fox
Deep Reinforcement Learning Robotics Domain Action Space Safe Reinforcement Learning Multi Agent Particle Shield Synthesis Non Markovian Safety

August 12, 2024

Enhancing Heterogeneous Multi-Agent Cooperation in Decentralized MARL via GNN-driven Intrinsic Rewards
Jahir Sadik Monon, Deeparghya Dutta Barua, Md. Mosaddek Khan
Multi Agent Reinforcement Learning Multi Agent Graph Neural Single Agent Heterogeneous Agent Intrinsic Motivation Multi Agent Particle Heterogeneous Multi Agent Reinforcement Learning Decentralized Cooperation

May 1, 2024

MESA: Cooperative Meta-Exploration in Multi-Agent Learning through Exploiting State-Action Space Structure
Zhicheng Zhang, Yancheng Liang, Yi Wu, Fei Fang
Multi Agent Reinforcement Learning Efficient Exploration Multi Agent Learning State Action Space Exploration Policy Multi Agent Particle Cooperative Multi Agent Learning Mesa Optimization

March 22, 2024

Collaborative AI Teaming in Unknown Environments via Active Goal Deduction
Zuyuan Zhang, Hanhan Zhou, Mahdi Imani, Taeyoung Lee, Tian Lan
Zero Shot Multi Agent Human Ai Collaboration Unknown Environment Team Performance Multi Agent Particle Dynamic Goal

March 5, 2024

Reaching Consensus in Cooperative Multi-Agent Reinforcement Learning with Goal Imagination
Liangzhou Wang, Kaiwen Zhu, Fengming Zhu, Xinghu Yao, Shujie Zhang, Deheng Ye, Haobo Fu, Qiang Fu, Wei Yang
Multi Agent Cooperative Multi Agent Reinforcement Learning Consensus Group Decision Multi Agent Coordination Multi Agent Particle Multi Agent Rollout Deliberate Imagination

December 5, 2023

MASP: Scalable GNN-based Planning for Multi-Agent Navigation
Xinyi Yang, Xinting Yang, Chao Yu, Jiayu Chen, Huazhong Yang, Yu Wang
Reinforcement Learning Task Planning Potential Scalability Planning Model Multi Agent Navigation Multi Agent Particle

October 18, 2023

Fact-based Agent modeling for Multi-Agent Reinforcement Learning
Baofu Fang, Caiming Zheng, Hao Wang
Multi Agent Reinforcement Learning Agent Model Multi Agent Particle

July 4, 2023

Beyond Conservatism: Diffusion Policies in Offline Multi-agent Reinforcement Learning
Zhuoran Li, Ling Pan, Longbo Huang
Diffusion Model Diffusion Policy Offline Multi Agent Reinforcement Learning Multi Agent Particle Expressive Policy

June 19, 2023

Maximum Entropy Heterogeneous-Agent Reinforcement Learning
Jiarong Liu, Yifan Zhong, Siyi Hu, Haobo Fu, Qiang Fu, Xiaojun Chang, Yaodong Yang
Multi Agent Reinforcement Learning Maximum Entropy Multi Agent Challenge Multi Agent MuJoCo Multi Agent Particle Heterogeneous Multi Agent Reinforcement Learning

February 15, 2023

TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Play
Fanqi Lin, Shiyu Huang, Tim Pearce, Wenze Chen, Wei-Wei Tu
Curriculum Learning Self Play Multi Agent Coordination Multi Agent Particle Modern Reinforcement Learning

February 13, 2023

Order Matters: Agent-by-agent Policy Optimization
Xihuai Wang, Zheng Tian, Ziyu Wan, Ying Wen, Jun Wang, Weinan Zhang
Single Agent Order Matter Multi Agent Policy Multi Agent Particle Simultaneous Improvement

October 9, 2022

ELIGN: Expectation Alignment as a Multi-Agent Intrinsic Reward
Zixian Ma, Rose Wang, Li Fei-Fei, Michael Bernstein, Ranjay Krishna
Multi Agent Reinforcement Learning Intrinsic Reward Expectation Alignment Multi Agent Particle Zero Shot Coordination

August 30, 2022

A further exploration of deep Multi-Agent Reinforcement Learning with Hybrid Action Space
Hongzhi Hua, Guixuan Wen, Kaigui Wu
Deep Reinforcement Learning Environment Exploration Action Space Multi Agent Deep Reinforcement Learning Multi Agent Particle Multi Agent Deep Deterministic Policy

June 1, 2022

Policy Diagnosis via Measuring Role Diversity in Cooperative Multi-agent RL
Siyi Hu, Chuanlong Xie, Xiaodan Liang, Xiaojun Chang
Long Term Cooperation Cooperative Multi Agent Reinforcement Learning Multi Agent Challenge Multi Agent Cooperation Multi Agent Task Multi Agent Particle Multi Agent RL Policy Model Challenging Role Type

April 12, 2022

Multi-agent Actor-Critic with Time Dynamical Opponent Model
Yuan Tian, Klaus-Rudolf Kladny, Qin Wang, Zhiwu Huang, Olga Fink
Multi Agent Reinforcement Learning Opponent Modeling Multi Agent Actor Critic Multi Agent Particle

April 4, 2022

Continuously Discovering Novel Strategies via Reward-Switching Policy Optimization
Zihan Zhou, Wei Fu, Bingliang Zhang, Yi Wu
Reinforcement Learning Policy Gradient Policy OpTimization Multi Agent Particle Novel Strategy