cs.ROOct 18, 2024

MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation

Authors: Toby Godfrey, William Hunt, Mohammad D. Soorati

Organizations: University of Southampton, Southampton, SO17 1BJ, United Kingdom

Abstract

Multi-agent reinforcement learning is a key method for training multi-robot systems. Through rewarding or punishing robots over a series of episodes according to their performance, they can be trained and then deployed in the real world. However, poorly trained policies can lead to unsafe behaviour during early training stages. We introduce Multi-Agent Reinforcement Learning guided by language-based Inter-robot Negotiation (MARLIN), a hybrid framework in which large language models provide high-level planning before the reinforcement learning policy has learned effective behaviours. Robots use language models to negotiate actions and generate plans that guide policy learning. The system dynamically switches between reinforcement learning and language-model-based negotiation during training, enabling more effective exploration. MARLIN is evaluated using both simulated and physical robots with local and remote language models. Results show that, compared to standard multi-agent reinforcement learning, the hybrid approach achieves higher performance in early training with limited impact on the final performance. The code is available at https://github.com/SooratiLab/MARLIN.

Figures & tables

Explore similar work

CardsList
  1. LangMARL: Natural Language Multi-Agent Reinforcement Learning

    Apr 1, 2026Huaiyuan Yao, Longchao Da, Xiaoou Liu +3RL for LLM AgentsMulti-Agent Reinforcement Learning

  2. MA-VLCM: A Vision Language Critic Model for Value Estimation of Policies in Multi-Agent Team Settings

    Mar 16, 2026Shahil Shaik, Aditya Parameshwaran, Anshul Nayak +2Multi-Agent Reinforcement LearningVLMs for Robotics

  3. MARFT: Multi-Agent Reinforcement Fine-Tuning

    Apr 21, 2025Junwei Liao, Muning Wen, Jun Wang +1Multi-Agent LLM SystemsRL Fine-Tuning