Distributed RL

RL: Reinforcement Learning

Overview

Distributed reinforcement learning studies how agents can collect experience and learn policies across multiple machines, robots, or networked environments, making training more scalable and enabling decentralized cooperation. Common approaches include parallel actor-learner systems for gathering rollouts, asynchronous policy updates, and consensus-based methods such as distributed Q-learning for agents sharing information over a network. Work spans multi-agent games, robotics, and long-horizon language-model agents, while systems research targets rollout scheduling, experience storage, and efficient model-weight transfer. A central tension is how to increase throughput and reduce communication without letting stale experience, network constraints, or failures undermine learning and reliable deployment.

Latest papers

CardsList

24 papers2 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. WeightBridge: An Efficient Weight Transfer Library for Reinforcement Learning

    Sep 21, 2026Xuanlin Jiang, Samuel Hsia, Michael Kuchnik +3RL for Language ModelsDistributed RL

  2. Conduit: An Experience Data Plane for Distributed Reinforcement Learning

    Sep 21, 2026Sitong Zhang, Tuo Shi, Mario Di Francesco +2Distributed RLReinforcement Learning

  3. Online Reinforcement Learning in the Met Office Unified Model through Distributed Model-Agent Coupling

    Sep 2, 2026Pritthijit Nath, Sebastian Schemm, Peter Haynes +2Weather ForecastingDistributed RL

  4. Variance-Reduced Q-Learning over Static and Time-Varying Networks

    Jul 24, 2026Sreejeet Maity, Feng Zhu, Aritra Mitra +1Reinforcement LearningQ-Learning

  5. Accelerating Disaggregated RL for Visual Generative LLMs with Diffusion-Based Parallelism and Trainer-Assisted Generation

    Jun 23, 2026Sijie Wang, Zhengyu Qing, Zhiqiang Tan +6Reinforcement LearningDistributed RL

  6. Libra: Efficient Resource Management for Agentic RL Post-Training

    Jun 2, 2026Kaiwen Chen, Xin Tan, Jingzong Li +6Agentic RLReinforcement Learning

  7. Darwin Mobile Agent: A Roadmap for Self-Evolution

    May 26, 2026Daniel Beechey, Derek Yuen, Jianheng Liu +5Reinforcement LearningRL for GUI Agents

  8. MADQRL: Distributed Quantum Reinforcement Learning Framework for Multi-Agent Environments

    Apr 13, 2026Abhishek Sawaika, Samuel Yen-Chi Chen, Udaya Parampalli +1Quantum RLDistributed RL

  9. Fully Byzantine-Resilient Distributed Multi-Agent Q-Learning

    Apr 3, 2026Haejoon Lee, Dimitra PanagouMulti-Agent Reinforcement LearningDistributed RL

  10. Heddle: A Distributed Orchestration System for Agentic RL Rollout

    Mar 30, 2026Zili Zhang, Yinmin Zhong, Chengxu Yang +5LLM Agent OrchestrationAgentic RL

  11. Cooperative-Competitive Team Play of Real-World Craft Robots

    Feb 24, 2026Rui Zhao, Xihui Li, Yizheng Zhang +6Cooperative MARLMulti-Robot Coordination

  12. FlexMARL: Graph-Driven Rollout-Training Co-Design for LLM-Based Multi-Agent Reinforcement Learning

    Feb 10, 2026Zhida Jiang, Zhaolong Xing, Jiawei Lu +13Multi-Agent Reinforcement LearningDistributed RL

  13. USER: A Unified and Extensible System for Real-World Online Policy Learning in Embodied AI

    Feb 8, 2026Hongzhi Zang, Shu'ang Yu, Hao Lin +14Robot Policy LearningReinforcement Learning

  14. Power Grid Control with Graph-Based Distributed Reinforcement Learning

    Sep 2, 2025Carlo Fabrizio, Gianvito Losapio, Marco Mussi +2Distributed RLPower Systems

  15. AsyncFlow: An Asynchronous Streaming RL Framework for Efficient LLM Post-Training

    Jul 2, 2025Zhenyu Han, Ansheng You, Haibo Wang +16RL for Language ModelsAsynchronous RL

  16. A Generalist Hanabi Agent

    Mar 17, 2025Arjun V Sudhakar, Hadi Nekoei, Mathieu Reymond +3RL for Game AICooperative MARL