cs.AIOct 27, 2025

Multi-Agent Conditional Diffusion Planning for Decentralized Wireless Resource Allocation

Authors: Kechen Meng, Sinuo Zhang, Rongpeng Li, Yansha Deng, Chan Wang, Zhifeng Zhao

Organizations: the College of Information Science and Electronic Engineering, Zhejiang University · the Department of Engineering, King’s College London, London WC2R 2LS, U.K. · Zhejiang Lab

Abstract

In wireless communication systems, efficient and adaptive resource allocation is essential for enhancing overall Quality of Service (QoS). Compared with conventional Model-Free Reinforcement Learning (MFRL), Model-Based RL (MBRL) first learns a generative world model for subsequent planning, enabling more stable training through the reuse of historical experience. However, deploying MBRL in large-scale wireless networks remains challenging due to high-dimensional stochastic dynamics, strong inter-agent cooperation, and stringent communication constraints. To overcome these challenges, we propose a Multi-Agent Conditional Diffusion Model Planner (MA-CDMP) for decentralized communication resource management. Following the Decentralized Training with Decentralized Execution (DTDE) paradigm, MA-CDMP models each communication node as an autonomous agent and employs Diffusion Models (DMs) to capture environment dynamics. An inverse dynamics model is further incorporated to guide action generation, improving sample efficiency and policy scalability. Moreover, to efficiently approximate large-scale agent interactions, we introduce a Mean Field (MF) mechanism to assist the classifier in conditional DMs. This mitigates inter-agent non-stationarity and enhances cooperation with minimal communication overhead. We further establish an upper bound on the distributional approximation error induced by MF-based diffusion generation, guaranteeing convergence stability and reliable modeling of multi-agent stochastic dynamics. Extensive experiments demonstrate that MA-CDMP consistently outperforms existing MARL baselines in terms of average reward and QoS metrics, showcasing its scalability and practicality for real-world wireless network optimization.

Figures & tables

Explore similar work

CardsList
  1. Foundation Model-Aided Multi-Agent Reinforcement Learning for Wireless Random Access Network Optimization

    Oct 6, 2026Myeung Suk Oh, Zhiyao Zhang, Alvaro Velasquez +2Wireless Resource AllocationDecentralized MARL

  2. Mean-Field Diffuser: Scaling Offline MARL to Thousands of Agents

    May 28, 2026Wenhao Li, Xiangfeng Wang, Bo JinMulti-Agent System OptimizationMean Field Games

  3. Hybrid Offline-Online Multi-Agent Decision Transformers for Wireless Resource Management

    Aug 28, 2026Yiming Zhang, Kun Yang, Cong Shen +1Wireless Resource AllocationDecentralized MARL