JCAS-MARL: Joint Communication and Sensing UAV Networks via Resource-Constrained Multi-Agent Reinforcement Learning
Organizations: ICTEAM, Université catholique de Louvain Ottignies-Louvain-la-Neuve, Belgium
Abstract
Multi-UAV networks are increasingly deployed for large-scale inspection and monitoring missions, where operational performance depends on the coordination of sensing reliability, communication quality, and energy constraints. In particular, the rapid increase in overflowing waste bins and illegal dumping sites has created a need for efficient detection of waste hotspots. In this work, we introduce JCAS-MARL, a resource-aware multi-agent reinforcement learning (MARL) framework for joint communication and sensing (JCAS)-enabled UAV networks. Within this framework, multiple UAVs operate in a shared environment where each agent jointly controls its trajectory and the resource allocation of an OFDM waveform used simultaneously for sensing and communication. Battery consumption, charging behavior, and associated CO emissions are incorporated into the system state to model realistic operational constraints. Information sharing occurs over a dynamic communication graph determined by UAV positions and wireless channel conditions. Waste hotspot detection requires consensus among multiple UAVs to improve reliability. Using this environment, we investigate how MARL policies exploit the sensing-communication-energy trade-off in JCAS-enabled UAV networks. Simulation results demonstrate that adaptive pilot-density control learned by the agents can outperform static configurations, particularly in scenarios where sensing accuracy and communication connectivity vary across the environment.
Figures & tables
| Symbol | Value | Role |
|---|---|---|
| Carrier frequency of OFDM waveform. | ||
| Total bandwidth; sets radar resolution scale. | ||
| Transmit power per UAV. | ||
| TX/RX antenna gains. | ||
| Effective radar cross section of hotspot . | ||
| Sensing noise floor. |
| Category | Parameter | Value |
| Environment Configuration | ||
| Grid size | cells | |
| Cell size | m | |
| Number of UAVs | ||
| Number of hotspots | ||
| Max steps per episode | ||
| Method | ||||
|---|---|---|---|---|
| PPO | 402 | 598 | 1253 | 1751 |
Integrated Sensing and Communication
Integrated sensing and communication combines wireless data links with radar-like perception using shared signals, spectrum, and hardware.
See all 47 papers