WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaboration
Organizations: School of Computer Science and Technology, Tianjin University · School of Cybersecurity, Tianjin University
Abstract
Collaborative perception is vital for autonomous driving yet remains constrained by tight communication budgets. Earlier work reduced bandwidth by compressing full feature maps with fixed-rate encoders, which adapts poorly to a changing environment, and it further evolved into spatial selection methods that improve efficiency by focusing on salient regions, but this object-centric approach often sacrifices global context, weakening holistic scene understanding. To overcome these limitations, we introduce WhisperNet, a bandwidth-aware framework that proposes a novel, receiver-centric paradigm for global coordination across agents. Senders generate lightweight saliency metadata, while the receiver formulates a global request plan that dynamically budgets feature contributions across agents and features, retrieving only the most informative features. A collaborative feature routing module then aligns related messages before fusion to ensure structural consistency. Extensive experiments show that WhisperNet achieves state-of-the-art performance, improving [email protected] on OPV2V by 2.4% with only 0.5% of the communication cost. As a plug-and-play component, it boosts strong baselines with merely 5% of full bandwidth while maintaining robustness under localization noise. These results demonstrate that globally-coordinated allocation across what and where to share is the key to achieving efficient collaborative perception.
Figures & tables
| Experts | [email protected]/0.7 | Params. (M) | GFLOPs |
|---|---|---|---|
| 1 | 0.9158 / 0.8512 | 13.13 | 176.25 |
| 2 | 0.9275 / 0.8681 | 9.43 | 140.54 |
| 4 | 0.9334 / 0.8764 | 7.28 | 122.68 |
| 8 | 0.9121 / 0.8435 | 6.66 | 113.76 |
Communication-Efficient Collaborative Perception
Communication-efficient collaborative perception studies how networked agents share useful sensor information with minimal bandwidth while improving their joint view of the scene.
See all 26 papers