CoopUQ: Robust Multi-Robot Social Navigation via Uncertainty-Aware Cooperative Forecasting
Organizations: Georgia Institute of Technology · University of California, Riverside · University of Michigan, Ann Arbor · University of Georgia ·
Abstract
Reinforcement learning enables mobile robots to make fast and scalable navigation decisions in constrained human-shared environments. However, directly extending single-robot approaches to multi-robot settings often fails to ensure safety and efficiency, especially under occlusions and out-of-distribution (OOD) scenarios, where individual robots may overlook potential risks or make inaccurate predictions. Leveraging cooperation effectively for both prediction and navigation remains a major challenge. We propose CoopUQ, a multi-robot social navigation framework that bridges uncertainty-aware cooperative occupancy forecasting and robust decision making. CoopUQ predicts future occupancy grid maps through cross-robot spatiotemporal feature fusion and further leverages forecasts and their uncertainty to guide policy via constrained multi-agent reinforcement learning, where the cost penalizes navigation through regions predicted to be occupied or highly uncertain. This design enables the policy to adapt its risk sensitivity under distribution shifts. Experimental results across multiple Unity3D-based simulation environments with both in-distribution and OOD settings, including diverse layouts, pedestrian densities, and rushing behavior, demonstrate improved prediction performance and safety over representative baselines. Real-robot experiments further demonstrate its robustness across various scenes. Our code and videos are available at https://coopuq.github.io/.
Figures & tables
| Methods | Cooperation | Horizon | SSIM | WMSE | IoU | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Clean | 200ms Delay | Loc. Noise | Clean | 200ms Delay | Loc. Noise | Clean | 200ms Delay | Loc. Noise | |||
| SOGMP++ [ 44 ] | No | 1 | 0.75 ±0.00 | – | – | 0.16 ±0.00 | – | – | 0.60 ±0.01 | – | – |
| 5 | 0.71 ±0.00 | – | – | 0.19 ±0.00 | – | – | 0.57 ±0.01 | – | – | ||
| Ours | Early Fusion | 1 | 0.86 ±0.00 | 0.79 ±0.01 | 0.74 ±0.01 | 0.07 ±0.00 | 0.13 ±0.01 | 0.15 ±0.01 | 0.73 ±0.01 | 0.65 ±0.01 | 0.58 ±0.02 |
| 5 | 0.80 ±0.00 | 0.74 ±0.01 | 0.68 ±0.02 | 0.12 ±0.00 | 0.15 ±0.01 | 0.20 ±0.01 | 0.68 ±0.01 | 0.60 ±0.02 | 0.53 ±0.02 | ||
| Late Fusion | 1 | 0.81 ±0.01 | 0.78 ±0.01 | 0.76 ±0.01 | 0.12 ±0.00 | 0.13 ±0.01 | 0.15 ±0.01 | 0.63 ±0.01 | 0.61 ±0.02 | 0.59 ±0.02 | |
| Methods | Coop. | SR | CR | TR | NT | PL | AA | ITR (%) | SD | ||
| Obstacle | Human | Robots | |||||||||
| NavMesh | No | 0.39 ±0.05 | 0.00 ±0.00 | 0.41 ±0.06 | 0.19 ±0.04 | 0.00 ±0.00 | 12.20 ±0.53 | 13.89 ±0.62 | 0.10 ±0.05 | 12.93 ±1.79 | 0.29 ±0.03 |
| ORCA [ 38 ] | 0.47 ±0.04 | 0.17 ±0.02 | 0.23 ±0.03 | 0.06 ±0.01 | 0.06 ±0.02 | 10.04 ±0.42 | 9.30 ±0.35 | 0.10 ±0.02 | 7.63 ±0.48 | 0.36 ±0.03 | |
| SAMARL [ 41 ] | 0.65 ±0.03 | 0.10 ±0.02 | 0.12 ±0.02 | 0.05 ±0.01 | 0.07 ±0.02 | 12.98 ±0.46 | 14.99 ±0.38 | 0.18 ±0.03 | 6.60 ±0.42 | 0.37 ±0.03 | |
| SCOPE [ 45 ] | 0.67 ±0.03 | 0.10 ±0.02 | 0.11 ±0.01 | 0.03 ±0.01 | 0.09 ±0.02 | 13.39 ±0.65 | 15.67 ±0.20 | 0.18 ±0.02 | 5.56 ±0.39 | 0.38 ±0.04 | |
| HEIGHT [ 25 ] | 0.70 ±0.03 | 0.07 ±0.01 | 0.13 ±0.02 | 0.03 ±0.01 | 0.06 ±0.01 | 12.43 ±0.40 | 13.80 ±0.32 | 0.14 ±0.02 | 4.08 ±0.31 | 0.37 ±0.03 | |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Environment | Pedestrians Count | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | ||||||||
| Success | Collision | Timeout | Success | Collision | Timeout | Success | Collision | Timeout | ||
| SCOPE [ 45 ] | Lobby-A | 1.00 | 0.00 | 0.00 | 0.75 | 0.25 | 0.00 | 0.50 | 0.25 | 0.25 |
| Lobby-B | 0.75 | 0.00 | 0.25 | 0.50 | 0.25 | 0.25 | 0.25 | 0.50 | 0.25 | |
| Corridor-A | 0.75 | 0.25 | 0.00 | 0.50 | 0.50 | 0.00 | 0.25 | 0.50 | 0.25 | |
| Corridor-B | 0.75 | 0.25 | 0.00 | 0.50 | 0.50 | 0.00 | 0.50 | 0.50 | 0.00 | |
| Robots | Method | SR | CR | TR | NT | PL | AA | ITR (%) | SD | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Obstacle | Human | Robots | |||||||||
| Three | ORCA [ 38 ] | 0.47/0.37 | 0.17/0.15 | 0.23/0.38 | 0.06/0.08 | 0.06/ 0.02 | 10.04/ 10.54 | 9.30 / 11.12 | 0.10/0.11 | 7.63/11.80 | 0.36/0.34 |
| SAMARL [ 41 ] | 0.65/0.53 | 0.10/0.14 | 0.12/0.21 | 0.05/0.06 | 0.07/0.06 | 12.98/13.45 | 14.99/15.57 | 0.18/0.20 | 6.60/10.43 | 0.37/0.34 | |
| SCOPE [ 45 ] | 0.67/0.56 | 0.10/0.10 | 0.11/0.18 | 0.03/0.05 | 0.09/0.11 | 13.39/14.79 | 15.67/16.92 | 0.18/0.21 | 5.56/7.56 | 0.38/0.36 | |
| HEIGHT [ 25 ] | 0.70/0.60 | 0.07/0.08 | 0.13/0.19 | 0.03/0.05 | 0.06/0.07 | 12.43/13.49 | 13.80/14.11 | 0.14/0.15 | 4.08/8.02 | 0.37/0.36 | |
| CoopUQ | 0.90 / 0.82 | 0.03 / 0.04 | 0.03 / 0.10 | 0.00 / 0.01 | 0.03 /0.03 | 9.80 /10.88 | 11.98/13.82 | 0.13/0.17 | 2.07 / 4.47 | 0.45 / 0.43 | |
| 1-step | 5-step | |||||
|---|---|---|---|---|---|---|
| Method | SSIM | WMSE | IoU | SSIM | WMSE | IoU |
| No Cooperation | ||||||
| Early Fusion | ||||||
| Late Fusion | ||||||
| Middle Fusion w/o Deviation-guided | ||||||
| Middle Fusion w/ Deviation-guided | ||||||
| Cooperation | Policy | SR | Obstacle CR | Human CR | Robots CR | TR | ITR (%) | SD |
|---|---|---|---|---|---|---|---|---|
| No Cooperation | Prediction | |||||||
| Prediction & Uncertainty | ||||||||
| CMARL | ||||||||
| Late Fusion | Prediction | |||||||
| Prediction & Uncertainty | ||||||||
| CMARL |
| Cost Limit | SR | Obstacle CR | Human CR | Robots CR | TR | NT | PL | AA | ITR (%) | SD |
|---|---|---|---|---|---|---|---|---|---|---|
Social Robot Navigation
Social robot navigation studies how robots move safely and comfortably around people while respecting human behavior, preferences, and shared-space norms.
See all 81 papers