VIRGA: Virtual-Agent-Intermediated Riemannian Geometry for Active-Sensing Air-Ground Coordination
Organizations: Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University, Shanghai 201210, China · State Key Laboratory of Autonomous Intelligent Unmanned Systems, Tongji University, Shanghai 201210, China · College of Electronic and Information Engineering, Tongji University, Shanghai 201804, China
Abstract
Air-ground autonomy becomes harder when the unmanned aerial vehicle (UAV) must remain observable by a gimbal light detection and ranging (LiDAR) mounted on the unmanned ground vehicle (UGV). The platforms must avoid dynamic obstacles while coordinating heterogeneous motion, limited sensing, and changing task initiative within one closed loop. This paper presents VIRGA, a neural geometric coordination framework that turns dual-LiDAR observations into bounded source-specific Riemannian fields and couples them through a virtual agent with reciprocal elastic feedback. Platform-aware execution maps convert the shared coordination reference into feasible UAV, UGV, and gimbal commands while enforcing active-observation safeguards. Evaluation against three complementary baselines reveals distinct limitations. An adapted Ray-RMP controller provides the fastest Riemannian response but produces insufficient clearance in the coupled air-ground task. A dense analytical Riemannian field improves geometric avoidance, yet its high evaluation cost prevents stable field-of-view maintenance. An adapted ColAG controller achieves the lowest latency but still incurs safety and observability violations. VIRGA completes all paired warehouse conditions safely, while a long-range cave stress test without retraining demonstrates sustained coordination in irregular and confined geometry. Ablations confirm contributions from online geometric evaluation, virtual-agent mediation, and reciprocal feedback.
Figures & tables
| Method | Task / safe completion | Mean min. clearance (m) | Collision / contact records | FOV loss (%) | Latency (ms), mean / p95 |
|---|---|---|---|---|---|
| Virga (ours) | 5 / 5 | 0.683 | 0.0 | 0.00 | 48.8 / 80.0 |
| Ray-RMP adapted | 5 / 0 | -0.050 | 124.0 | 0.30 | 43.8 / 51.6 |
| Dense analytical field | 0 / 0 | 0.021 | 0.0 | 24.29 | 614.1 / 741.0 |
| ColAG-Hetero adapted | 4 / 0 | -0.050 | 9.0 | 2.51 | 20.7 / 41.9 |
| Configuration | Task completion | Median clearance (m) | Median FOV loss (%) | Mean UGV wait | Main outcome |
|---|---|---|---|---|---|
| Complete Virga | 5 / 5 | 0.671 | 0.00 | 34 | All completed |
| Fixed learned prototype | 5 / 5 | 0.372 | 0.00 | 164 | All completed |
| w/o reciprocal feedback | 1 / 5 | 0.080 | 0.83 | N/A | 3 liveness failures, 1 deadlock |
| w/o VA & elastic couplings | 0 / 5 | 1.270 | 0.00 | N/A | 5 deadlocks |
| Metric | Result |
| Mean dual-LiDAR clearance (m) | 1.759 |
| Minimum measured clearance (m) | 0.1005 |
| Collision events | 0 |
| FOV-loss samples (%) | 0.0704 |
Multi-Robot Coordination
Multi-robot coordination studies how teams of robots plan, communicate, allocate tasks, and act together safely and efficiently.
See all 328 papers