Learning Multi-Agent Local Collision-Avoidance for Collaborative Carrying tasks with Coupled Quadrupedal Robots
Organizations: Robotic Systems Lab, ETH Zurich. · Centro di Ricerca “Enrico Piaggio”, and Dipartimento di Ingegneria dell’Informazione, Universit`a di Pisa, Pisa, Italy.
Abstract
Robotic collaborative carrying could greatly benefit human activities like warehouse and construction site management. However, coordinating the simultaneous motion of multiple robots represents a significant challenge. Existing works primarily focus on obstacle-free environments, making them unsuitable for most real-world applications. Works that account for obstacles, either overfit to a specific terrain configuration or rely on pre-recorded maps combined with path planners to compute collision-free trajectories. This work focuses on two quadrupedal robots mechanically connected to a carried object. We propose a Reinforcement Learning (RL)-based policy that enables tracking a commanded velocity direction while avoiding collisions with nearby obstacles using only onboard sensing, eliminating the need for precomputed trajectories and complete map knowledge. Our work presents a hierarchical architecture, where a perceptive high-level object-centric policy commands two pretrained locomotion policies. Additionally, we employ a game-inspired curriculum to increase the complexity of obstacles in the terrain progressively. We validate our approach on two quadrupedal robots connected to a bar via spherical joints, benchmarking it against optimization-based and decentralized RL baselines. Our hardware experiments demonstrate the ability of our system to locomote in unknown environments without the need for a map or a path planner. The video of our work is available in the multimedia material.
Figures & tables
| MAPPO | Opt.-based Local 100 | Opt.-based Local 1500 | Ours | Opt.-based Full 1500 | ||
| Empty | SR | 100% | 100 % | 100% | 100% | 100 % |
| 20 Hz | Hz | Hz | 20 Hz | – | ||
| 9.09 0.11 | 10.10 1.05 | 9.64 0.74 | 8.00 0.14 | 8.65 0.01 | ||
| 9.04 0.08 | 9.67 0.76 | 9.82 0.81 | 8.48 0.14 | 8.65 0.01 | ||
| 9.02 0.06 | 8.75 0.26 | 8.98 0.39 | 8.15 0.05 | 8.65 0.01 | ||
| Corridor | SR | 81% | 30 % | 90% | 99% | 100 % |
| 2.0 m | 10.0 | ||
| [4.0x6.0] m | , | 0.6 m, 0.2 m | |
| 0.3 m | 2.0 m | ||
| 50 | -0.2 | ||
| 0.1 | -2.5 | ||
| 1.0 m | -0.1 | ||
| [1.0, 1.5] m | 15.0 |