DeReCo: Decoupling Representation and Coordination Learning for Object-Adaptive Decentralized Multi-Robot Cooperative Grasping and Lifting
Organizations: All the authors are with the Division of Information Science, Graduate School of Science and Technology, Nara Institute of Science and Technology (NAIST), Nara, Japan. · Shandil Dhiresh Bosch is with the Department of Cognitive Robotics, Faculty of Mechanical Engineering, Delft University of Technology, Delft, Netherlands.
Abstract
Generalizing decentralized multi-robot cooperative grasping and lifting across objects with diverse shapes and physical properties remains a fundamental challenge. Under decentralized execution, two key challenges arise: object-dependent representation learning under partial observability and coordination learning in multi-agent reinforcement learning (MARL) under non-stationarity. A typical approach jointly optimizes object-dependent representations and coordinated policies in an end-to-end manner while randomizing object shapes and physical properties during training. However, this joint optimization tightly couples representation and coordination learning, which can introduce bidirectional interference: inaccurate representations under partial observability can degrade coordination learning, while non-stationarity in MARL can further degrade representation learning, leading to degraded task performance. Inspired by prior work on decoupling representation and control learning in single-robot settings, we propose DeReCo, a MARL framework that decouples representation and coordination learning for object-adaptive decentralized multi-robot cooperative grasping and lifting. DeReCo adopts a two-phase training strategy: (1) coordination learning with privileged object information, and (2) transition to decentralized execution through reconstruction of object-dependent representations from local observations and retraining of coordination policies using the reconstructed representations. Experimental results show that DeReCo outperforms baselines in simulation on three training objects, generalizes to six unseen objects with varying masses and friction coefficients under similar grasping configurations, and achieves superior performance on two unseen objects in real-robot experiments.
Figures & tables
| Method | Seen Objects | Unseen Objects | |||||||||
| Bar | Cylinder | Board | Avg. | Hexagon | Triangle | L bar | Thick bar | Octagon | Semi-ellipse | Avg. | |
| MAPPO w/o PI | 0.66 | 0.54 | 0.90 | 0.70 | 0.57 | 0.50 | 0.63 | 0.70 | 0.57 | 0.49 | 0.58 |
| MAPPO w/o PI + LSTM | 0.55 | 0.26 | 0.46 | 0.42 | 0.33 | 0.39 | 0.48 | 0.21 | 0.30 | 0.44 | 0.36 |
| MAPPO w/o AE | 0.81 | 0.69 | 0.95 | 0.82 | 0.72 | 0.61 | 0.74 | 0.72 | 0.71 | 0.60 | 0.68 |
| MAPPO w/o AE + LSTM | 0.57 | 0.35 | 0.73 | 0.55 | 0.38 | 0.35 | 0.50 | 0.36 | 0.37 | 0.42 | 0.40 |
| MAPPO w PI | 0.92 | 0.83 | 0.96 | 0.91 | 0.44 | 0.31 | 0.53 | 0.60 | 0.47 | 0.33 | 0.45 |
| Method | Board | Frame | ||
| Success | Error [m] | Success | Error [m] | |
| MAPPO w/o AE | 0/5 | 0.18 0.06 | 0/5 | 0.34 0.00 |
| DeReCo | 5/5 | 0.09 0.01 | 4/5 | 0.09 0.01 |