cs.ROMar 9, 2026

DeReCo: Decoupling Representation and Coordination Learning for Object-Adaptive Decentralized Multi-Robot Cooperative Grasping and Lifting

Authors: Kazuki Shibata, Ryosuke Sota, Shandil Dhiresh Bosch, Yuki Kadokawa, Yoshihisa Tsurumine, Takamitsu Matsubara

Organizations: All the authors are with the Division of Information Science, Graduate School of Science and Technology, Nara Institute of Science and Technology (NAIST), Nara, Japan. · Shandil Dhiresh Bosch is with the Department of Cognitive Robotics, Faculty of Mechanical Engineering, Delft University of Technology, Delft, Netherlands.

Abstract

Generalizing decentralized multi-robot cooperative grasping and lifting across objects with diverse shapes and physical properties remains a fundamental challenge. Under decentralized execution, two key challenges arise: object-dependent representation learning under partial observability and coordination learning in multi-agent reinforcement learning (MARL) under non-stationarity. A typical approach jointly optimizes object-dependent representations and coordinated policies in an end-to-end manner while randomizing object shapes and physical properties during training. However, this joint optimization tightly couples representation and coordination learning, which can introduce bidirectional interference: inaccurate representations under partial observability can degrade coordination learning, while non-stationarity in MARL can further degrade representation learning, leading to degraded task performance. Inspired by prior work on decoupling representation and control learning in single-robot settings, we propose DeReCo, a MARL framework that decouples representation and coordination learning for object-adaptive decentralized multi-robot cooperative grasping and lifting. DeReCo adopts a two-phase training strategy: (1) coordination learning with privileged object information, and (2) transition to decentralized execution through reconstruction of object-dependent representations from local observations and retraining of coordination policies using the reconstructed representations. Experimental results show that DeReCo outperforms baselines in simulation on three training objects, generalizes to six unseen objects with varying masses and friction coefficients under similar grasping configurations, and achieves superior performance on two unseen objects in real-robot experiments.

Figures & tables

Explore similar work

CardsList
  1. Sampling-Based Coordination-Informed Multi-Objective Multi-Robot Reinforcement Learning

    Jun 29, 2026Antonio Marino, Esteban Restrepo, Soon-jo Chung +2Multi-Objective Reinforcement LearningMulti-Robot Coordination

  2. CoDiMAD: Diffusion-Based Privileged Distillation for Communication-Free Multi-Robot Coordination

    Jul 10, 2026Jiyue Tao, Shunheng Xin, Tongsheng Shen +2Multi-Agent CoordinationMulti-Robot Coordination

  3. Position: Beyond Training Time, Test-Time Coordination is Essential for Cooperative MARL

    Oct 12, 2026Dongsu Lee, Sooraj Sathish, Joonkyung Kim +2Centralized Training with Decentralized ExecutionCooperative MARL