DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation
Organizations: Tsinghua University, Beijing, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China · Harbin Institute of Technology, Harbin, China · Hangzhou Yunshenchu Technology Co., Ltd. (DEEP Robotics), Hangzhou, China
Abstract
Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly distinguish camera ego-motion from base and arm actions. Here we introduce DECOWAM, a whole-body world-action model that separates these factors through dedicated conditional interfaces. DECOWAM freezes an adapted FastWAM backbone and trains residual adapters, an action-equivalent future bottleneck distilled from privileged observations, adversarially separated base and arm latents, and base-velocity conditioning for video prediction. We further introduce ARMDOG, a real-robot dataset that synchronizes video, whole-body state and action, and language. On a fixed replay protocol, DECOWAM improved both future-video and action prediction over FastWAM, reducing action MSE by 21.7% with 25.95M trainable adaptation parameters. Across 79 closed-loop trials per method, it achieved the highest observed whole-body coordination and base-displacement robustness among the compared systems, while task completion remained comparable to the strongest baseline. These results show that embodiment-aware factorization can support parameter-efficient joint visual prediction and whole-body control under moving viewpoints.
Figures & tables
| Model | Mean Completion Time (s) | Cumulative Approach Completion Rate (%) | Cumulative Grasp Completion Rate (%) | Cumulative Transport Completion Rate (%) | Cumulative Placement Completion Rate (%) | Task Success Rate (%) |
|---|---|---|---|---|---|---|
| GR00T | 57 | 73.4 | 13.9 | 11.4 | 8.9 | 8.9 |
| 50 | 89.9 | 62.0 | 53.2 | 49.4 | 49.4 | |
| FastWAM | 65 | 91.1 | 63.3 | 59.5 | 57.0 | 57.0 |
| X-WAM | 82 | 77.2 | 26.6 | 19.0 | 15.2 | 15.2 |
| DECOWAM | 49 | 92.4 | 69.6 | 67.1 | 58.2 | 58.2 |
World Models for Robotics
World models for robotics predict how scenes and robot states change under actions to support planning, control, and learning.
See all 384 papers