cs.AIAug 20, 2026

DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation

Authors: Siyuan Ma, Boshi Zhang, Yutian Zhang, Qinglian Wu, Jiaqi Zhai, Dong Wei, Qiaojun Yu

Organizations: Tsinghua University, Beijing, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China · Harbin Institute of Technology, Harbin, China · Hangzhou Yunshenchu Technology Co., Ltd. (DEEP Robotics), Hangzhou, China

Abstract

Mobile manipulation requires a robot to predict how locomotion and arm motion jointly alter future observations and control. Existing world-action models, developed largely for fixed-base platforms, do not explicitly distinguish camera ego-motion from base and arm actions. Here we introduce DECOWAM, a whole-body world-action model that separates these factors through dedicated conditional interfaces. DECOWAM freezes an adapted FastWAM backbone and trains residual adapters, an action-equivalent future bottleneck distilled from privileged observations, adversarially separated base and arm latents, and base-velocity conditioning for video prediction. We further introduce ARMDOG, a real-robot dataset that synchronizes video, whole-body state and action, and language. On a fixed replay protocol, DECOWAM improved both future-video and action prediction over FastWAM, reducing action MSE by 21.7% with 25.95M trainable adaptation parameters. Across 79 closed-loop trials per method, it achieved the highest observed whole-body coordination and base-displacement robustness among the compared systems, while task completion remained comparable to the strongest baseline. These results show that embodiment-aware factorization can support parameter-efficient joint visual prediction and whole-body control under moving viewpoints.

Figures & tables

Explore similar work

CardsList
  1. MobileWAM: Bridging World Action Models to Mobile Manipulation with Chain-of-Foresight

    Aug 5, 2026Zehua Fan, Junjie He, Wenxuan Song +14World Models for RoboticsMobile Manipulation

  2. MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation

    Jun 8, 2026Jia Zheng, Teli Ma, Yudong Fan +3Humanoid Loco-ManipulationHumanoid Robot Control

  3. PointWAM: 3D World Action Modeling for Dexterous Robotic Manipulation

    Oct 2, 2026Chunghyun Park, Beomjun Kim, Seungcheol Park +5Robotic ManipulationEmbodied World Models