cs.RONov 19, 2026

Learning to Move from and for Manipulation Policies: Spatializing Latent Action Representations for Goal-Pose-Free Mobile Manipulation

Authors: Siyuan Zheng, Zhong Cao, Henry X. Liu

Organizations: Department of Electrical and Computer Engineering, University of Michigan · Department of Civil and Environmental Engineering, University of Michigan · University of Michigan Transportation Research Institute

Abstract

The success of manipulation policies is closely tied to the spatial relationship between the robot and the target object, as well as the task being performed, making the ability to adjust the robot's pose critical for successful execution. When the robot starts away from the task, such adjustments require coordinating navigation with local manipulation. Jointly training these capabilities incurs substantial computational and data costs, while navigating toward a predefined goal pose limits the flexibility needed to adapt to task-specific manipulation requirements. To address these challenges, we propose Learning to Move from and for Manipulation Policies (M4M), a framework that learns manipulation-aware mobility directly from pretrained manipulation policies. By leveraging the hidden representations of the policy's action-generating network as dense supervision, together with a limited number of manipulation execution outcomes, we learn a spatially conditioned embedding that captures task-dependent manipulation success across candidate robot poses. From the robot's current stereo observations, this representation estimates manipulation success at unvisited poses without rolling out the manipulation policy at each location. It is further integrated into navigation policy training, while a learned handoff policy decides when to transition from navigation to manipulation, enabling the robot to move and manipulate in a unified, task-aware manner. Across eight articulated-object tasks in unseen RoboCasa kitchens, M4M achieves 47.0% mean task success, compared with 26.5% for the strongest baseline and 19.2% for direct manipulation execution, and refrigerator-closing experiments show consistent improvements across four frozen manipulation policies.

Figures & tables

Explore similar work

CardsList
  1. MAVP: Map-Aware Visuomotor Policies for Mobile Manipulation

    Sep 22, 2026Jinhe Tang, Ruixiao Dai, Weiming ZhiRobot Trajectory TrackingRobot Policy Learning

  2. N2M: Bridging Navigation and Manipulation by Learning Pose Preference from Rollout

    Sep 23, 2025Kaixin Chai, Hyunjun Lee, Joseph J. LimRobot Policy LearningMobile Manipulation

  3. ComManip: Overfitting Manipulation Policies to Comfortable Regions

    Sep 29, 2026Yidan Lai, Xinyi Chen, Shuquan Man +1Visuomotor Policy LearningRobotic Manipulation