Learning whole-body mobile manipulation requires demonstrations that coordinate bimanual actions with locomotion across extended workspaces. However, existing interfaces trade off direct robot control, perception and action alignment, and natural operator mobility, making such demonstrations difficult to collect. We introduce HALO, a human-aligned data collection system for whole-body mobile manipulation. The system aligns the operator's perception and action space with the robot while preserving direct physical feedback and natural locomotion. Operators guide the robot end-effectors through kinesthetic teaching and move a low-resistance platform without the deployed mobile base while performing bimanual manipulation. This interface enables more natural whole-body demonstrations, but the close human-robot coupling introduces discrepancies between the demonstration and deployment settings. We address these discrepancies with deployment-aligned demonstration processing, which calibrates and temporally aligns platform motion with the deployed base response and masks and inpaints demonstrator hands in recorded observations. Compared with Mobile ALOHA and VR teleoperation, HALO enables up to 2.9x faster demonstration collection while maintaining comparable or higher success rates. Policies trained with HALO perform precise manipulation tasks, including zip-tie fastening, and achieve a 73.3% success rate on a six-stage long-horizon mobile manipulation task involving repeated coordinated base and arm motion. Project page: https://robbyant-research.github.io/Lingbot-ALOHA/
Figures & tables
Figure 1: Interface comparison. Mobile ALOHA exhibits perception and mobility gaps, while our interface aligns human–robot perception and preserves natural operator mobility.
Figure 2: HALO overview and learned capabilities. (a) Human-aligned data collection with natural locomotion and direct bimanual kinesthetic teaching. (b) Learned policies exhibit precise manipulation, coordinated whole-body control, long-horizon mobile manipulation, and navigation.
Method
Mobile Support
Egocentric Perception
Force Feedback
Natural Locomotion
Retargeting-Free Actions
Precise Base Control
GELLO Wu et al. (2024b)
×
×
×
×
✓
×
Mobile ALOHA Fu et al. (2024)
✓
×
×
×
✓
✓
VR Zhu et al. (2022) ; Rakita et al. (2018) ; Honerkamp et al. (2025)
✓
×
×
×
✓
✓
Exoskeleton Citron et al. (2026) ; Liang et al. (2026)
✓
✓
✓
✓
×
×
UMI Chi et al. (2024) / HoMMI Xu et al. (2026)
✓
✓
✓
✓
×
×
HALO
✓
✓
✓
✓
✓
✓
Table 1: Qualitative comparison of data collection systems. We compare representative interfaces in terms of the desired properties for whole-body mobile manipulation data collection.
Figure 4
Figure 5: Implicit base control. The low-resistance collection platform allows base motion to arise naturally from the operator’s movement, without explicit base control that could disrupt hand manipulation, thereby capturing coordinated mobile manipulation behaviors.
Figure 7: Visual processing. Our pipeline removes human hands during rapid motion, bimanual manipulation, and egocentric interaction.
Figure 8: Comparison and limitations of demonstration data collection. Top: Comparison of human demonstration collection methods in terms of efficiency and reliability. Succ. Rate and Time denote the demonstration success rate and the average duration of successful demonstrations, respectively. Bottom: Representative limitations of existing teleoperation interfaces: VR lacks precise gripper control and force feedback, while the mobile base constrains operator mobility during whole-body demonstration collection.
Figure 9: Push Chair, Zip-Tie Fastening, and Disassemble Lego. In Push Chair, the policy navigates to the chair, grasps it while moving, transports it to the target desk, and inserts it into place. Both Zip-Tie Fastening and Disassemble Lego require precise action prediction. In Disassemble Lego, the randomized separation pattern changes the required disassembly strategy. The policy learns to handle these variations from our demonstrations and generalizes to unseen Lego configurations. In the third row, two Lego pieces of the same color are included, and the policy correctly places both resulting pieces into the correct bin.
Figure 10: Long-horizon mobile manipulation with coordinated whole-body control. The policy retrieves a box from the shelf, loads target objects, transports the box to the conveyor, places it at the designated location, and returns to repeat the procedure.
Figure 11: Generalization of mobile manipulation. We evaluate Push Chair under large initial-pose variations and in unseen environments. Compared with the 5–10 cm initial-position variation in Mobile ALOHA, we increase the randomization to 2–3 m.
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Parameter
Value
Base model
Pretrained π0.5
Fine-tuning
Full-parameter
Optimizer
AdamW
Learning rate
5×10−5
Warmup steps
100
Global batch size
128
Appendix
Table 5: Policy training configuration.
Figure 12: Off-the-shelf industrial measuring wheel assembly used for wheel odometry. The illustration was redrawn from a real photograph using GPT Image.
Figure 13: Modular end-effector design. Left: the assembled gripper. Right: an exploded view showing the gripper motor, finger mounts, and interchangeable fingers.
We present Whole-Body Mobile Manipulation Interface (HoMMI), a data collection and policy learning framework that learns whole-body mobile manipulation directly from robot-free human demonstrations. We augment UMI interfaces with egocentric sensing to capture the global context required for mobile manipulation, enabling portable, robot-free, and scalable data collection. However, naively incorporating egocentric sensing introduces a larger human-to-robot embodiment gap in both observation and action spaces, making policy transfer difficult. We explicitly bridge this gap with a cross-embodiment hand-eye policy design, including an embodiment agnostic visual representation; a relaxed head action representation; and a whole-body controller that realizes hand-eye trajectories through coordinated whole-body motion under robot-specific physical constraints. Together, these enable long-horizon mobile manipulation tasks requiring bimanual and whole-body coordination, navigation, and active perception. Results are best viewed on: https://hommi-robot.github.io
Human demonstrations, which can be collected at scale and naturally capture active hand-eye coordination, are a promising data source for learning humanoid loco-manipulation. However, directly transferring human demonstrations to humanoids requires a precise world-frame tracking controller, which is often brittle under Out-of-Distribution(OOD) targets, while human-to-humanoid gaps persist in both egocentric observation and action execution. To address these challenges, we present HALOMI, a scalable framework for learning humanoid loco-manipulation with active perception from human demonstrations. HALOMI extends Universal Manipulation Interface (UMI) with egocentric sensing to collect ego-view and wrist-view observations along with head-hand trajectories at scale. We further propose a manifold-constrained controller that plans in a learned latent behavior manifold to enable precise and robust head-hand tracking in the world frame. To bridge the human-to-humanoid gap, we perform ego-view alignment and introduce a controller-aware reference trajectory adaptation to reduce mismatch in both observation and action execution. We validate HALOMI on a Unitree G1 humanoid robot with an actuated neck across five real-world tasks involving navigation, grasping, bimanual manipulation, whole-body coordination, and dynamic behaviors. Across the three quantitatively evaluated tasks, HALOMI achieves an average success rate of 85%, while additional qualitative demonstrations show its ability to support dynamic tossing and deep-squat grasping.
Zehui Zhao, Yuxuan Zhao, Gaojing Zhang +3
Shanghai Jiao Tong University · University of Sussex · East China University of Science and Technology
Current approaches for humanoid whole-body manipulation, primarily relying on teleoperation or visual sim-to-real reinforcement learning, are hindered by hardware logistics and complex reward engineering. Consequently, demonstrated autonomous skills remain limited and are typically restricted to controlled environments. In this paper, we present the Humanoid Manipulation Interface (HuMI), a portable and efficient framework for learning diverse whole-body manipulation tasks across various environments. HuMI enables humanoid-free data collection by capturing rich whole-body motion using portable hardware. This data drives a hierarchical learning pipeline that translates human motions into dexterous and feasible humanoid skills. Extensive experiments across five whole-body tasks--including kneeling, squatting, tossing, walking, and bimanual manipulation--demonstrate that HuMI achieves a 3x increase in data collection efficiency compared to teleoperation and attains a 70% success rate in unseen environments.
Ruiqian Nai, Boyuan Zheng, Junming Zhao +8
Tsinghua University · Shanghai Qi Zhi Institute · Shanghai Jiao Tong University