Ropedia W0: Scaling Loco-Manipulation World Models across Embodiments with Human Experience
Organizations: Nanyang Technological University · Ropedia · Duke University · University of California, San Diego ·
Abstract
World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due to heterogeneous action spaces and limited multimodal supervision. We present Ropedia W0, the first egocentric loco-manipulation world foundation model spanning humans and robots with diverse embodiments. We curate Xp-Data, comprising 10k hours of egocentric human data and 3k hours of robot data with unified multimodal annotations and systematic quality control. A unified kinematic representation encodes locomotion through camera poses and manipulation through projected skeletons, with robot skeletons combining embodiment-specific forward kinematics with extensive manual keypoint annotation and correction. We also introduce Xp-Teleop, a long-horizon loco-manipulation benchmark based on high-quality dexterous humanoid teleoperation data. Evaluations demonstrate state-of-the-art performance across five cross-embodiment benchmarks (DreamDojo, , -HOME, Xp-Teleop, and AgiBot) and on held-out human egocentric video, from zero-shot inference to few-shot and full-data post-training. Scaling human pre-training data improves performance on both human and robot evaluations. After distillation, our model supports real-time, minute-long rollouts, enabling live VR interaction. Applications in policy evaluation, model-based planning, and world-action modeling further demonstrate the model's utility for embodied decision-making.
Figures & tables
| Dataset | Robot / hand | Capabilities | Task horizon | Modalities | |||||||||
| Loco. | Dex. | Duration (s) | Loco. range (m) | Subtasks | RGB@fps | Dpt. | IMU | WB joints | Tac. | Cal. | Kpts. | ||
| Tabletop teleoperation | |||||||||||||
| RoboMIND (Tien Kung) | Tien Kung / Inspire | 21.7 | 0 | 2.2 | @30 | ||||||||
| GR00T-Teleop-GR1 | GR-1 / Fourier | 14.3 | 0.21 | 1.0 | @20 | ||||||||
| Unitree G1 Dex3 | G1 / Dex3 | 27.4 | 0 | 1.0 | @30 | ||||||||
| Unitree G1 Dex1 | G1 / Dex1 gripper | 28.7 | 0 | 1.1 | @30 | ||||||||
| Method | (a) Camera and hand action following | ||||||
| ATE | RPE | RRE | HandL2 | [email protected] | [email protected] | Det | |
| Cosmos3-Nano (16B) | 1.931 | 0.170 | 1.584 | 46.9 | 78.94 | 84.03 | 92.08 |
| Cosmos3-Super (64B) | 2.031 | 0.178 | 2.045 | 48.3 | 77.89 | 83.32 | 91.83 |
| OSCAR (2B) | 3.480 | 0.273 | 6.258 | 42.1 | 77.60 | 84.46 | 90.55 |
| RynnWorld-Teleop (5B) | 3.543 | 0.274 | 6.109 | 49.1 | 74.67 | 82.37 | 88.78 |
| DreamDojo (2B) | 2.652 | 0.224 | 4.716 | 69.8 | 58.84 | 70.14 | 81.44 |
| Data | Model | In-lab | EgoDex | DreamDojo-HV | ||||||
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | ||
| 1% | DreamDojo (2B) | 18.840 | 0.731 | 0.254 | 18.584 | 0.749 | 0.243 | 16.996 | 0.724 | 0.256 |
| DreamDojo (14B) | 18.983 | 0.743 | 0.244 | 18.070 | 0.747 | 0.246 | 16.643 | 0.716 | 0.262 | |
| Ropedia W0 (5B) | 20.854 | 0.764 | 0.213 | 20.569 | 0.778 | 0.208 | 19.045 | 0.760 | 0.217 | |
| Ropedia W0 (A14B) | 23.028 | 0.826 | 0.190 | 22.354 | 0.830 | 0.188 | 20.788 | 0.810 | 0.198 | |
| 10% | DreamDojo (2B) | 19.238 | 0.744 | 0.244 | 19.091 | 0.768 | 0.230 | 17.210 | 0.729 | 0.250 |
| Benchmark | Model / initialization | No post-training | Few-shot | Full-data | ||||||
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | ||
| DreamDojo (14B) | 14.45 | 0.580 | 0.432 | 14.43 | 0.579 | 0.438 | 13.78 | 0.569 | 0.449 | |
| Cosmos3-Nano (16B) | 13.74 | 0.563 | 0.465 | 14.71 | 0.584 | 0.409 | 16.55 | 0.636 | 0.320 | |
| Cosmos3-Super (64B) | 13.78 | 0.562 | 0.461 | 14.94 | 0.591 | 0.400 | 15.73 | 0.613 | 0.352 | |
| Ropedia W0 (5B), pretrain | 15.17 | 0.587 | 0.394 | 15.59 | 0.606 | 0.364 | 16.26 | 0.625 | 0.330 | |
| Ropedia W0 (5B), midtrain | 15.22 | 0.594 | 0.385 | 15.59 | 0.603 | 0.369 | 16.41 | 0.628 | 0.325 | |
| Model / initialization | Fidelity | Video quality | |||||
| PSNR | SSIM | LPIPS | S-Cons. | B-Cons. | Aes. | Dyn. | |
| DreamDojo (2B), AgiBot post-trained | 18.26 | 0.750 | 0.218 | 0.9383 | 0.9520 | 0.4318 | 0.54 |
| DreamDojo (14B), AgiBot post-trained | 18.30 | 0.755 | 0.210 | 0.9416 | 0.9526 | 0.4374 | 0.48 |
| Cosmos3-Nano (16B) | 17.70 | 0.742 | 0.230 | 0.9159 | 0.9262 | 0.4373 | 0.72 |
| Cosmos3-Super (64B) | 17.28 | 0.732 | 0.241 | 0.9181 | 0.9274 | 0.4396 | 0.68 |
| OSCAR (2B) | 18.56 | 0.746 | 0.217 | 0.9281 | 0.9458 | 0.4477 | 0.66 |
| Demos/task | Initialization | LIBERO | LIBERO-Plus | |||||||
| Camera | Robot | Language | Lighting | Background | Noise | Layout | Overall | |||
| full ( 43) | FastWAM | 96.95 | 17.32 | 44.32 | 67.47 | 79.96 | 52.04 | 38.66 | 60.92 | 50.06 |
| Ropedia W0 | 97.00 | 20.14 | 51.68 | 73.52 | 88.05 | 61.43 | 48.09 | 66.30 | 56.82 | |
| Improvement | +0.05 (0.1%) | +2.82 (16.3%) | +7.36 (16.6%) | +6.05 (9.0%) | +8.09 (10.1%) | +9.39 (18.0%) | +9.43 (24.4%) | +5.38 (8.8%) | +6.76 (13.5%) | |
| 10 | FastWAM | 87.30 | 18.32 | 23.10 | 43.59 | 55.27 | 29.46 | 28.36 | 42.36 | 33.58 |
| Ropedia W0 | 92.20 | 10.94 | 24.26 | 50.94 | 70.30 | 40.43 | 21.99 | 49.84 | 36.71 | |
Appendix figures & tables27 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Rollout | FPS | PSNR | SSIM | LPIPS |
| Teacher (50-step) | 6.3 s | 3.0 | 15.95 | 0.528 | 0.248 |
| 19 s | 14.34 | 0.454 | 0.321 | ||
| 32 s | 14.13 | 0.438 | 0.348 | ||
| 61 s | 13.64 | 0.414 | 0.385 | ||
| Student (4-step) | 6.3 s | 21.3 | 16.12 | 0.538 | 0.247 |
| 19 s | 14.70 | 0.468 | 0.312 |
| Method | EgoSuite (100) | OpenAoE (100) | ||||
| ATE | PSNR | FVD 16 | ATE | PSNR | FVD 16 | |
| Cosmos3-Nano (16B) | 1.122 | 19.75 | 111.5 | 2.740 | 17.56 | 139.9 |
| Cosmos3-Super (64B) | 1.322 | 19.55 | 110.4 | 2.740 | 17.16 | 132.7 |
| OSCAR (2B) | 2.586 | 16.87 | 173.7 | 4.374 | 15.54 | 221.8 |
| RynnWorld-Teleop (5B) | 2.642 | 17.98 | 182.4 | 4.444 | 15.90 | 200.3 |
| DreamDojo (2B) | 1.892 | 17.94 | 173.8 | 3.412 | 15.57 | 241.1 |
| Model / initialization | No post-training | Few-shot | Full-data | ||||||
| Seen | Unseen | Seen | Unseen | Seen | Unseen | ||||
| DreamDojo (14B) | 14.90 | 13.99 | 0.91 | 14.85 | 14.02 | 0.83 | 14.13 | 13.43 | 0.70 |
| Cosmos3-Nano (16B) | 13.83 | 13.65 | 0.18 | 15.04 | 14.37 | 0.67 | 17.10 | 16.00 | 1.10 |
| Cosmos3-Super (64B) | 13.82 | 13.73 | 0.09 | 15.27 | 14.60 | 0.67 | 16.23 | 15.22 | 1.01 |
| Model / initialization | Overall | Per-segment PSNR | ||||
| PSNR | SSIM | LPIPS | seg. 1 | seg. 6 | seg. 12 | |
| DreamDojo (14B) | 14.17 | 0.641 | 0.579 | 22.32 | 13.36 | 13.02 |
| Cosmos3-Nano (16B) | 13.91 | 0.573 | 0.576 | 25.57 | 12.75 | 11.11 |
| Cosmos3-Super (64B) | 13.74 | 0.579 | 0.570 | 25.13 | 12.58 | 11.14 |
| Ropedia W0 (5B), pretrain | 13.64 | 0.651 | 0.516 | 23.92 | 12.57 | 10.35 |
| Model / initialization | Hand following | Fidelity | Video quality | ||||||
| Err. (px) | Miss | Err.@120 | PSNR | SSIM | LPIPS | B-Cons. | Aes. | Dyn. | |
| DreamDojo (14B) | 62.6 | 77.1% | 106.9 | 10.00 | 0.301 | 0.620 | 0.891 | 0.449 | 0.55 |
| Cosmos3-Nano (16B) | 55.8 | 50.9% | 88.5 | 11.10 | 0.338 | 0.579 | 0.892 | 0.500 | 0.55 |
| Cosmos3-Super (64B) | 52.5 | 61.5% | 94.0 | 10.76 | 0.302 | 0.587 | 0.884 | 0.478 | 0.50 |
| Ropedia W0 (5B), midtrain | 19.8 | 45.3% | 65.2 | 10.83 | 0.336 | 0.573 | 0.892 | 0.469 | 0.70 |
| Model | Variant | PSNR | SSIM | LPIPS |
| Cosmos3 | Nano (16B) | 19.02 | 0.739 | 0.197 |
| Super (64B) | 18.77 | 0.736 | 0.202 | |
| Ours 5B | Full | 19.83 | 0.760 | 0.167 |
| w/o Plücker | 19.71 | 0.755 | 0.178 | |
| w/o skeletons | 18.03 | 0.736 | 0.214 | |
| Ours A14B | Full | 21.98 | 0.802 | 0.128 |
| Data | Base | In-lab | EgoDex | DreamDojo-HV | ||||||
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | ||
| 1% | Official base | 16.04 | 0.495 | 0.446 | 13.42 | 0.394 | 0.548 | 12.43 | 0.348 | 0.548 |
| Ropedia W0 | 20.85 | 0.764 | 0.213 | 20.57 | 0.778 | 0.208 | 19.05 | 0.760 | 0.217 | |
| 10% | Official base | 18.89 | 0.630 | 0.287 | 18.64 | 0.687 | 0.267 | 16.95 | 0.623 | 0.307 |
| Ropedia W0 | 21.02 | 0.786 | 0.206 | 20.78 | 0.801 | 0.199 | 19.29 | 0.787 | 0.207 | |
| 100% | Official base | 19.41 | 0.650 | 0.275 | 18.87 | 0.695 | 0.265 | 17.48 | 0.645 | 0.293 |
| Metric | BWM + SR | Ropedia W0 (A14B) |
| EWMScore | 61.01 | 66.92 |
| Image Quality | 51.54 | 53.57 |
| Aesthetic Quality | 43.09 | 41.04 |
| JEPA Similarity | 90.93 | 96.00 |
| Dynamic Degree | 17.49 | 25.48 |
| Flow Score | 8.49 | 15.75 |
Embodied World Models
Embodied world models predict how environments change under an agent’s actions to support planning, learning, simulation, and control.
See all 159 papers