Overview

World models learn to predict what will happen when a robot acts, giving it a way to plan ahead, learn from imagined experience, and reduce costly or risky real-world trials. Approaches range from latent-dynamics models such as JEPA and Dreamer, often paired with model-predictive control or reinforcement learning, to video-based world-action models that predict future observations alongside executable actions. Researchers also add structure—3D geometry, object-centric states, physics, memory, and tactile or force signals—to handle contact, navigation, and long-horizon tasks. A central challenge is that visually convincing predictions may not follow actions faithfully or support reliable control; balancing physical consistency, robustness, evaluation quality, and inference speed remains open.

Latest papers

CardsList

426 papers51 papers in the last four weeks, down 46% on the four weeks before. 0.4% of all new papers.

  1. Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learning

    Mar 26, 2026Jai Bardhan, Patrik Drozdik, Josef Sivic +1World Models for RoboticsWorld Models

  2. VLGOR: Visual-Language Knowledge Guided Offline Reinforcement Learning for Generalizable Agents

    Mar 24, 2026Pengsen Liu, Maosen Zeng, Nan Tang +4Offline RLVLMs for Robotics

  3. Dreaming the Unseen: World Model-regularized Diffusion Policy for Out-of-Distribution Robustness

    Mar 22, 2026Ziou Hu, Xiangtong Yao, Yuan Meng +2Diffusion PolicyOOD Generalization

  4. Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Models

    Mar 21, 2026Zhilong Zhang, Haoxiang Ren, Yihao Sun +6RL for VLMsVision-Language-Action Models

  5. IndoorR2X: Indoor Robot-to-Everything Coordination with LLM-Driven Planning

    Mar 20, 2026Fan Yang, Soumya Teotia, Shaunak A. Mehta +8World Models for RoboticsLarge Language Model-Based Robot Planning

  6. EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards

    Mar 18, 2026Ruixiang Wang, Qingming Liu, Yueci Deng +3World Models for RoboticsPhysical Consistency in Video Generation

  7. Simulation Distillation: Pretraining World Models in Simulation for Rapid Real-World Adaptation

    Mar 16, 2026Jacob Levy, Tyler Westenbroek, Kevin Huang +6World Models for RoboticsRobot Policy Adaptation

  8. NavThinker: Action-Conditioned World Models for Coupled Prediction and Planning in Social Navigation

    Mar 16, 2026Tianshuai Hu, Zeying Gong, Lingdong Kong +7Social Robot NavigationWorld Models for Robotics

  9. WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systems

    Mar 15, 2026Yuchen Wang, Jiangtao Kong, Sizhe Wei +6Robot Motion PredictionWorld Models for Robotics

  10. Building Explicit World Model for Zero-Shot Open-World Object Manipulation

    Mar 14, 2026Xiaotong Li, Gang Chen, Javier Alonso-MoraZero-Shot Robotic ManipulationRobotic Manipulation

  11. PlayWorld: Learning Robot World Models from Autonomous Play

    Mar 9, 2026Tenny Yin, Zhiting Mei, Zhonghe Zheng +8World Models for RoboticsVideo World Models

  12. ΔΔVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation

    Mar 9, 2026Yijie Zhu, Jie He, Rui Shao +4Vision-Language-Action ModelsVLMs for Robotics

  13. MWM: Mobile World Models for Action-Conditioned Consistent Prediction

    Mar 8, 2026Han Yan, Zishang Xiang, Zeyu Zhang +1World Models for RoboticsAction-Conditioned World Models

  14. Pri4R: Learning World Dynamics for Vision-Language-Action Models with Privileged 4D Representation

    Mar 2, 2026Jisoo Kim, Jungbin Cho, Sanghyeok Chu +9World Models for VLAsVision-Language-Action Models

  15. StemVLA:An Open-Source Vision-Language-Action Model with Future 3D Spatial Geometry Knowledge and 4D Historical Representation

    Feb 27, 2026Jiasong Xiao, Yutao She, Kai Li +23D Scene PredictionLong-Horizon Robotic Manipulation

  16. EgoMoD: Predicting Global Maps of Dynamics from Local Egocentric Observations

    Feb 26, 2026Iacopo Catalano, David Morilla-Cabello, Jorge Pena-Queralta +1Robot NavigationWorld Models for Robotics

  17. Self-Correcting VLA: Online Action Refinement via Sparse World Imagination

    Feb 25, 2026Chenyv Liu, Wentao Tan, Lei Zhu +4Vision-Language-Action ModelsRobotic RL

  18. Recursive Belief Vision Language Action Models

    Feb 24, 2026Vaidehi Bagaria, Bijo Sebastian, Nirav Kumar PatelVision-Language-Action ModelsLong-Horizon Robotic Manipulation

  19. JEPA-Bisim: Learning Robust Visual Representations for Planning with Joint-Embedding Predictive World Models

    Feb 20, 2026Leonardo F. Toso, Davit Shadunts, Yunyang Lu +5Visual Representation LearningWorld Models for Robotics

  20. FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment

    Feb 19, 2026Han Zhao, Jingbo Wang, Wenxuan Song +5World Models for RoboticsLatent World Models

  21. Learning to unfold cloth: Scaling up world models to deformable object manipulation

    Feb 18, 2026Jack Rome, Stephen James, Subramanian RamamoorthyDeformable Object ManipulationGeneralization in Robotic Manipulation

  22. Learning Physics from Pretrained Video Models: A Multimodal Continuous and Sequential World Interaction Models for Robotic Manipulation

    Feb 18, 2026Zijian Song, Qichang Li, Sihan Qin +4Robotic ManipulationWorld Models for Robotics

  23. WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL

    Feb 15, 2026Zhennan Jiang, Shangqing Zhou, Yutong Jiang +11World Models for RoboticsWorld Models

  24. H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model

    Feb 11, 2026Jinbang Huang, Wenyuan Chen, Zhiyuan Li +9Long-Horizon Robotic ManipulationWorld Models for Robotics

  25. MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation

    Feb 10, 2026Jiaxu Wang, Yicheng Jiang, Tianlun He +7World Models for Robotics4D Scene Generation

  26. Coupled Local and Global World Models for Efficient First Order RL

    Feb 5, 2026Joseph Amigo, Rooholla Khorrambakht, Nicolas Mansard +1Model-Based RLWorld Models for Robotics

  27. PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation

    Feb 5, 2026Yushan Liu, Jingjing Fan, Shoujie Li +3World Models for RoboticsVisuomotor Policy Learning