World Model-Based Planning

Overview

World model-based planning studies how an agent can predict the consequences of actions and use those predictions to reach goals, avoid risks, or coordinate with others. Models may predict images, compact latent states, object relations, or physical dynamics, and planners use methods such as model-predictive control, CEM, tree search, and learned action policies. Work spans robot manipulation and navigation, autonomous driving, games, and language-guided agents, with approaches including hierarchical subgoals, uncertainty estimates, and symbolic or physics-based structure. A central challenge is that accurate-looking or low-error predictions may still rank actions poorly, especially over long horizons or under distribution shift, so researchers are developing planning-focused representations, diagnostics, and more efficient closed-loop adaptation.

Latest papers

CardsList

263 papers70 papers in the last four weeks, up 63% on the four weeks before. 0.4% of all new papers.

  1. Telecom World Models: Unifying Digital Twins, Foundation Models, and Predictive Planning for 6G

    Apr 8, 2026Hang Zou, Yuzhi Yang, Lina Bariah +15Network SlicingWorld Model-Based Planning

  2. Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving

    Mar 28, 2026Qiqi Liu, Huan Xu, Jingyu Li +5VLMs for Autonomous DrivingWorld Model-Based Planning

  3. Policy-Guided World Model Planning for Language-Conditioned Visual Navigation

    Mar 26, 2026Amirhosein Chahe, Lifeng ZhouEmbodied NavigationVision-Language Navigation

  4. World Reasoning Arena

    Mar 26, 2026PAN Team, Qiyue Gao, Kun Zhou +15World Model EvaluationWorld Model-Based Planning

  5. Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation

    Mar 16, 2026Xingtai Gui, Meijie Zhang, Tianyi Yan +5Autonomous Driving PlanningWorld Model-Based Planning

  6. Beyond Dense Futures: World Models as Structured Planners for Robotic Manipulation

    Mar 13, 2026Minghao Jin, Mozheng Liao, Mingfei Han +2World Model-Based PlanningRobotic Manipulation

  7. Temporal Straightening for Latent Planning

    Mar 12, 2026Ying Wang, Oumayma Bounou, Gaoyue Zhou +4Latent-Space PlanningWorld Model-Based Planning

  8. MWM: Mobile World Models for Action-Conditioned Consistent Prediction

    Mar 8, 2026Han Yan, Zishang Xiang, Zeyu Zhang +1World Models for RoboticsAction-Conditioned World Models

  9. ICPRL: Acquiring Physical Intuition from Interactive Control

    Mar 1, 2026Xinrun Xu, Pi Bu, Ye Wang +8Physical ReasoningIn-Context RL

  10. GeoWorld: Geometric World Models

    Feb 26, 2026Zeyu Zhang, Danning Li, Ian Reid +1World Model LearningWorld Models

  11. OOWM: Structuring Embodied Reasoning and Planning via Object-Oriented Programmatic World Modeling

    Feb 25, 2026Hongyu Chen, Liang Lin, Guangrun WangLarge Language Model-Based Robot PlanningWorld Models

  12. Compositional Planning with Jumpy World Models

    Feb 23, 2026Jesse Farebrother, Matteo Pirotta, Andrea Tirinzoni +3Long-Horizon PlanningWorld Model-Based Planning

  13. JEPA-Bisim: Learning Robust Visual Representations for Planning with Joint-Embedding Predictive World Models

    Feb 20, 2026Leonardo F. Toso, Davit Shadunts, Yunyang Lu +5Visual Representation LearningWorld Models for Robotics

  14. H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model

    Feb 11, 2026Jinbang Huang, Wenyuan Chen, Zhiyuan Li +9Long-Horizon Robotic ManipulationWorld Models for Robotics

  15. Imagine-then-Plan: Agent Learning from Adaptive Lookahead with World Models

    Jan 13, 2026Youwei Liu, Jian Wang, Hanlin Wang +2World Model-Based PlanningModel-Based Planning

  16. MobileDreamer: Generative Sketch World Model for GUI Agent

    Jan 7, 2026Yilin Cao, Yufeng Zhong, Zhixiong Zeng +6Mobile GUI AutomationWorld Model Learning

  17. What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?

    Dec 30, 2025Basile Terver, Tsung-Yen Yang, Jean Ponce +2World Model-Based PlanningJoint-Embedding Predictive Architecture

  18. From Discrete Plans to Real-World Execution: A World-Model-Driven Framework for Execution-Aware Multi-Agent Path Finding

    Nov 26, 2025Jingtian Yan, Shuai Zhou, He Jiang +2Multi-Robot Motion PlanningWorld Models for Robotics

  19. Semantic World Models

    Oct 22, 2025Jacob Berg, Chuning Zhu, Yanda Bao +2World Models for RoboticsWorld Model-Based Planning

  20. OmniNWM: Omniscient Driving Navigation World Models

    Oct 21, 2025Bohan Li, Zhuang Ma, Dalong Du +10Action-Conditioned Video GenerationWorld Model Learning

  21. Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresight

    Oct 9, 2025Yifei Dong, Fengyi Wu, Guangyu Chen +9Embodied NavigationRobot Navigation

  22. MAPF-World: Action World Model for Multi-Agent Path Finding

    Aug 16, 2025Zhanjiang Yang, Yueming Li, Yang Shen +2Multi-Agent Path FindingMulti-Agent Planning