World Model-Based Planning

Overview

World model-based planning studies how an agent can predict the consequences of actions and use those predictions to reach goals, avoid risks, or coordinate with others. Models may predict images, compact latent states, object relations, or physical dynamics, and planners use methods such as model-predictive control, CEM, tree search, and learned action policies. Work spans robot manipulation and navigation, autonomous driving, games, and language-guided agents, with approaches including hierarchical subgoals, uncertainty estimates, and symbolic or physics-based structure. A central challenge is that accurate-looking or low-error predictions may still rank actions poorly, especially over long horizons or under distribution shift, so researchers are developing planning-focused representations, diagnostics, and more efficient closed-loop adaptation.

Latest papers

CardsList

261 papers70 papers in the last four weeks, up 63% on the four weeks before. 0.4% of all new papers.

  1. How Much Can Best-of-N Help a World Action Model? Measuring Selectable Headroom and Realizing It in Closed Loop

    Oct 27, 2026Haojia Gao, Yue Cao, Yumin Liu +6World Model-Based PlanningAction-Conditioned World Models

  2. SWIM: Learning What Matters from Behaviors for JEPA World Models

    Oct 27, 2026Jiaming Hu, Shi Bo, Yan Zheng +11World Models for RoboticsWorld Model-Based Planning

  3. Rollback: Experience Backtracking in World Models for Policy Improvement

    Oct 26, 2026Jiayi Luo, Yang Zhang, Liliang Chen +13Robot Policy LearningRobotic RL

  4. Adapt for Planning, Not just Prediction: Optimistic Test-Time World Model Adaptation

    Oct 26, 2026Akshay Mete, Dileep Kalathil, P. R. KumarTest-Time AdaptationWorld Model-Based Planning

  5. Anticipating Social Consequences with Distributional World Models

    Oct 22, 2026Viet-Thanh Pham, Thuy-Trang Vu, Zhuang Li +2World Model-Based PlanningAction-Conditioned World Models

  6. PhysiCalWorld: In-Context Physics Calibration for World Models

    Oct 21, 2026Yunhao Luo, Wentao He, Yinpei Dai +5World ModelsAction-Conditioned World Models

  7. Events, Not Pixels: Where World Models Get the Return Wrong

    Oct 21, 2026Haoyue Liu, Xiaoying TangWorld Model-Based PlanningWorld Model Evaluation

  8. Self-Improving Agents with World Model Predictive Paths

    Oct 20, 2026Haori Lu, Tianyu Gao, Yaoyao Liu +1Self-Improving AgentsLLM Agent Planning

  9. WorldStream: Streaming Interactive 3D Worlds with Hierarchical Planning and Persistent State

    Oct 20, 2026Xiaoxiao Ma, Weiyang Jin, Yanwen Ma +11Interactive World Models3D Scene Generation

  10. Second Thoughts: Exploring and Planning through Comparative Imagination in World Models

    Oct 20, 2026Hieu Tran, Hong YuWorld Model-Based PlanningModel-Based RL

  11. World Models with Configurable Perception

    Oct 20, 2026Yijun Shen, Delong Chen, Xianming Hu +2World Model LearningWorld Model-Based Planning

  12. LaLa-World: Scaling Latent World Models with Natural Language Actions

    Oct 20, 2026Junha Song, Geonmo Gu, Jeongeun Park +5World Model LearningLatent World Models

  13. AnyGoal: On World Model Generalization Beyond Expert Rollouts

    Oct 19, 2026Heejeong Nam, Divyat Mahajan, Quentin Le Lidec +2World ModelsWorld Model-Based Planning

  14. Learning Goal-Conditioned Subgoals through Frozen Hierarchical World Models

    Oct 19, 2026Xiang Kaibo, Liu QingfengHierarchical World ModelsWorld Model-Based Planning

  15. Latent Projection for Latent Planning

    Oct 19, 2026Yoo Sung Jang, Michael RyooLatent-Space PlanningWorld Model-Based Planning

  16. Vector-Quantized World Model: Latent Feedback Motion Planning for Robot Manipulation

    Oct 19, 2026Xuezhou Xu, Chung-Pang Wang, Zhenzhen Li +1Long-Horizon Robotic ManipulationWorld Model-Based Planning

  17. Plans Are Not Executions: Adapting Frozen World-Model Planners to Controller-Induced Execution Shift

    Oct 15, 2026Danqi Zhao, Keyu Chen, Wenchao Sun +6Autonomous Driving PlanningWorld Model-Based Planning

  18. Neurosymbolic Learning of Interpretable World Models

    Oct 14, 2026Riccardo Andreoni, Massimiliano Ronzani, Chiara Ghidini +2Temporal LogicWorld Model Learning

  19. Pretrained Features as Teachers, Not States: Compact Latent World Models for Visual Planning

    Oct 14, 2026Yanbo Wang, Nan Lin, Wendelin Böhmer +1World Model-Based PlanningLatent World Models

  20. MemWM: Associative Memory-Enhanced Latent World Models for Long-Horizon Planning

    Oct 14, 2026Yuwei Sun, Siyu ZhuWorld Model LearningWorld Models for Robotics

  21. Back on Track: Deployment-time Policy Improvement via World Model Planning

    Oct 14, 2026Colton Crosby, Hao Wang, Mac Schwager +1Robot Policy AdaptationWorld Model-Based Planning

  22. Order-Consistent Latent Geometry for Reliable Short-Horizon Planning in World Models

    Oct 13, 2026Junlin Wu, Wen Fan, Dandan ZhangLatent Space GeometryLatent-Space Planning

  23. SkipWorld: Latent Skip Planning with Distilled World Models for Efficient Visual Navigation

    Oct 13, 2026Yifei Yang, Zehua Fan, Zike Yan +2Visual NavigationWorld Model-Based Planning

  24. Relational Learning as World Modeling

    Oct 12, 2026Zheyu Zhang, Gjergji KasneciAction-Conditioned World ModelsWorld Model-Based Planning

  25. World Modeling through Spectral Alignment

    Oct 11, 2026Holger Molin, William Peng, Marco Bagatella +1World Model LearningLatent World Models

  26. PILOT: Guiding Long-Horizon World-Model Planning for Robot Manipulation with Visual Subgoals and Policy Priors

    Oct 9, 2026Yang Liu, Hanchen Cui, Karthik DesinghLong-Horizon Robotic ManipulationRobot Task Planning