Overview

Interactive world models study how to represent and predict environments as agents act, so they can support planning, policy training, and playable experiences. Common approaches include action-conditioned autoregressive video diffusion, latent dynamics models, persistent 3D scene memory, and hybrids that combine learned generation with physics or explicit world state. Evaluation spans games, robotics, driving, and interfaces, with benchmarks testing action responsiveness, spatial and physical consistency, memory on revisits, and long-horizon stability. A central tension is making rollouts fast and visually convincing while preserving causal, persistent state; models still often drift or respond inconsistently over extended interactions.

Latest papers

CardsList

134 papers19 papers in the last four weeks, down 14% on the four weeks before. 0.1% of all new papers.

  1. WorldRuler: Interactive World Modeling under Configurable Rules

    Nov 18, 2026Mingliang Zhai, Chuanhao Li, Jiaming Tan +6Interactive World ModelsGame World Models

  2. StrideWorld: Benchmarking Scene Rigidity and Action Consistency in Interactive Video World Model

    Nov 18, 2026Chuang Wang, Rui Nie, Jie Song +9World Model EvaluationInteractive World Models

  3. WM^MLLM: Turning MLLMs into World Models

    Nov 18, 2026Baiang Li, Enze Xie, Jincheng Yu +5World ModelsInteractive World Models

  4. Making the World React Realistically: A Closed-Loop Interactive World Model for Autonomous Driving

    Nov 17, 2026Jia Hu, Yang Chang, Panqu Wang +4World Models for Autonomous DrivingInteractive World Models

  5. Every Camera Grows Up: Camera-Height Regression in Interactive Video World Models

    Nov 16, 2026Sheng Lu, Guangpin Tao, Tong Lu +1Interactive World ModelsWorld Model Evaluation

  6. GameWM: Toward Next-Generation Video Games with Interaction-Centric World Models

    Nov 14, 2026Bing He, Runze Wang, Fei Zha +5Game World ModelsVideo Games

  7. PlayGen2: Learning Real-Time Playable Worlds with Explicit 3D State

    Nov 5, 2026Jihai Zhang, Yuhan Zhou, Junyou Li +3Game World ModelsVideo Games

  8. Old Is Not False: Valid-Time Memory for Interactive Video World Models

    Oct 31, 2026Ziming Wang, Chuyue Gong, Hongliang Cao +4Memory-Augmented Video GenerationInteractive World Models

  9. Fight World Model: Customizable Combat through Visual Interaction Proxies

    Oct 29, 2026Jiahua Li, Zixu John, Tom Zhong +5Game World ModelsInteractive World Models

  10. WorldProbe: When Video World Models Fall Apart under Long-Horizon Spatial Exploration

    Oct 29, 2026Minqi Wang, Jie Peng, Hejun Dong +8Video World ModelsWorld Model Evaluation

  11. FutureWorld: A Plug-and-Play Causal Next-State Predictor for Interactive Video World Exploration

    Oct 29, 2026Guangyuan Li, Kelu Yao, Shuolin Xu +6Interactive World ModelsVideo World Models

  12. Context Compaction for World Models

    Oct 28, 2026Hayder TirmaziWorld ModelsLLM World Models

  13. GameVerse: A Minute-Scale Gameplay Dataset for Long-Horizon Interactive World Modeling

    Oct 27, 2026Kang He, Wenshuo Peng, Chuanhao Li +7Multimodal DatasetInteractive World Models

  14. Hy-Nomas: Towards Free-form Interactive World Generation

    Oct 27, 2026Qiaoling Chen, Jiaxiang Cheng, Xueqing Deng +35Interactive World ModelsVideo Generation

  15. BoxWorld: Let World Engines Control and Video Generators Render

    Oct 26, 2026Zike Wu, Ahmed Hatem, Chintan Trivedi +4Real-Time Interactive Video GenerationInteractive World Models

  16. WorldPager: Zero-Stall Tiered Memory for Long-Horizon World Models on a Single Consumer GPU

    Oct 26, 2026Bingnan Liu, Ruini XueKV-Cache OffloadingInteractive World Models

  17. WMEval: Evaluating Interactive World Models Grounded on Physical Simulations

    Oct 24, 2026Lanxiang Hu, Yixin Huang, Abhilash Shankarampeta +13World Model EvaluationInteractive World Models

  18. WorldMirror: Agentic Real-to-Sim Generation of Interactive Worlds from In-the-Wild Robot Demonstrations

    Oct 22, 2026Tianling Xu, Weijie Wan, Honghao Su +9Robotics SimulationDigital Twins

  19. WorldStream: Streaming Interactive 3D Worlds with Hierarchical Planning and Persistent State

    Oct 20, 2026Xiaoxiao Ma, Weiyang Jin, Yanwen Ma +11Interactive World Models3D Scene Generation

  20. RIGen: Beyond Action Following with Reciprocal Interaction in Generative Gameplay

    Oct 14, 2026Mengfei Li, Yi Zhang, Xingtong Ge +8Real-Time Interactive Video GenerationInteractive World Models

  21. Orbia: Do Generated Videos Form a Consistent 3D World?

    Oct 14, 2026Dongyue Lu, Guian Fang, Hur Lim +20Geometric Consistency in Video GenerationWorld Model Evaluation

  22. Multics: Generative Multi-Player World Model with Hierarchical Communication

    Oct 12, 2026Kaiyi Huang, Wangbo Yu, Yukun Huang +6Interactive World ModelsWorld Models

  23. Esports World Model Dataset

    Oct 12, 2026Weiyu Ma, Zeyuan Gong, Xuhui Liu +5Interactive World ModelsWorld Model Learning