Overview

Video world models predict how scenes change over time, often in response to actions or camera movements, so agents can explore, plan, and test decisions in imagined environments. Common approaches use autoregressive or diffusion video generation, sometimes predicting compact visual features instead of pixels, and add action conditioning, 3D geometry, persistent memory, or explicit world states to improve control and consistency. Applications include robotic manipulation, autonomous driving, navigation, and interactive games, with evaluation increasingly testing physical dynamics, action following, memory, and downstream task performance alongside visual quality. A central challenge is that realistic-looking video does not necessarily preserve hidden state, obey physics, or support reliable long-horizon interaction, while richer simulation and memory can raise compute and latency costs.

Latest papers

CardsList

285 papers37 papers in the last four weeks, down 40% on the four weeks before. 0.3% of all new papers.

  1. SciWorldBench: Do Video World Models Really Understand Scientific Experiments?

    Nov 16, 2026Xue Yang, Haonan Cai, Xinyu Hang +4Video World ModelsVideo Generation Evaluation

  2. The Flip Test: Video World Models Fail to Learn the World State

    Nov 15, 2026Mi Luo, Lijun Yu, Adams Wei Yu +10Video World ModelsWorld Model Learning

  3. CoCode-World: Shared 3D Proxy Representation for Multi-Player World Models

    Nov 11, 2026Qirui Li, Xin Zhang, Yabo Chen +7Video World ModelsMulti-View Video Generation

  4. WanderBench: Can World Models Explore Dynamic Worlds from Video?

    Nov 9, 2026Yuhang Chen, Jiheng Li, Jiale Wang +2Video World ModelsWorld Model Evaluation

  5. QCC-WM: Linking Macro-State Dynamics and Visual Generation via Quotient Causal Construction

    Nov 9, 2026Zhizhong Fu, Wei Zhou, Zhaoyang Jiang +7Action-Conditioned World ModelsVideo World Models

  6. EvoWorld: Towards Out-of-Sight World Evolution in Generative Video Models

    Nov 4, 2026Yequan Bie, Dengyang Jiang, Zhixuan Chen +5Video World ModelsCausal Video Generation

  7. TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds

    Nov 4, 2026Jiaao Yu, Yanjian Zhang, Haoyang Jiang +3Controllable Video GenerationReal-Time Interactive Video Generation

  8. Compression Forcing: Hierarchical History Tokenization Enables Flexible World Models

    Nov 2, 2026Siqiao Huang, Partha Kaushik, Michael Chen +5World Model LearningWorld Models

  9. History Forcing: Distilling History-Dependent Continuations for Long-Horizon Video World Models

    Nov 2, 2026Hangyi Kuang, Chengzhi Wang, Yefei He +8Video GenerationLong-Horizon Video Generation

  10. AgiWorld: An Agentic Video World Model for Building Persistent Worlds

    Nov 2, 2026Shaoheng Fang, Yiqun Mei, Hanwen Jiang +7Video World ModelsAgentic Video Generation

  11. When Does Latent Prediction Error Support Physical Surprise Claims in Video World Models?

    Nov 1, 2026Anton Hristov, Aleksandar Slavov, Vasil VasilevVideo World ModelsWorld Model Evaluation

  12. GSExplorer: Interactive World Generation with a Persistent 3D Gaussian World State

    Nov 1, 2026Sicheng Yu, Liu Liu, Xinjie Wang +73D-Aware Video GenerationVideo World Models

  13. Dreams Are Cheaper Than Flights: Curated World-Model Data Improves Aerial Detection

    Oct 29, 2026Rugved Katole, Vedant Patil, Jenna Kline +1Synthetic Data AugmentationSynthetic Data Evaluation

  14. L3G-World: Real-Time Infinite World Generation with Latent 3D Gaussian Memory

    Oct 29, 2026Jinhyeok Choi, JoungBin Lee, Jongmin Lee +5Video World ModelsReal-Time Interactive Video Generation

  15. Fight World Model: Customizable Combat through Visual Interaction Proxies

    Oct 29, 2026Jiahua Li, Zixu John, Tom Zhong +5Game World ModelsInteractive World Models

  16. GROME: GROunding Factorized MEmory into Video World Models

    Oct 29, 2026Fang Yu, Xiaoxue Wu, Haiyu Zhang +6Memory-Augmented Video GenerationTemporal Consistency in Video Generation

  17. WorldProbe: When Video World Models Fall Apart under Long-Horizon Spatial Exploration

    Oct 29, 2026Minqi Wang, Jie Peng, Hejun Dong +8Video World ModelsWorld Model Evaluation

  18. FutureWorld: A Plug-and-Play Causal Next-State Predictor for Interactive Video World Exploration

    Oct 29, 2026Guangyuan Li, Kelu Yao, Shuolin Xu +6Interactive World ModelsVideo World Models

  19. WorldFlow: Joint Video and 3D Motion Prediction via Large-Scale Pretraining

    Oct 29, 2026Yuhao Lu, Jiongxu Chen, Hexiang Wei +9Video World ModelsMultimodal Trajectory Prediction

  20. GameVerse: A Minute-Scale Gameplay Dataset for Long-Horizon Interactive World Modeling

    Oct 27, 2026Kang He, Wenshuo Peng, Chuanhao Li +7Multimodal DatasetInteractive World Models

  21. Video World Models Need Predictable Latents

    Oct 26, 2026Mattia Scardecchia, Sherry YangVideo World ModelsWorld Model Learning

  22. FlockWorld: Toward Population-Scale Multi-Agent Video World Models through Artificial Life Simulation

    Oct 25, 2026Meryem Koksal, Yunzhe Wang, Volkan UstunVideo World ModelsAction-Conditioned Video Generation

  23. RoboWorM: Evaluating Movement Realism, Consistency and Acceleration Affects in Embodied Video World Models

    Oct 24, 2026Doanh Le Thien, Viet-Thanh Nguyen, Pham Tri Quang +18World Model EvaluationVideo World Models