Overview

Video world models predict how scenes change over time, often in response to actions or camera movements, so agents can explore, plan, and test decisions in imagined environments. Common approaches use autoregressive or diffusion video generation, sometimes predicting compact visual features instead of pixels, and add action conditioning, 3D geometry, persistent memory, or explicit world states to improve control and consistency. Applications include robotic manipulation, autonomous driving, navigation, and interactive games, with evaluation increasingly testing physical dynamics, action following, memory, and downstream task performance alongside visual quality. A central challenge is that realistic-looking video does not necessarily preserve hidden state, obey physics, or support reliable long-horizon interaction, while richer simulation and memory can raise compute and latency costs.

Latest papers

CardsList

285 papers37 papers in the last four weeks, down 40% on the four weeks before. 0.3% of all new papers.

  1. Distilling Dense Trajectory Teachers For Large-Motion Video World Models

    Oct 24, 2026Shuofeng Sun, Linqing Zhao, Haibin YanVideo World ModelsCamera-Controlled Video Generation

  2. UniWorld: A Unified World Model for Real-Time Visual World Simulation

    Oct 23, 2026Xin Zhang, Yabo Chen, Shuaiwei Wang +4Video World ModelsVideo Generation

  3. Reading, Writing, Sharing, and Interacting with the World through Video

    Oct 22, 2026Shengqiong Wu, Meng Luo, Bobo Li +5Video Foundation ModelsVideo World Models

  4. Rethinking Video Autoencoders for Interactive World Models

    Oct 21, 2026Adrien Ramanana Rahary, Yutong Bai, Nicolas Dufour +2Video World ModelsAutoencoders

  5. LiveAct: Towards Real-Time Multi-Agent World Models with Heterogeneous Action Interfaces

    Oct 21, 2026Xinyu Wang, Huafeng Shi, Yue Ma +9Video World ModelsReal-Time Interactive Video Generation

  6. AEON: Unifying Video and 3D World Models

    Oct 20, 2026Weiqi Zhang, Wenyuan Zhang, Yu-Shen Liu +1Video World Models3D-Aware Video Generation

  7. OverSeer: Multi-Agent World Models Beyond What Agents See

    Oct 20, 2026Runjia Li, Kam Woh Ng, Minghao Chen +6Video World ModelsMulti-View Consistency

  8. ActionRoPE: Action as Coordinates for Spatially Consistent Control in Planar-Camera Game World Models

    Oct 19, 2026Zhiyang Deng, Yuzhe Wu, Zijun Lin +1Game World ModelsAction-Conditioned Video Generation

  9. UniState: Unifying Memory and Intervention for Controllable World Simulation

    Oct 18, 2026Jaeseok Jeong, Kyungmook Choi, Sohyun Chung +2Controllable Video GenerationVideo World Models

  10. Beckmann World Models: Direct Terminal-Map Learning for One-Step Action-Conditioned Prediction

    Oct 16, 2026Adam Lee, Shobhit Agarwal, June Pyo SuhWorld Model LearningAction-Conditioned World Models

  11. Persistent Planar Memory for Video World Models

    Oct 16, 2026Yuze He, Bin Tan, Zelin Gao +4Video World ModelsMemory-Augmented Video Generation

  12. Execution Before Memory: Diagnosing Memory Failures in Video World Models

    Oct 16, 2026Weiyang Jin, Jiwen Yu, Sihan Xu +2World Model EvaluationVideo World Models

  13. Momentum: Persistent Dynamics for Video World Models

    Oct 16, 2026Nedko Savov, Stefan Maria Ailuro, Danda Pani Paudel +3Video World ModelsMemory-Augmented Video Generation

  14. Velox: Spatial Memory Makes World Models Efficient

    Oct 15, 2026Qiuhong Shen, Shizun Wang, Xinchao WangAttention RoutingVideo World Models

  15. CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

    Oct 15, 2026Dongjie Cheng, Ruifeng Yuan, Ran Wei +3VLM ReasoningVideo Reasoning

  16. StateCraft: Augmenting Video World Models with Abstract-State Reasoning

    Oct 14, 2026Lorenzo Venturoli, Nedko Savov, Xi Wang +2Video World ModelsLong-Horizon Video Generation

  17. Time-JEPA: Grounding Video World Models with Physical Time Series

    Oct 14, 2026Shenyi Li, Ziyang Zhang, Wen Wu +2Video World ModelsPhysical Reasoning in Video

  18. WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models

    Oct 13, 2026Nan Zhou, Jianxiong Gao, Qiuyu Wang +10World Model EvaluationVideo World Models

  19. 4LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling

    Oct 13, 2026Jianhui Zhang, Zuyao Lin, Pengxin Xu +2Video World ModelsMemory-Augmented Video Generation

  20. World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models

    Oct 12, 2026Junyi Wu, Zekun Li, Chenhongyi Yang +9Video World ModelsMemory-Augmented Video Generation

  21. Totem: Object-Centric 3D Memory for World-Consistent Video Generation

    Oct 11, 2026Zichen Wan, Tianyu Huang, Fan Li +33D-Aware Video GenerationVideo World Models

  22. Across Viewpoints and Time: Trajectory-Generalizable Physical Attacks on World Models and Video Understanding Models

    Oct 11, 2026Song Xia, Meiwen Ding, Chenqi Kong +2Adversarial AttacksPhysical Adversarial Attacks

  23. Remembering What Matters for Long-Horizon Robotic World Models

    Oct 10, 2026Hao Wu, Tianyu Shao, Shengju Qian +10Video World ModelsVideo Prediction

  24. GLIMPSE: Global-Local Indexing with Multi-Precision Spectral Encoding for Explorable Video World Models

    Oct 9, 2026Zhufeng Xu, Henglei Lv, Bailin Deng +5Video World ModelsMemory-Augmented Video Understanding

  25. What 30,000 Hours of Ego-centric Video Does Not Teach

    Oct 8, 2026Jiahua Dong, Anurag Bagchi, Yash Jangir +7Video World ModelsWorld Models

  26. WorldGuide: Goal-Directed Video World Model for Procedural Task Execution

    Oct 8, 2026Ankan Deria, Komal Kumar, Hisham Cholakkal +2Video GenerationAgentic Video Generation

  27. WorldCast: Distributed Multiplayer World Models

    Oct 8, 2026Ziyang Ye, Junchao Huang, Evelyn Zhang +9World ModelsInteractive World Models

  28. Learning to Retrieve: Internalizing Memory Retrieval for Video World Models

    Oct 8, 2026JiaKui Hu, Tailai Chen, Yuqi Pan +8Memory-Augmented Video GenerationVideo World Models