Memory-Augmented Video Generation

Overview

Memory-augmented video generation studies how video models can retain useful information beyond their immediate context, supporting consistent characters, scenes, and events over long clips or repeated scene visits. Approaches include selecting and compressing frames or attention-cache entries, learning compact memory tokens or entity slots, and using camera geometry or 3D structure to retrieve relevant spatial evidence. These methods are used in multi-shot storytelling and interactive world models, and are tested on long-video, camera-control, and scene-revisit benchmarks such as VBench-Long and revisit-consistency suites. A central challenge is keeping memory bounded without losing evidence, while allowing scenes and motion to evolve; replay fidelity alone may not measure whether a model can reliably recall a world.

Latest papers

CardsList

110 papers31 papers in the last four weeks, up 520% on the four weeks before. 0.2% of all new papers.

  1. Hy-Nomas: Towards Free-form Interactive World Generation

    Oct 27, 2026Qiaoling Chen, Jiaxiang Cheng, Xueqing Deng +35Interactive World ModelsVideo Generation

  2. More Memory, Better Videos? A Controlled Study of Visual Memory in Long-Video Generation

    Oct 26, 2026Yuzhuo Chen, Huafeng Shi, Xinyu Wang +6Memory-Augmented Video GenerationRetrieval-Augmented Video Generation

  3. WorldCast: World-Consistent Character Video Generation with Large-Angle Camera Control

    Oct 23, 2026Lei Cao, Yu Liu, Wenhua Liao +7Video GenerationCamera-Controlled Video Generation

  4. Attn-Forcing: Learning Full-Context Attention Proxies for Streaming Video Generation

    Oct 21, 2026Junyao Gao, Sibo Liu, Jiaxing Li +5Streaming Video GenerationMemory-Augmented Video Generation

  5. Recast the Past: Stable Long Video Generation with Full Context Memory

    Oct 20, 2026Yukuo Ma, Cong Liu, Junke Wang +4Long-Horizon Video GenerationMemory-Augmented Video Generation

  6. Persistent Planar Memory for Video World Models

    Oct 16, 2026Yuze He, Bin Tan, Zelin Gao +4Video World ModelsMemory-Augmented Video Generation

  7. Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context Reasoning

    Oct 16, 2026Xikang Guan, Shaocong Yang, Yanqi Bao +6Physical Consistency in Video GenerationVideo Generation

  8. Momentum: Persistent Dynamics for Video World Models

    Oct 16, 2026Nedko Savov, Stefan Maria Ailuro, Danda Pani Paudel +3Video World ModelsMemory-Augmented Video Generation

  9. Velox: Spatial Memory Makes World Models Efficient

    Oct 15, 2026Qiuhong Shen, Shizun Wang, Xinchao WangAttention RoutingVideo World Models

  10. Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation

    Oct 14, 2026Weijie Wang, Haomin Zhang, Ye Li +7Agentic Video GenerationMulti-Shot Video Generation

  11. StateCraft: Augmenting Video World Models with Abstract-State Reasoning

    Oct 14, 2026Lorenzo Venturoli, Nedko Savov, Xi Wang +2Video World ModelsLong-Horizon Video Generation

  12. Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation

    Oct 13, 2026Nikolay Semenov, Artem Riabinin, Sergey Bassenko +8Audio-Video GenerationAudio-Driven Facial Animation

  13. CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generation

    Oct 13, 2026Xiaoxue Wu, Xinyu Gao, Fang Yu +2Memory-Augmented Video GenerationMulti-Shot Video Generation

  14. 4LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling

    Oct 13, 2026Jianhui Zhang, Zuyao Lin, Pengxin Xu +2Video World ModelsMemory-Augmented Video Generation

  15. World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models

    Oct 12, 2026Junyi Wu, Zekun Li, Chenhongyi Yang +9Video World ModelsMemory-Augmented Video Generation

  16. REEL: Learning to Retrieve, Evaluate, and Evolve Visual Memory for Any Long-Horizon Multi-Shot Video Generation

    Oct 12, 2026Hang Xu, Guohui Zhang, Xiaoxiao Ma +7Memory-Augmented Video GenerationLong-Horizon Video Generation

  17. Totem: Object-Centric 3D Memory for World-Consistent Video Generation

    Oct 11, 2026Zichen Wan, Tianyu Huang, Fan Li +33D-Aware Video GenerationVideo World Models

  18. Memory Forcing: Attendable Mid-Horizon History for Streaming Video Generation

    Oct 8, 2026Jiaming Zhang, Xinyu Wang, Huafeng Shi +2Streaming Video GenerationMemory-Augmented Video Generation

  19. Learning to Retrieve: Internalizing Memory Retrieval for Video World Models

    Oct 8, 2026JiaKui Hu, Tailai Chen, Yuqi Pan +8Memory-Augmented Video GenerationVideo World Models

  20. Keepsake: Selective Spatial Memory for Long-Horizon Video Generation

    Oct 5, 2026Abdul Mohaimen Al Radi, Kunyang Li, Yuzhang Shang +2Camera-Controlled Video GenerationLong-Horizon Video Generation

  21. HLA-WM: Hybrid Linear Attention for Long-Horizon Video World Models

    Oct 5, 2026Zhuokun Chen, Feng Chen, Xi Lin +4World Model LearningLong-Horizon Video Generation

  22. Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation

    Oct 2, 2026Ziyi Wang, Junchi Yao, Heqian Qiu +5Compositional Video GenerationVideo Generation

  23. Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory

    Oct 1, 2026Ying Yang, Guiyu Zhang, Lianghua Huang +5Memory-Augmented Video GenerationWorld Models

  24. MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation

    Oct 1, 2026Yiwen Zhang, Haocheng Xi, Michael Tian-Yue Liu +4Image-to-Video GenerationLong-Horizon Video Generation

  25. Memory-Guided B-Roll Generation from User Video Collections

    Oct 1, 2026Cusuh Ham, Fabian Caba Heilbron, Josef Sivic +1Video-Reference Video GenerationMemory-Augmented Video Generation

  26. LOCI: Spatial Linear Memory for Streaming World Models

    Sep 30, 2026Ji Xia, Tingting Liao, Xuezhi Liang +2World ModelsMemory-Augmented Video Generation

  27. FrameMorrow: Future-guided Frame Selection with Prospective Tokens for Long-Horizon Video Generation

    Sep 30, 2026Bo Yin, Xiaobin Hu, Jiaqi Zhao +1Long-Horizon Video GenerationMemory-Augmented Video Generation

  28. Honeycomb: Constant-Size Scene Memory Representation for Video World Models

    Sep 29, 2026Jack Wei Lun Shi, Kaichen Zhou, Haoyu Chen +6Long-Horizon Video GenerationMemory-Augmented Video Generation

  29. Compress to Remember: Learning Compact Memory via On-Policy Distillation for Long Video Generation

    Sep 28, 2026Xiaoyu Wu, Weihang Guo, Yifei Wang +3Video Diffusion ModelsLong Video Generation