Memory-Augmented Video Generation

Overview

Memory-augmented video generation studies how video models can retain useful information beyond their immediate context, supporting consistent characters, scenes, and events over long clips or repeated scene visits. Approaches include selecting and compressing frames or attention-cache entries, learning compact memory tokens or entity slots, and using camera geometry or 3D structure to retrieve relevant spatial evidence. These methods are used in multi-shot storytelling and interactive world models, and are tested on long-video, camera-control, and scene-revisit benchmarks such as VBench-Long and revisit-consistency suites. A central challenge is keeping memory bounded without losing evidence, while allowing scenes and motion to evolve; replay fidelity alone may not measure whether a model can reliably recall a world.

Latest papers

CardsList

122 papers15 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. MovieRoll: A Systematic Framework for Rolling Out Long-Form Videos

    Nov 16, 2026Yunyang Ge, Weijie Kong, Ryan Xu +9Long-Horizon Video GenerationVideo Generation

  2. AgiWorld: An Agentic Video World Model for Building Persistent Worlds

    Nov 2, 2026Shaoheng Fang, Yiqun Mei, Hanwen Jiang +7Video World ModelsAgentic Video Generation

  3. What Helps Denoising Can Hurt Memory: Rethinking History in Long Video Generation

    Oct 31, 2026Yubin Jing, Ziyang Zhang, Meng Chen +3Long-Horizon Video GenerationAutoregressive Video Generation

  4. FilmTogether: Cinematic Video Generation from Low-Cost Inputs

    Oct 31, 2026Shiying Zhang, Xiaobin Hu, Qianchi Zhang +4Video EditingInstruction-Based Video Editing

  5. Old Is Not False: Valid-Time Memory for Interactive Video World Models

    Oct 31, 2026Ziming Wang, Chuyue Gong, Hongliang Cao +4Memory-Augmented Video GenerationInteractive World Models

  6. SE-Mem: Semantic-Episodic Memory for Scene-Consistent Generative View Synthesis

    Oct 31, 2026Changsong Lei, Yihan Li, Yu-Hui Wen +5Camera-Conditioned Video GenerationMemory-Augmented Video Generation

  7. Any Forcing: Any-Step Generality and One-Step Stability for Autoregressive Video Generation

    Oct 30, 2026Jiahua Xu, Yijie Fang, Nannan Wang +6Autoregressive Video GenerationLong-Horizon Video Generation

  8. L3G-World: Real-Time Infinite World Generation with Latent 3D Gaussian Memory

    Oct 29, 2026Jinhyeok Choi, JoungBin Lee, Jongmin Lee +5Video World ModelsReal-Time Interactive Video Generation

  9. GROME: GROunding Factorized MEmory into Video World Models

    Oct 29, 2026Fang Yu, Xiaoxue Wu, Haiyu Zhang +6Memory-Augmented Video GenerationTemporal Consistency in Video Generation

  10. Hy-Nomas: Towards Free-form Interactive World Generation

    Oct 27, 2026Qiaoling Chen, Jiaxiang Cheng, Xueqing Deng +35Interactive World ModelsVideo Generation

  11. More Memory, Better Videos? A Controlled Study of Visual Memory in Long-Video Generation

    Oct 26, 2026Yuzhuo Chen, Huafeng Shi, Xinyu Wang +6Memory-Augmented Video GenerationRetrieval-Augmented Video Generation

  12. WorldCast: World-Consistent Character Video Generation with Large-Angle Camera Control

    Oct 23, 2026Lei Cao, Yu Liu, Wenhua Liao +7Video GenerationCamera-Controlled Video Generation

  13. Attn-Forcing: Learning Full-Context Attention Proxies for Streaming Video Generation

    Oct 21, 2026Junyao Gao, Sibo Liu, Jiaxing Li +5Streaming Video GenerationMemory-Augmented Video Generation

  14. Recast the Past: Stable Long Video Generation with Full Context Memory

    Oct 20, 2026Yukuo Ma, Cong Liu, Junke Wang +4Long-Horizon Video GenerationMemory-Augmented Video Generation

  15. Persistent Planar Memory for Video World Models

    Oct 16, 2026Yuze He, Bin Tan, Zelin Gao +4Video World ModelsMemory-Augmented Video Generation

  16. Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context Reasoning

    Oct 16, 2026Xikang Guan, Shaocong Yang, Yanqi Bao +6Physical Consistency in Video GenerationVideo Generation

  17. Momentum: Persistent Dynamics for Video World Models

    Oct 16, 2026Nedko Savov, Stefan Maria Ailuro, Danda Pani Paudel +3Video World ModelsMemory-Augmented Video Generation

  18. Velox: Spatial Memory Makes World Models Efficient

    Oct 15, 2026Qiuhong Shen, Shizun Wang, Xinchao WangAttention RoutingVideo World Models

  19. Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation

    Oct 14, 2026Weijie Wang, Haomin Zhang, Ye Li +7Agentic Video GenerationMulti-Shot Video Generation

  20. StateCraft: Augmenting Video World Models with Abstract-State Reasoning

    Oct 14, 2026Lorenzo Venturoli, Nedko Savov, Xi Wang +2Video World ModelsLong-Horizon Video Generation

  21. Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation

    Oct 13, 2026Nikolay Semenov, Artem Riabinin, Sergey Bassenko +8Audio-Video GenerationAudio-Driven Facial Animation

  22. CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generation

    Oct 13, 2026Xiaoxue Wu, Xinyu Gao, Fang Yu +2Memory-Augmented Video GenerationMulti-Shot Video Generation

  23. 4LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling

    Oct 13, 2026Jianhui Zhang, Zuyao Lin, Pengxin Xu +2Video World ModelsMemory-Augmented Video Generation

  24. World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models

    Oct 12, 2026Junyi Wu, Zekun Li, Chenhongyi Yang +9Video World ModelsMemory-Augmented Video Generation

  25. REEL: Learning to Retrieve, Evaluate, and Evolve Visual Memory for Any Long-Horizon Multi-Shot Video Generation

    Oct 12, 2026Hang Xu, Guohui Zhang, Xiaoxiao Ma +7Memory-Augmented Video GenerationLong-Horizon Video Generation

  26. Totem: Object-Centric 3D Memory for World-Consistent Video Generation

    Oct 11, 2026Zichen Wan, Tianyu Huang, Fan Li +33D-Aware Video GenerationVideo World Models

  27. Memory Forcing: Attendable Mid-Horizon History for Streaming Video Generation

    Oct 8, 2026Jiaming Zhang, Xinyu Wang, Huafeng Shi +2Streaming Video GenerationMemory-Augmented Video Generation