Memory-Augmented Video Generation

Follow this topic Ask about this topic

Momentum

12 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 65

All topics

SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generation
Jul 17, 2026Yilai Liu, Xin Zhang, Shiyuan Zhang +1Long Video Generation Memory-Augmented Video Generation
1The University of Hong Kong · 2Tsinghua University
WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory
Jul 2, 2026Hanlin Wang, Hao Ouyang, Qiuyu Wang +10Physical Consistency in Video Generation Camera-Controlled Video Generation
1HKUST · 2Ant Group · 3ZJU +1
MemLearner: Learning to Query Context memory for Video World Models
Jun 30, 2026Jiwen Yu, Jianxiong Gao, Jianhong Bai +7Action-Conditioned Video Generation Long-Horizon Video Generation
The University of Hong Kong · ‡Work done during an internship at Kling Team, Kuaishou Technology. · Fudan University +2
Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control
Jun 26, 2026Haoyuan Wang, Yabo Chen, Haibin Huang +2Camera-Controlled Video Generation Long-Horizon Video Generation
Institute of Artificial Intelligence, China Telecom (TeleAI)
Compression and Retrieval: Implicit Memory Retrieval for Video World Models
Jun 22, 2026Zhan Peng, Jie Ma, Huiqiang Sun +6Long-Horizon Video Generation Memory-Augmented Video Generation
Huazhong University of Science and Technology, China · HUJING Digital Media & Entertainment Group, China · Sun Yat-sen University, China
InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars
Jun 22, 2026Quanyue Song, Yishan He, Yanfei Zhang +6Real-Time Interactive Video Generation Memory-Augmented Video Generation
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, China · China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd., China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, China +1
UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating
Jun 19, 2026Jiehui Huang, Yuechen Zhang, Bin Xia +7Audio-Video Generation Memory-Augmented Video Generation
The Hong Kong University of Science and Technology · Kling Team, Kuaishou Technology · The Chinese University of Hong Kong +2
GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling
Jun 18, 2026Yixuan Lai, Tianjia Shao, Kun Zhou +3Long Video Generation Memory-Augmented Video Generation
State Key Lab of CAD&CG Zhejiang University Hangzhou, China · Fudan University Shanghai, China · Baidu Beijing, China
DreamX-World 1.0: A General-Purpose Interactive World Model
Jun 15, 2026DreamX Team, Yancheng Bai, Rui Chen +20Camera-Controlled Video Generation Real-Time Interactive Video Generation
DreamX Team
PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory
Jun 15, 2026Shuai Yang, Bingjie Gao, Ziwei Liu +3Multi-View Consistency Memory-Augmented Video Generation
Shanghai Jiao Tong University · S-Lab, Nanyang Technological University · Shanghai Innovation Institute +2
Closed-Loop Triplet Synergistic Generation for Long-Form Video
Jun 15, 2026Xinlei Yin, Xiulian Peng, Xiao Li +2Long Video Generation Memory-Augmented Video Generation
Microsoft Research Asia · University of Science and Technology of China
Memento: Reconstruct to Remember for Consistent Long Video Generation
Jun 12, 2026Xuan Wei, Longbin Ji, Guan Wang +5Long Video Generation Memory-Augmented Video Generation
Xiamen University · ERNIE Team, Baidu Inc.
Latent Spatial Memory for Video World Models
Jun 8, 2026Weijie Wang, Haoyu Zhao, Yifan Yang +7Video Diffusion Models Memory-Augmented Video Generation
Zhejiang University · Microsoft Research · Adelaide University +1
Echo-Memory: A Controlled Study of Memory in Action World Models
Jun 8, 2026Wayne King, Zeyue Xue, Yuxuan Bian +13Action-Conditioned Video Generation Video Diffusion Models
The University of Hong Kong · Joy Future Academy, JD · The Chinese University of Hong Kong +5
Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generation
Jun 3, 2026Yuxuan Bian, Zeyue Xue, Songchun Zhang +9Long Video Generation Memory-Augmented Video Generation
1The Chinese University of Hong Kong · 2Joy Future Academy, JD · 3The Hong Kong University of Science and Technology +4
Steady-Forcing: Balancing Spatial Persistence and Motion Continuity in Long-Horizon Nature Video Diffusion
Jun 2, 2026Matiur Rahman Minar, Seunghun Oh, GangHyeon Jeong +1Physical Consistency in Video Generation Long-Horizon Video Generation
Department of Computer Science and Engineering Sogang University Seoul, Korea · Department of Artifical Intelligence Sogang University Seoul, Korea
LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generation
Jun 1, 2026Qixin Hu, Shuai Yang, Wei Huang +2Autoregressive Diffusion Long Video Generation
NVIDIA · USC · MIT
Retrieve What's Missing: Coverage-Maximizing Retrieval for Consistent Long Video Generation
Jun 1, 2026Minseok Joo, Dogyun Park, Taehoon Lee +2Long-Horizon Video Generation Memory-Augmented Video Generation
Korea University · KAIST
Geometry-Aware Implicit Memory for Video World Models
Jun 1, 2026Zhengxuan Wei, Xu Guo, Xinghui Li +8World Model Learning Memory-Augmented Video Generation
School of Intelligence Science and Technology, Nanjing University · 2Kling Team, Kuaishou Technology · 3Tsinghua University
DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory
May 29, 2026Zhenhao Yang, Xiaoshi Wu, Zhengyao Lv +5Long-Horizon Video Generation Memory-Augmented Video Generation
1The University of Hong Kong · *Work done during an internship at Kling Team, Kuaishou Tech. · 2Kling Team, Kuaishou Technology
SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generation
May 29, 2026Weijia Dou, Hui Li, Jiahao Cui +3Video Diffusion Models Long-Horizon Video Generation
Fudan University · Meta Superintelligence Labs · Baidu
Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation
May 29, 2026Hanlin Chen, Jiaxin Wei, Xibin Song +5Action-Conditioned Video Generation Long-Horizon Video Generation
School of Computing, National University of Singapore · Technische Universität München · Vertex Lab +1
OmniMem: Scalable and Adaptive Memory Retrieval for Long Video Generation
May 28, 2026Lin Zhao, Yushu Wu, Yifan Gong +2KV Caching Long Video Generation
Northeastern University · Adobe Research
Teaching Video Generators to Remember: Eliciting Dynamic Memory for Out-of-Sight State Evolution
May 25, 2026Tianshuo Xu, Yichen Xie, Depu Meng +5Video Diffusion Models Long-Horizon Video Generation
Applied Intuition · University of California, Berkeley
EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation
May 22, 2026Jente Vandersanden, Matheus Gadelha, Chun-Hao P. Huang +2Memory-Augmented Video Generation Identity-Preserving Video Generation
Max Planck Institute for Informatics, Germany and Adobe Research, UK · Adobe Research, UK · Adobe Research, USA
WorldKV: Efficient World Memory with World Retrieval and Compression
May 21, 2026Jung Yi, Minjae Kim, Paul Hyunbin Cho +3KV Caching Memory-Augmented Video Generation
1KAIST AI · 2Naver AI Lab
DySink: Dynamic Frame Sinks for Autoregressive Long Video Generation
May 20, 2026Bo Ye, Xinyu Cui, Jian Zhao +2Long-Horizon Video Generation Memory-Augmented Video Generation
School of Computer Science and Engineering, Southeast University · Key Lab. of Computer Network and Information Integration, Southeast University · Southeast University +3
Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory
May 18, 2026Jinzhuo Liu, Jiangning Zhang, Wencan Jiang +5Long-Horizon Video Generation Memory-Augmented Video Generation
Zhejiang University · Tencent Youtu Lab · Huazhong University of Science and Technology +1
Echo-Forcing: A Scene Memory Framework for Interactive Long Video Generation
May 15, 2026Mingqiang Wu, Weilun Feng, Zhefeng Zhang +8Video Diffusion Models Long-Horizon Video Generation
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China · China University of Mining & Technology, Beijing +3
EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation
May 14, 2026Ruozhen He, Meng Wei, Ziyan Yang +1Long-Horizon Video Generation Memory-Augmented Video Generation
ByteDance · Rice University · ByteDance Seed

Jul 17, 2026, cs.CVJ/K move · Enter open · S save

SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generation

Yilai Liu, Xin Zhang, Shiyuan Zhang, Hongyang Du

1The University of Hong Kong · 2Tsinghua University

Long Video Generation Memory-Augmented Video Generation Video Generation Multi-Shot Video Generation

Open paper AskPDF arXiv

Maintaining recurring character identities across scene transitions and long temporal gaps is a central challenge in narrative long video generation. Methods targeting global consistency often retrieve memory using cues that are not aligned with character identity preservation, while recent character-centric variants still rely on coarse frame-level kv memory that entangles identity with incidental visual factors and lacks a continuous update mechanism under limited memory capacity. To address these limitations, we propose \textbf{SlotMem}, a character-addressable internal memory framework for multi-character narrative long video generation. Specifically, SlotMem uses a Character-Semantic Probe to localize character-relevant visual tokens from cross-attention responses, and a Memory Encoder to compress DiT tokens into compact role-wise slot memory. As generation proceeds, a Memory Writer conservatively updates each character's memory with new observations, while Character-Wise Cross-Attention retrieves the role memory and injects it only into localized tokens of the same character. Experiments on multiple narrative long video generation benchmarks show that SlotMem improves long-range character consistency over existing baselines, while maintaining comparable video quality. Our code is available at https://github.com/YilaiLiu-HKU/SlotMem.

Momentum

Related topics

Latest papers 65