Diffusion Model Caching

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 69

All topics

CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching
Oct 6, 2026Shangye Song, Dong Gong, Hong Jia +2Action-Conditioned Video Generation Real-Time Interactive Video Generation
University of Auckland · UNSW Sydney
MC-Sparse: Deconstructing and Closing the Dense-Sparse Attention Gap in Diffusion Transformers
Oct 5, 2026Jiarui Chen, Zeqiang Lai, Jiangshan Wang +5Video Diffusion Models Diffusion Transformer
Fudan University · Tencent HY · Shanghai Innovation Institute +4
Hybrid-Basis Feature Forecasting for Diffusion Sampling Acceleration
Oct 4, 2026Kai-Liang Cheng, Yuan-Yuan Cheng, Yu-fan Jin +1Diffusion Sampling Diffusion Model Caching
University of Science and Technology of China, China
The Golden Path Hypothesis: Reusable Schedules in Diffusion Caching
Sep 30, 2026Dong Wang, Wenwu Tang, Francesco Corti +3Diffusion Model Caching Diffusion Timestep Scheduling
Graz University of Technology, Austria · Swiss Data Science Center, Switzerland · ETH Zurich, Switzerland +1
Time-Anchored Diffusion Language Models: Latent-Space Caching for Fast Generation
Sep 29, 2026Joel Anto Paul, Litu Rout, Aditya Akella +1Diffusion Language Model Inference Diffusion Model Caching
UT Austin
ReCaVSR: One-Step Streaming Diffusion Video Super-Resolution with Recycled Latents and Learned Cache Routing
Sep 29, 2026Xijun Wang, Xin Li, Suhang Yao +3Diffusion Transformer Streaming Video Generation
University of Science and Technology of China
RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidance
Sep 29, 2026Yiming Liu, Ben Wan, Tongxuan Liu +5Classifier-Free Guidance Diffusion Model Caching
School of Software, Tsinghua University, Beijing, China · BNRist, Tsinghua University, Beijing, China · JD.com, Beijing, China
In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion
Sep 26, 2026Yikai Wang, Xiao Han, Mengmeng Xu +9Long-Horizon Video Generation Diffusion Model Caching
Meta · S-Lab, Nanyang Technological University
Fixed State, Long Reach: What a Constant-Size Cache Buys Block Diffusion at Scale
Sep 14, 2026Vaibhav Singh, Pierre-André Noël, Torsten Scholak +2Blockwise Diffusion Language Models Diffusion Language Model Inference
Mila · Concordia University · ServiceNow Research
RegionCache: Semantic-Aware Region Reuse for Efficient Multi-Turn Image Generation
Aug 30, 2026Peizheng Li, Xin Ai, Hanyuan Liu +2Diffusion Model Caching Diffusion-Based Image Editing
School of Computer Science and Engineering, Northeastern University, China · School of Computer Science
Beyond Attention Masks: Instruction Anchoring for Efficient In-Context Diffusion Generation
Aug 21, 2026Yangshuai Liu, Zheming Li, Jiaao Li +4Diffusion Transformer Diffusion Model Caching
Harbin Institute of Technology · KlingAI Research
From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion
Aug 13, 2026Xichen Ye, Yifan Wu, Zhikang Xie +3Video Diffusion Models Diffusion-Based Image Generation
College of Computer Science and Artificial Intelligence, Fudan University · Faculty of Engineering, The Chinese University of Hong Kong · School of Data Science, Fudan University
BAG: Budget-Aware Gating for Diffusion Caching
Aug 10, 2026Tong Zhao, Mingkun Lei, Yucheng Han +1Diffusion Transformer Diffusion Model Caching
Zhejiang University · AGI Lab, Westlake University · StepFun
Archer: Adaptive Reuse of Cached Hidden States for Efficient Rollback in Diffusion Language Models
Aug 8, 2026Xuning He, Zinan Sheng, Yongding Tao +4Diffusion Language Model Inference Diffusion Model Caching
School of Computer Science, Shanghai Jiao Tong University · College of Artificial Intelligence, Nankai University · School of Computer Science, Peking University
BRACE: Taming Sharp Irregularities via Barycentric Rational Forecasting for Fast Diffusion Transformers Inference
Aug 4, 2026Jinlong Yang, Jinke Wu, Lizilin +1Diffusion Transformer Diffusion Model Caching
Sichuan University Chengdu, China · School of Artificial Intelligence, Sichuan University Chengdu, China
EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation
Aug 3, 2026Jiayu Chen, Xiaoyu Wu, Rongshan Gao +6Audio-Video Generation Audio-Visual Alignment
Peking University Beijing, China · Taiyuan University of Technology Taiyuan, China
WorldDynCache: Risk-Controlled Latent Dynamics Approximation for Diffusion World Model
Aug 3, 2026Leyang Chen, Junyi Wu, Shaoqiu Zhang +1World Model Learning Latent Dynamics Modeling
Shanghai Jiao Tong University
Disagree to Accelerate: Closing the Loop on Diffusion Feature Forecasts
Aug 3, 2026Yanchao Li, Jiaqing Xie, Ben Gao +6Diffusion Sampling Diffusion Model Caching
1Nanjing University · 2Shanghai Artificial Intelligence Laboratory · 3North University of China +2
OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference
Jul 31, 2026Zhikang Xie, Xichen Ye, Yifan Wu +5Diffusion Model Caching Diffusion Model Inference Acceleration
College of Computer Science and Artificial Intelligence, Fudan University · School of Data Science, Fudan University · 3Shanghai Key Laboratory of Intelligent Information Processing
Faster but Different: Diagnosing and Controlling Content Drift in Accelerated Multimodal Diffusion Language Models
Jul 31, 2026Yaoxuan Dou, Yang ShuMultimodal Large Language Models Diffusion Language Model Inference
School of Mathematics and Statistics, Beijing Institute of Technology Beijing, China
FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference
Jul 30, 2026Hanshuai Cui, Zhiqing Tang, Zhi Yao +3Diffusion-Based Image Generation Diffusion Model Caching
School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China · Institute of Artificial Intelligence and Future Networks, Beijing Normal University, Zhuhai 519087, China
OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Models
Jul 26, 2026Zhaoyuan He, Muhammad Muaz, Lili QiuVideo Diffusion Models Diffusion Transformer
Department of Computer Science, The University of Texas at Austin, Austin, TX, USA
CachedSearch: Training-Free Cached Exploration for Test-Time Search in Video Diffusion
Jul 25, 2026Shreshth Saini, Neil Birkbeck, Yilin Wang +2Video Diffusion Models Video Generation
1The University of Texas at Austin · 2Google, Inc. · University of Colorado Boulder
Evolving Cache Schedules for Fast Diffusion Policy Inference
Jul 22, 2026Siying Wang, Kangye Ji, Di Wang +1Diffusion Policy Diffusion Model Caching
School of Telecommunications Engineering, Xidian University, Xi’an, China · Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · School of Computer Science and Technology, Xidian University, Xi’an, China +1
DiTango: Cost-Effective Parallel Diffusion Generation with Selective Attention State Reuse
Jul 17, 2026Yuyang Chen, Runxin Zhong, Zan Zong +3Diffusion Transformer Efficient Attention
Shanghai Jiao Tong University, Shanghai AI Laboratory Shanghai, China · Tsinghua University Beijing, China · University of Science and Technology Beijing Beijing, China +1
Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques
Jul 14, 2026Daehoon Gwak, Minhyung Lee, Junwoo Park +1Masked Diffusion Models Inference-Time Scaling
KAIST AI · Yonsei University
ACID: Adaptive Caching for vIDeo generation
Jul 14, 2026Om Agrawal, Saurabh Agarwal, Aditya AkellaVideo Diffusion Models Diffusion Model Caching
UT Austin
Training Hybrid Block Diffusion Language Models with Partial Bidirectionality
Jul 2, 2026Pranshu Chaturvedi, Parth Shroff, Tarun Suresh +2Mamba Long-Context Language Model Inference
Stanford University
Set Diffusion: Interpolating Token Orderings Between Autoregression and Diffusion for Fast and Flexible Decoding
Jul 2, 2026Marianne Arriola, Volodymyr KuleshovLanguage Model Decoding Diffusion Language Model Decoding
Department of Computer Science, Cornell University, Ithaca, NY, USA.
OTCache: Optimal Transport for Geometry-Aware Caching in Diffusion Models
Jun 30, 2026Huanlin Gao, Fang Zhao, Qiang Hui +8Diffusion Sampling Diffusion Model Caching
Data Science & Artificial Intelligence Research Institute, China Unicom · Unicom Data Intelligence, China Unicom · National Key Laboratory for Novel Software Technology, Nanjing University
SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation
Jun 29, 2026Juncheng Ma, Yuxuan Du, Yanan Sun +8Diffusion Transformer Audio-Driven Facial Animation
Shenzhen Graduate School, Peking University, China · Shanghai AI Laboratory, China · Tencent Hunyuan, China +1
Affix Cache for Diffusion Large Language Models
Jun 26, 2026Kaihua Liang, An Zhong, Xin Tan +4KV Caching Memory-Efficient Inference
KAUST · CUHK · LUMS
Bifocal Diffusion Language Models: Asymmetric Bidirectional Context for Parallel Generation
Jun 26, 2026Yuhang Chen, Xianfeng Wu, Jinhao Duan +11Diffusion Language Model Inference Parallel Decoding
University of North Carolina at Chapel Hill · Meta AI
NaviCache: Test-Time Self-Calibration Caching for Video Generation
Jun 25, 2026Zheqi Lv, Zhibo Zhu, Jinke Wang +6Video Diffusion Models Diffusion Model Caching
Zhejiang University, Hangzhou, China · Cornell University, New York, USA · Tencent Hunyuan, Shenzhen, China +1
LearniBridge: Learnable Calibration of Feature Caching for Diffusion Models Acceleration
Jun 25, 2026Xuyue Huang, Zhe Chen, Wang Shen +1Video Diffusion Models Diffusion Transformer
Shenzhen Ubiquitous Data Enabling Key Laboratory, Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Central Media Technology Institute, Huawei Technologies Co., Ltd., Shenzhen, China
MoECa: Aligning Feature Reuse with Expert Decomposition in Diffusion Transformers
Jun 14, 2026Maoliang Li, Haojing Chen, Jiayu Chen +4Diffusion Transformer Diffusion Model Caching
School of Computer Science, Peking University, Beijing, China · School of Software Engineering, University of Electronic Science and Technology of China, Chengdu, China
Budget-Constrained Step-Level Diffusion Caching
Jun 11, 2026Mingkun Lei, Tong Zhao, Liangyu Yuan +1Diffusion Model Caching Diffusion Model Inference Acceleration
AGI Lab, Westlake University
TetherCache: Stabilizing Autoregressive Long-Form Video Generation with Gated Recall and Trusted Alignment
Jun 11, 2026Yu Meng, Xiangyang Luo, Letian Li +5Long-Horizon Video Generation Diffusion Model Caching
Tsinghua University · D-INFK, ETH Zürich
FadeMem: Distance-Aware Memory Consolidation for Autoregressive Video Diffusion
Jun 9, 2026Yu Lu, Junjie Yang, Piotr Koniusz +2KV Caching Long-Horizon Video Generation
Zhejiang University · University of New South Wales (UNSW) · Data61/CSIRO +1
Less Is More: Training-Free Acceleration Framework of 3D Diffusion Models for Low-Count PET Denoising via Global-Local Trajectory Reduction
Jun 7, 2026Yuhan Liu, Scott M. Leonard, Marlee Crews +5Diffusion Models for Image Restoration Diffusion Model Caching
Department of Radiology, Northwestern University, Chicago, IL, USA
ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE
Jun 4, 2026Mishan Aliev, Eva Neudachina, Ilya Bykov +4Diffusion Model Caching Diffusion Model Inference Acceleration
1HSE University, Russia · 2Yandex Research, Russia
WaveFilter: Enhancing the Long-Context Capability of Diffusion LLMs via Wavelet-Guided KV Cache Filtering
May 30, 2026Jinnan Yang, Yan Wang, Zhen Bi +5Long-Context Language Model Inference Diffusion Language Model Inference
Nanjing University of Science and Technology · Alibaba Group · Huzhou Normal University +1
VideoMLA: Low-Rank Latent KV Cache for Minute-Scale Autoregressive Video Diffusion
May 28, 2026Hidir Yesiltepe, Jiazhen Hu, Tuna Han Salih Meral +4Video Diffusion Models Self-Attention
1Virginia Tech · 2fal
SoftCap: Soft-Budget Control for Diffusion Transformer Acceleration
May 26, 2026Yuhang Zhang, Junxiang Qiu, Huixia Ben +3Diffusion Transformer Diffusion Model Caching
Hefei University of Technology · University of Science and Technology of China · Anhui University of Science and Technology +1
Enabling KV Caching of Shared Prefix for Diffusion Language Models
May 26, 2026Younghun Go, Jaehoon Han, Changyong Shin +2KV Caching KV-Cache Management
Korea University, South Korea
Trajectory-Consistent Calibration for Cache-Accelerated Diffusion Models
May 24, 2026Mingyu Liang, Dingkun Xu, Jingwei XuDiffusion Transformer Diffusion-Based Image Generation
Laboratory for Novel Software Technology, Nanjing University, China
WorldKV: Efficient World Memory with World Retrieval and Compression
May 21, 2026Jung Yi, Minjae Kim, Paul Hyunbin Cho +3KV Caching Memory-Augmented Video Generation
1KAIST AI · 2Naver AI Lab
Live Music Diffusion Models: Efficient Fine-Tuning and Post-Training of Interactive Diffusion Music Generators
May 21, 2026Zachary Novack, Stephen Brade, Haven Kim +8Diffusion Model Alignment Controllable Music Generation
UC San Diego · MIT · Adobe
Focused Forcing: Content-Aware Per-Frame KV Selection for Efficient Autoregressive Video Diffusion
May 18, 2026Peiliang Cai, Evelyn Zhang, Jiacheng Liu +8Video Diffusion Models Autoregressive Diffusion
1SJTU · 2SDU · 3HUST +4
Prefix-Adaptive Block Diffusion for Efficient Document Recognition
May 16, 2026Mingxu Chai, Ziyu Shen, Chenyu Liu +9Diffusion Language Model Inference Diffusion Model Caching
Computation and Artificial Intelligence Innovative College, Fudan University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China · ByteDance, Shanghai, China
Accelerating Rectified Flow Models via Trajectory-Aware Caching
May 16, 2026Xiao Liu, Kai Liu, Naiyang Guan +5Video Diffusion Models Rectified Flow
Shanghai Jiao Tong University, Shanghai, China · Academy of Military Science, Beijing, China · Huawei Technologies Ltd, Shenzhen, China
Test-time Sparsity for Extreme Fast Action Diffusion
May 13, 2026Kangye Ji, Yuan Meng, Jianbo Zhou +3Diffusion Transformer Inference-Time Optimization
Tsinghua University · The Chinese University of Hong Kong
Muninn: Your Trajectory Diffusion Model But Faster
May 11, 2026Gokul Puthumanaillam, Hao Jiang, Ruben Hernandez +4Trajectory Generation Diffusion-Based Planning
University of Illinois Urbana-Champaign. · Florida International University. · Providence College.
Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models
May 10, 2026Yicheng Ji, Zhizhou Zhong, Jun Zhang +7Diffusion Model Caching KV-Cache Compression
ZJU · Video Rebirth · HKUST +1
SWIFT: Prompt-Adaptive Memory for Efficient Interactive Long Video Generation
May 10, 2026Shanwen Tan, Hao Li, Jingtao Zhang +4Long Video Generation Memory-Augmented Video Generation
University of Science and Technology of China · Fudan University · Georgia Institute of Technology +1
FlashClear: Ultra-Fast Image Content Removal via Efficient Step Distillation and Feature Caching
May 9, 2026Yixin Tang, Jiawei Guo, Junxian Li +6Diffusion Model Distillation Few-Step Diffusion Sampling
Shanghai Jiao Tong University · Nanyang Technological University · Honor Device Co., Ltd
Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generation
May 7, 2026Ernie Chu, Vishal M. PatelVideo Diffusion Models Diffusion Transformer
Johns Hopkins University Baltimore, MD 21218
Motion-Aware Caching for Efficient Autoregressive Video Generation
May 3, 2026Jing Xu, Yuexiao Ma, Xuzhe Zheng +7Video Diffusion Models KV-Cache Management
1Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China · 2ByteDance · 3Max Planck Institute for Intelligent Systems, 4ELLIS Institute Tbingen, 5Tbingen AI Center
DARE: Diffusion Language Model Activation Reuse for Efficient Inference
May 1, 2026Natalia Frumkin, Bokun Wang, Hung-Yueh Chiang +3Self-Attention Diffusion Language Model Inference
Chandra Family Department of Electrical and Computer Engineering The University of Texas at Austin · Cornell University
Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Models
Apr 29, 2026Zhirong Shen, Rui Huang, Jiacheng Liu +6Diffusion Transformer Diffusion Model Caching
Shanghai Jiao Tong University · University of Electronic Science and Technology of China · Shandong University +2

Oct 6, 2026, cs.CVJ/K move · Enter open · S save

CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching

Shangye Song, Dong Gong, Hong Jia, Yun Sing Koh+1

University of Auckland · UNSW Sydney

Action-Conditioned Video Generation Real-Time Interactive Video Generation Efficient Inference for World Action Models Diffusion Model Caching

Open paper AskPDF arXiv

Interactive video world models need to generate each video chunk efficiently while responding faithfully to user controls. Many systems use chunk-wise autoregressive generation with few-step denoising, but each chunk still requires several costly denoising iterations. Training-free caching can reduce this cost, yet existing policies make reuse decisions primarily from model-internal denoising dynamics and do not explicitly account for control transitions. Actually, interactive generation explicitly exposes a signal they do not use: the controls for a chunk arrive before it is denoised, so a schedule derived from them costs no forward pass. To this end, we analyze adjacent chunks under different control regimes and find that structural similarity drops around action changes, while low-frequency structure remains more persistent than high-frequency detail. Motivated by these observations, we propose CtrlCache, a training-free control-aware caching framework that adapts computation to the current control sequence. Specifically, the action-aware scheduling and refresh policy detects action changes across and within chunks, and labels each chunk as initial, transition, turning, or steady state. At one selected interior denoising step, initial and transition chunks retain full computation, while turning and steady chunks reuse the transformer residual from the most recent fully computed step in the same chunk. To exploit the persistence of low-frequency structure during steady interaction, we further introduce a frequency-mixed history prior guidance that incorporates complementary information from the preceding clean latent without an additional DiT forward pass. Evaluated on Matrix-Game 2.0 and LingBot-World v1/v2, CtrlCache achieves 1.21x to 1.41x DiT-backbone speedups without model retraining while improving WBench Overall scores over original inference across all three models.

Momentum

Related topics

Latest papers 69