Diffusion Model Inference Acceleration

Overview

Diffusion models repeatedly denoise a sample, so inference acceleration studies how to reduce the cost of those steps for image, video, language, and action generation. Methods reduce the number of evaluations with faster solvers, timestep schedules, and few-step distillation, or reduce work within each step using caching, sparse attention, token pruning, compression, and lower-precision computation. Systems work also targets memory movement, GPU parallelism, and serving, while adaptive methods allocate computation according to uncertainty, content, or task difficulty. The central challenge is preserving fidelity, diversity, and task accuracy as skipped or approximated computations can accumulate errors; gains therefore depend on the model, workload, hardware, and end-to-end evaluation.

Latest papers

CardsList

509 papers73 papers in the last four weeks, up 66% on the four weeks before. 0.4% of all new papers.

  1. KV Cache Quantization for Diffusion Language Models

    Oct 29, 2026Yan Tai, Yunan Ding, Guangzhao Li +5KV-Cache QuantizationDiffusion Language Model Inference

  2. AB-Attention: Accurate Block Attention for Accelerating Video Diffusion Transformers

    Oct 29, 2026Bin Xu, Mo Zhang, Zhengfeiyang Zhang +6Diffusion Model Inference AccelerationBlock-Sparse Attention

  3. Triage: Skip, Skim, or Refine Attention Tiles in Video Diffusion Transformers

    Oct 26, 2026Yeonjae Kim, Omin Kwon, Seong Hoon Seo +1Diffusion Model Inference AccelerationVideo Diffusion Models

  4. ToDoPro: Faster and Better Reference-Based Generation: Early Token Reduction via Downsampled Self-Probing

    Oct 26, 2026Caiyi Sun, Yujing Sun, Siu-Ming YiuImage GenerationDiffusion Model Inference Acceleration

  5. What Makes a Good Unmasking Policy? A Controlled Study of Learned Unmasking in Diffusion Language Models

    Oct 22, 2026Jinya Sakurai, Xun Xu, Jaehong YoonDiffusion Language Model DecodingDiffusion Language Models

  6. CAVC: Convergence-Adaptive Audio-Visual Cache for Modality-Asymmetric Diffusion Generation

    Oct 22, 2026Lifan Jiang, Yibo Zhao, Senlin cheng +6Audio-Video GenerationDiffusion Model Caching

  7. ParaLin++: Accelerating Parallel Diffusion Integrator via Intrinsic Partially Linear Structure

    Oct 22, 2026Jianrong Lu, Zhiyu Zhu, Hui Liu +1Diffusion SamplingDiffusion Model Inference Acceleration

  8. PRIMFLOW: Learning Trajectory Primitives for Few-Step Distillation

    Oct 19, 2026Hongyi Fang, Benjia ZhouDiffusion Model DistillationFew-Step Diffusion Sampling

  9. SpecKCast: Spectral Kalman Forecasting for Diffusion Acceleration

    Oct 19, 2026Javad Rajabi, Hakki Can Karaimer, David B. Lindell +2Diffusion Model Inference AccelerationDiffusion Transformer

  10. RECAP: Reciprocal Sparse Attention and Hierarchical Caching for Efficient Video Diffusion

    Oct 19, 2026Tiange Xu, Kai Liu, Linghe Kong +1Video Diffusion ModelsDiffusion Model Inference Acceleration

  11. TriTD: Tri-Partite Trajectory-Distribution Distillation for Real-Time Autoregressive Video Generation

    Oct 19, 2026Jia Li, Xurui Peng, Haowei Zhu +7Autoregressive Video GenerationReal-Time Interactive Video Generation

  12. TamedFlow: Trajectory-Aware Distillation for Teacher-Assisted Diffusion Sampling

    Oct 19, 2026Shuaiqi Cheng, Jiahao Zhang, Boyuan Gu +5Diffusion SamplingDiffusion Model Inference Acceleration

  13. PoSTCache: From Forecasting to Postdictive Smoothing for Revisable Diffusion Caching

    Oct 19, 2026Liwei Lan, Hui Chen, Jungong Han +1Diffusion Model CachingDiffusion Model Inference Acceleration

  14. Blitz: Accelerating the Diffusion Modules of AlphaFold3 and Boltz-2

    Oct 16, 2026Vinay Saji Mathew, Soundar Kumara, Gretta Kellogg +1Protein Structure PredictionDiffusion Model Inference Acceleration

  15. DIFFLET: A Fast Inference Engine for Diffusion Transformer Models on AWS Trainium

    Oct 16, 2026Bin Ma, Min Yu, Vijay Kodamalla +3Diffusion Model Inference AccelerationDiffusion Model Serving

  16. Sink-Sparse Hybrid Attention for Efficient Inference in T2I/T2V Diffusion Transformers

    Oct 16, 2026Bingxin Xing, Yu Zhang, Jiatong Ding +2Diffusion Model Inference AccelerationSparse Attention

  17. SoftCache: Adaptive Step Size Caching for Diffusion Transformers

    Oct 15, 2026Shimon Malnick, Nadav Orenstein, Ohad Fried +1Diffusion Model CachingDiffusion Model Inference Acceleration

  18. UltraDiff: Transferring High-Fidelity Priors to Compressed Latent Spaces for High-Resolution Image Generation

    Oct 15, 2026Jingjing Ren, Haitian Zheng, Haoyu Chen +5Latent Diffusion ModelsDiffusion Model Distillation

  19. LinMorph: Learning to Morph Weights for Efficient Video DiT Linearization

    Oct 13, 2026Lingyi Long, Congyue Zhao, Xiaoou Li +2Diffusion Model Inference AccelerationVideo Diffusion Models

  20. AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers

    Oct 12, 2026Javad Rajabi, Koorosh Roohi, David B. Lindell +1Diffusion TransformerDiffusion-Based Image Generation

  21. MARS: Systematic Multi-Level Acceleration for World Action Models

    Oct 12, 2026Zengyuan Zuo, Yongchang Zhang, Guangyu Zhao +4Efficient Inference for World Action ModelsWorld Action Models