Diffusion Model Inference Acceleration

Overview

Diffusion models repeatedly denoise a sample, so inference acceleration studies how to reduce the cost of those steps for image, video, language, and action generation. Methods reduce the number of evaluations with faster solvers, timestep schedules, and few-step distillation, or reduce work within each step using caching, sparse attention, token pruning, compression, and lower-precision computation. Systems work also targets memory movement, GPU parallelism, and serving, while adaptive methods allocate computation according to uncertainty, content, or task difficulty. The central challenge is preserving fidelity, diversity, and task accuracy as skipped or approximated computations can accumulate errors; gains therefore depend on the model, workload, hardware, and end-to-end evaluation.

Latest papers

CardsList

509 papers73 papers in the last four weeks, up 66% on the four weeks before. 0.4% of all new papers.

  1. LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Models

    Mar 13, 2026Chenglin Wang, Yucheng Zhou, Shawn Chen +2T2I GenerationDiffusion Language Model Inference

  2. DAPD: Dependency-Aware Parallel Decoding via Attention for Diffusion LLMs

    Mar 13, 2026Bumjun Kim, Dongjae Jeon, Moongyu Jeon +1Parallel Decoding for Diffusion Language ModelsParallel Decoding

  3. Draft-and-Target Sampling for Video Generation Policy

    Mar 13, 2026Qikang Zhang, Yingjie Lei, Wei Liu +1Diffusion Model Inference AccelerationDiffusion Model Sampling

  4. AccelAes: Accelerating Diffusion Transformers for Training-Free Aesthetic-Enhanced Image Generation

    Mar 13, 2026Xuanhua Yin, Chuanzhi Xu, Haoxian Zhou +2Diffusion TransformerImage Generation

  5. One Model, Many Budgets: Elastic Latent Interfaces for Diffusion Transformers

    Mar 12, 2026Moayed Haji-Ali, Willi Menapace, Ivan Skorokhodov +6Adaptive Computation for Diffusion ModelsDiffusion Transformer

  6. SoulX-LiveAct: Towards Hour-Scale Real-Time Human Animation with Neighbor Forcing and ConvKV Memory

    Mar 12, 2026Dingcheng Zhen, Xu Zheng, Ruixin Zhang +4Autoregressive DiffusionReal-Time Interactive Video Generation

  7. DyWeight: Dynamic Gradient Weighting for Few-Step Diffusion Sampling

    Mar 12, 2026Tong Zhao, Mingkun Lei, Liangyu Yuan +5Diffusion SamplingFew-Step Diffusion Sampling

  8. Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers

    Mar 11, 2026Wenhao Sun, Ji Li, Zhaoqiang LiuDiffusion Model Inference AccelerationDiffusion Models

  9. Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusion

    Mar 11, 2026Jakub Gregorek, Paraskevas Pegios, Nando Metzger +3Depth CompletionDiffusion Models

  10. ES-dLLM: Efficient Inference for Diffusion Large Language Models by Early-Skipping

    Mar 10, 2026Zijian Zhu, Fei Ren, Zhanhong Tan +1Diffusion Language Model InferenceDiffusion Language Models

  11. HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoising

    Mar 9, 2026Kai Zou, Dian Zheng, Hongbo Liu +3Autoregressive Video GenerationLong-Horizon Video Generation

  12. WaDi: Weight Direction-aware Distillation for One-step Image Synthesis

    Mar 9, 2026Lei Wang, Yang Cheng, Senmao Li +3Diffusion Model DistillationOne-Step Generative Modeling

  13. SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving

    Mar 9, 2026Ayush Barik, Sofia Stoica, Nikhil Sarda +4Text-to-Audio GenerationDiffusion Model Inference Acceleration

  14. MWM: Mobile World Models for Action-Conditioned Consistent Prediction

    Mar 8, 2026Han Yan, Zishang Xiang, Zeyu Zhang +1World Models for RoboticsAction-Conditioned World Models

  15. Accelerating Diffusion Models for Generative AI Applications with Silicon Photonics

    Mar 8, 2026Tharini Suresh, Salma Afifi, Sudeep PasrichaDiffusion Model Inference AccelerationDiffusion Models

  16. DC-DiT: Adaptive Compute and Elastic Inference for Visual Generation via Dynamic Chunking

    Mar 6, 2026Akash Haridas, Utkarsh Saxena, Parsa Ashrafi Fashi +3Adaptive TokenizationDiffusion Transformer

  17. WorldCache: Accelerating World Models for Free via Heterogeneous Token Caching

    Mar 6, 2026Weilun Feng, Guoxin Fan, Haotong Qin +10Diffusion Model Inference AccelerationDiffusion Model Caching

  18. Cross-Resolution Distribution Matching for Diffusion Distillation

    Mar 6, 2026Feiyang Chen, Hongpeng Pan, Haonan Xu +3Video Diffusion ModelsDiffusion Model Distillation

  19. TempoSyncDiff: Distilled Temporally-Consistent Diffusion for Low-Latency Audio-Driven Talking Head Generation

    Mar 6, 2026Soumya Mazumdar, Vineet Kumar RakeshTalking Head GenerationTemporal Consistency in Video Generation

  20. Accelerating Text-to-Video Generation with Calibrated Sparse Attention

    Mar 5, 2026Shai Yehezkel, Shahar Yadin, Noam Elata +2Diffusion Model Inference AccelerationT2V Generation

  21. Diff-ES: Stage-wise Structural Diffusion Pruning via Evolutionary Search

    Mar 5, 2026Zongfang Liu, Shengkun Tang, Zongliang Wu +2Diffusion Model PruningDiffusion Model Inference Acceleration

  22. Progressive Refinement Regulation for Accelerating Diffusion Language Model Decoding

    Mar 4, 2026Lipeng Wan, Jianhui Gu, Junjie Ma +4Diffusion Language Model DecodingDiffusion Language Models

  23. Helios: Real Real-Time Long Video Generation Model

    Mar 4, 2026Shenghai Yuan, Yuanyang Yin, Zongjian Li +3Efficient Video GenerationLong-Horizon Video Generation

  24. FastWave: Optimized Diffusion Model for Audio Super-Resolution

    Mar 4, 2026Nikita Kuznetsov, Maksim KaledinAudio Diffusion ModelsDiffusion Model Acceleration

  25. Beyond Masks: Efficient, Flexible Diffusion Language Models via Deletion-Insertion Processes

    Mar 4, 2026Fangyu Ding, Ding Ding, Sijin Chen +8Diffusion Language ModelsLanguage Modeling