Diffusion Model Quantization

Overview

Diffusion model quantization studies how to use fewer bits for model weights, activations, and attention caches while keeping iterative generation close to full precision, enabling larger models to run with less memory and time. Common approaches include post-training quantization and quantization-aware training, with rotations, smoothing, outlier handling, low-rank compensation, and mixed precision used to control errors. Methods increasingly account for changing sensitivity across denoising steps, classifier-free guidance, and temporal consistency, while sampling-side corrections and fused low-bit kernels address error propagation and real deployment speed. W4A4 and even lower-bit settings can retain useful quality on image and video benchmarks such as COCO and VBench, but results remain model- and hardware-dependent: aggressive compression can harm fidelity, and speedups require kernels that use a device’s native low-precision operations.

Latest papers

CardsList

40 papers1 paper in the last four weeks, down 86% on the four weeks before. 0.0% of all new papers.

  1. The Hidden Cost of MoE Diffusion Decoding: Profiling and Fixing the Sampler

    Nov 16, 2026Harshit Samrat, Ramakrishna Paramahamsa KompellaDiffusion Language Model InferenceDiffusion Language Model Decoding

  2. TriTile: Three-Tier Attention for Video Diffusion Transformers

    Oct 26, 2026Yeonjae Kim, Omin Kwon, Seong Hoon Seo +1Diffusion Model Inference AccelerationVideo Diffusion Models

  3. Deflating the Hessian: Rank-4 W4A4 Quantization for Multimodal Diffusion Transformers

    Oct 8, 2026Shiwen Wang, Pengxiang Zhao, Xiaoming YuanDiffusion Model QuantizationPost-Training Quantization

  4. SoloQ: Calibration-Free Quantization for Diffusion Language Models

    Oct 5, 2026Donghyun Lee, Arkapravo Ghosh, Varun Manjunath +5Diffusion Model QuantizationKV-Cache Quantization

  5. Joint Branch-Space Transform Coding for Diffusion Activation Quantization with Classifier-Free Guidance

    Oct 1, 2026Mingrun Jiang, Yuejia Liu, Zishan Shao +11Classifier-Free GuidanceDiffusion Model Quantization

  6. JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization

    Sep 27, 2026Kaicheng Yang, Kaisen Yang, Chunyu Liu +8Neural Network QuantizationDiffusion Model Quantization

  7. Chameleon: Dynamic Format Adapter for Efficient Diffusion

    Sep 27, 2026Arnab Sanyal, Sandeep ChinchaliDiffusion Model QuantizationPost-Training Quantization

  8. PulseQuant: Propagation-Guided Subspace Correction for 4-Bit Video Diffusion Transformers

    Sep 27, 2026Yutong Wang, Xingtong Ge, Enhuai Liu +4Video Diffusion ModelsDiffusion Transformer

  9. Quantization-Aware Kalman Estimation for Diffusion Sampling

    Sep 18, 2026Qitan Shi, Cheng Jin, Jiawei Zhang +1Diffusion Model QuantizationDiffusion Sampling

  10. Post-training Quantization for Hybrid Iterative Generative Models

    Aug 14, 2026Jing Gao, Junyi Wu, Wei Wang +2Post-Training QuantizationNeural Network Quantization

  11. TTS-Q: Speaker-Aware Post-Training Quantization of Text-to-Speech Diffusion Transformers

    Aug 11, 2026Xiaoqin Feng, Yuqi Li, Weilun Feng +9Diffusion Model QuantizationPost-Training Quantization

  12. TASQ: Temporal-Adaptive Bit Sparsification Quantization for Diffusion Models

    Aug 4, 2026Seokho Han, Dongwei Wang, Jinhee Kim +4Weight-Only QuantizationMixed-Precision Quantization

  13. KroQuant: Kronecker-Structured Block Transforms for Efficient Post-Training Quantization of Diffusion Transformers

    Jul 23, 2026Yann Bouquet, Alireza Khodamoradi, Kristof Denolf +1Diffusion TransformerDiffusion Model Quantization

  14. Closing the Null Space: Guidance-Aware Quantization for Classifier-Free Diffusion

    Jul 9, 2026Abdullah Al Shafi, Sumaiya Rahim SumaMixed-Precision QuantizationClassifier-Free Guidance

  15. OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers

    Jul 2, 2026Donghyun Lee, Jitesh Chavan, Duy Nguyen +5Video Diffusion ModelsDiffusion Transformer

  16. FAIR-Calib: Frontier-Aware Instability-Reweighted Calibration for Post-Training Quantization of Diffusion Large Language Models

    Jun 4, 2026Haoyu Huang, Linlin Yang, Sheng Xu +5LLM QuantizationDiffusion Model Quantization

  17. STaR-Quant: State-Time Consistent Post-Training Quantization for Diffusion Large Language Models

    Jun 3, 2026Xin Yan, Aqiang Wang, Zhenglin Wan +2LLM QuantizationDiffusion Model Quantization

  18. Timestep-Aware SVDQuant-GPTQ for W4A4 Quantization of Wan2.2-I2V

    May 26, 2026Junhao Wu, Dezhong Yao, Hai JinVideo Diffusion ModelsDiffusion Transformer

  19. Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion

    May 25, 2026Tuna Tuncer, Felix Becker, Thomas PfeilVideo Diffusion ModelsSelf-Attention

  20. Q-ARVD: Quantizing Autoregressive Video Diffusion Models

    May 20, 2026Siao Tang, Xinyin Ma, Gongfan Fang +2Video Diffusion ModelsDiffusion Model Quantization