Diffusion Model Inference Acceleration

Follow this topic Ask about this topic

Momentum

40 papers in the last four weeks, up 100% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 335

All topics

Looped Diffusion Language Models
May 25, 2026Sanghyun Lee, Chunsan Hong, Seungryong Kim +3Masked Diffusion Models Diffusion Language Model Inference
1KAIST · 2KRAFTON · University of California, Berkeley
Triplet-Block Diffusion RWKV
May 25, 2026Ke Lin, Yiyang Luo, Zhaolong Su +2Diffusion Language Model Inference Recurrent Transformers
William & Mary · HKUST · Cornell
PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution
May 25, 2026Wenxue Li, Jingjing Ren, Peng Zhang +4Video Diffusion Models Few-Step Diffusion Sampling
The Hong Kong University of Science and Technology (Guangzhou) · MiLM Plus, Xiaomi Inc · The Hong Kong University of Science and Technology
Three-Step Conditional Diffusion 3D Reconstruction for Light-Field Microscopy
May 24, 2026Qihong Zhao, Shaokang Yan, Zhimin Qiao +23D Reconstruction Few-Step Diffusion Sampling
1Yanshan University · 2Peking University
Dynamic Neural Koopman Distillation for Fast Robot Control Using Diffusion Models
May 24, 2026Lei Zheng, Peiqi Yu, Zengqi Peng +2Robotic Control Koopman Operator Learning
Department of Electrical and Computer Engineering, National University of Singapore, Singapore · Department of Electrical and Computer Engineering, Carnegie Mellon University, USA · Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology, Hong Kong SAR, China
Trajectory-Consistent Calibration for Cache-Accelerated Diffusion Models
May 24, 2026Mingyu Liang, Dingkun Xu, Jingwei XuDiffusion Transformer Diffusion-Based Image Generation
Laboratory for Novel Software Technology, Nanjing University, China
PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion
May 22, 2026Yifan Lu, Qi Wu, Jay Zhangjie Wu +4Latent Diffusion Models Pixel-Space Diffusion Models
NVIDIA
DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
May 22, 2026Jean-Marie Lemercier, Tomas Geffner, Karsten Kreis +3Masked Diffusion Models Diffusion Language Model Inference
NVIDIA
Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention
May 22, 2026Bingtian Qiao, Yue Shi, Yingjie Zhou +3Diffusion Models for Image Restoration Diffusion Model Inference Acceleration
Shanghai Jiao Tong University · Fuzhou University · Shanghai AI Laboratory
DFSAttn: Dynamic Fine-grained Sparse Attention for Efficient Video Generation
May 22, 2026Jie Hu, Zixiang Gao, Yutong He +1Video Diffusion Models Diffusion Transformer
1Peking University.
VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation
May 22, 2026Junwen Tan, Jinglin Liang, Hongyuan Chen +1Rectified Flow Image Generation
South China University of Technology
ORBIS: Output-Guided Token Reduction with Distribution-Aware Matching for Video Diffusion Acceleration
May 21, 2026Hangyeol Lee, Joo-Young KimToken Merging Video Diffusion Models
KAIST · Daejeon, South Korea
Rethinking Token Reduction for Diffusion Models via Output-Similarity-Awareness
May 21, 2026Hangyeol Lee, Hyojeong Lee, Joo-Young KimDiffusion Transformer Diffusion-Based Image Generation
KAIST, Daejeon, Republic of Korea
Dynamic Video Generation: Shaping Video Generation Across Time and Space
May 20, 2026Shikang Zheng, Jingkai Huang, Jiacheng Liu +5Video Diffusion Models Diffusion Model Inference Acceleration
Shanghai Jiao Tong University · South China University of Technology · Tsinghua University
PulseCol: Periodically Refreshed Column-Sparse Attention for Accelerating Diffusion Language Models
May 20, 2026Yanyi Lyu, Letian Chen, Futing Sun +3Self-Attention Diffusion Language Model Inference
Harbin Institute of Technology (Shenzhen)
RoPeSLR: 3D RoPE-driven Sparse-LowRank Attention for Efficient Diffusion Transformers
May 20, 2026Yuxi Liu, Zekun Zhang, Yixiang Cai +3Rotary Positional Embeddings Low-Rank Attention
Peking University · University of Electronic Science and Technology of China · Beijing University of Posts and Telecommunications
Accelerating Video Inverse Problem Solvers with Autoregressive Diffusion Models
May 20, 2026Taesung Kwon, Jonghyun Park, Hyungjin Chung +1Video Diffusion Models Video Restoration
KAIST · EverEx
TIDE: Efficient and Lossless MoE Diffusion LLM Inference with I/O-aware Expert Offload
May 19, 2026Zhiben Chen, Youpeng Zhao, Yang Sui +2Expert Offloading LLM Inference Scheduling
University of Central Florida · Rice University
Efficient Long-Context Modeling in Diffusion Language Models via Block Approximate Sparse Attention
May 19, 2026Wenhu Zhang, Yiming Wu, Huanyu Wang +6Self-Attention Long-Context Language Modeling
The Hong Kong University of Science and Technology · The University of Hong Kong · Zhejiang University +1
Spectral Progressive Diffusion for Efficient Image and Video Generation
May 18, 2026Howard Xiao, Brian Chao, Lior Yariv +1Video Diffusion Models Diffusion Sampling
Stanford University
Dual-Rate Diffusion: Accelerating diffusion models with an interleaved heavy-light network
May 18, 2026Grigory Bartosh, David Ruhe, Emiel Hoogeboom +3Diffusion Sampling Diffusion-Based Image Generation
*Work done while interning at Google DeepMind Amsterdam, 1University of Amsterdam, 2Google DeepMind Amsterdam · 2Google DeepMind Amsterdam
Elastic-dLLM: Position Preserving Context Compression and Augmentation of Diffusion LLMs
May 18, 2026Junyi Wu, Tianchen Zhao, Shaoqiu Zhang +3Masked Diffusion Models Long-Context Language Modeling
Tsinghua University · Shanghai Jiao Tong University · Infinigence AI
DCFold: Efficient Protein Structure Generation with Single Forward Pass
May 18, 2026Zhe Zhang, Yuanning Feng, Yuxuan Song +3Protein Structure Prediction AI-Assisted Scientific Research
Institute for AI Industry Research (AIR), Tsinghua University · Department of Computer Science and Technology, Tsinghua University · School of Computer Science and Technology, Huazhong University of Science and Technology +1
Temporal Aware Pruning for Efficient Diffusion-based Video Generation
May 18, 2026Sheng Li, Yang Sui, Junhao Ran +3Video Diffusion Models Token Pruning
University of Pittsburgh · Rice University · Rutgers University +1
Accelerating Redshift-Conditioned Galaxy Image Synthesis with One-step Generative Modeling
May 17, 2026Tianyue Yang, Sandro Tacchella, Xiao XueConditional Image Generation One-Step Generative Modeling
The Center for Computational Science University College London · Cavendish Laboratory Kavli Institute for Cosmology University of Cambridge
HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editing
May 17, 2026Yuyao Zhang, Alexander Huang-Menders, Yu-Wing TaiDiffusion Transformer Diffusion-Based Image Editing
Dartmouth College
Roll Out and Roll Back: Diffusion LLMs are Their Own Efficiency Teachers
May 16, 2026Fanqin Zeng, Feng Hong, Geng Yu +6Diffusion Model Distillation Diffusion Language Model Decoding
Shanghai Jiao Tong University, Shanghai, China · Apple MLR, Cupertino, CA, USA · Tongji University, Shanghai, China +2
Prefix-Adaptive Block Diffusion for Efficient Document Recognition
May 16, 2026Mingxu Chai, Ziyu Shen, Chenyu Liu +9Diffusion Language Model Inference Diffusion Model Caching
Computation and Artificial Intelligence Innovative College, Fudan University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China · ByteDance, Shanghai, China
Accelerating Rectified Flow Models via Trajectory-Aware Caching
May 16, 2026Xiao Liu, Kai Liu, Naiyang Guan +5Video Diffusion Models Rectified Flow
Shanghai Jiao Tong University, Shanghai, China · Academy of Military Science, Beijing, China · Huawei Technologies Ltd, Shenzhen, China
CAB: Accelerating Flow and Diffusion Sampling via Rectification and Corrected Adams-Bashforth
May 16, 2026Anuska Roy, Pravin NairFew-Step Diffusion Sampling Generative Flow Networks
Department of Electrical Engineering Indian Institute of Technology Madras, Chennai, India

May 25, 2026, cs.LGJ/K move · Enter open · S save

Looped Diffusion Language Models

Sanghyun Lee, Chunsan Hong, Seungryong Kim, Jonghyun Lee+2

1KAIST · 2KRAFTON · University of California, Berkeley

Masked Diffusion Models Diffusion Language Model Inference Diffusion Language Models Diffusion Model Inference Acceleration

Open paper AskPDF arXiv

Masked diffusion models (MDMs) have emerged as a promising alternative to autoregressive models for language modeling, yet the effective design of transformer architectures for MDMs remains underexplored. In this paper, we show that selectively looping the early-middle transformer layers significantly improves both training efficiency and model performance in MDMs. We call this approach LoopMDM(Looped Masked Diffusion Model), which brings two key benefits: looping layers at training-time yields a depth-scaling effect without adding parameters, while varying the number of loops at inference-time enables flexible compute scaling. Despite the simplicity, the results are striking: across multiple pre-training corpora, LoopMDM matches the performance of same-size MDMs with up to 3.3 fewer training FLOPs, while its final performance outperforms them on various reasoning benchmarks, including up to 8.5 points on GSM8K. It even surpasses deeper non-looped MDMs trained with comparable per-step compute, indicating that selective looping is more effective than naive depth scaling. Furthermore, LoopMDM can scale inference-time compute by increasing the number of loops. Adaptively adjusting the number of loops throughout the sampling process further yields additional gains in compute efficiency while maintaining performance. Lastly, with attention analysis, we provide evidence that looping is effective in MDMs by promoting interactions among masked positions. Our code and weights will be publicly released.

Momentum

Related topics

Latest papers 335