Diffusion Model Inference Acceleration

Follow this topic Ask about this topic

Momentum

40 papers in the last four weeks, up 100% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 335

All topics

Urgent Actions Go First: Urgency-Aware Denoising for Real-Time VLA Control
Sep 29, 2026Zibo Wang, Haochen Han, Pengzhen Ren +2Robotic Control Efficient VLA Model Inference
Pengcheng Laboratory
Parameterized Stripe Attention for Efficient Video Generation
Sep 29, 2026Xingyu Jia, Baole Ai, Ang Wang +2Video Diffusion Models Diffusion Transformer
Alibaba Group
FastVR: Efficient Streaming Video Restoration with One-Step Diffusion
Sep 29, 2026Xiaoxu Chen, Qin Yang, Haoran Bai +2Diffusion Transformer Video Restoration
Alibaba Group · Xidian University
RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidance
Sep 29, 2026Yiming Liu, Ben Wan, Tongxuan Liu +5Classifier-Free Guidance Diffusion Model Caching
School of Software, Tsinghua University, Beijing, China · BNRist, Tsinghua University, Beijing, China · JD.com, Beijing, China
Sol-H3: Recursive Self-Improvement for MiniMax-H3 Inference Acceleration on Sol-Engine across Cloud and Edge
Sep 28, 2026Yitong Li, Jincheng Yu, Junsong Chen +6Video Diffusion Models GPU Kernel Optimization
NVIDIA Research, Efficient AI Team & Singapore Lab.
Unlocking Few-Step Diffusion for Faithful Previews
Sep 28, 2026Jing Jia, Sifan Liu, Guanyang WangDiffusion Sampling Few-Step Diffusion Sampling
Department of Computer Science, Rutgers University · Department of Statistical Science, Duke University · Department of Statistics, Rutgers University
CAST: Reconstruction-Coupled Acceleration of Interactive World Models
Sep 28, 2026Leyang Chen, Junyi Wu, Fanqing Kong +2Real-Time Interactive Video Generation Inference Acceleration
Shanghai Jiao Tong University
Faster Block-Diffusion Serving with Distribution-Free Risk Guarantees
Sep 27, 2026Jungseob Lee, Dongyub Jude Lee, Chanjun Park +2Diffusion Language Model Inference LLM Inference Acceleration
Korea University · Zoom Communications · Soongsil University +1
AnyStep-WAM: Budget-Aligned Distillation and Adaptive Inference for World Action Models
Sep 27, 2026Rui Wang, Xiangyu Wang, Donglin Yang +4Adaptive Inference Diffusion Model Distillation
Southern University of Science and Technology · Shenzhen Loop Area Institute · The University of Hong Kong
GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code
Sep 27, 2026Haosen Li, Wenshuo Chen, Shaofeng Liang +3Video Diffusion Models Diffusion Transformer
The Hong Kong University of Science and Technology (Guangzhou) · Griffith University · Data61, CSIRO +1
Tsubame: Tree Replay for Diffusion-Based Speculative Decoding
Sep 27, 2026Yepeng Weng, Qiao Hu, Takehisa YairiSpeculative Decoding for Diffusion Language Models Speculative Decoding
The University of Tokyo · National Center for Mathematics and Interdisciplinary Sciences (NCMIS), AMSS, CAS
OOD Generalization as a Bifurcation Problem
Sep 27, 2026Nguyen-Thanh-Luong Doan, Quang-Vu Nguyen, Tang-Phu-Quy Le +1Diffusion Model Guidance OOD Generalization
The University of Danang - Vietnam-Korea University of Information and Communication Technology
Chameleon: Dynamic Format Adapter for Efficient Diffusion
Sep 27, 2026Arnab Sanyal, Sandeep ChinchaliDiffusion Model Quantization Post-Training Quantization
UT SWARM Lab, Department of Electrical & Computer Engineering The University of Texas, Austin TX 78712
From Position Risks to Block Survival: Faster Generation for Diffusion Language Models
Sep 27, 2026Siwei Chen, Yuxiang Wan, Yifan Yu +1Speculative Decoding for Diffusion Language Models Diffusion Language Model Decoding
University of Illinois Urbana-Champaign
FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generation
Sep 27, 2026Yiyi Cai, Yuhan Wu, Kunhang Li +6Motion Diffusion Models Human Motion Generation
Alaya Lab · The University of Tokyo · Japan Advanced Institute of Science and Technology +1
In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion
Sep 26, 2026Yikai Wang, Xiao Han, Mengmeng Xu +9Long-Horizon Video Generation Diffusion Model Caching
Meta · S-Lab, Nanyang Technological University
Accelerating Video Diffusion via Training-Free Trajectory Routing
Sep 24, 2026Mustafa Munir, Huy Vu, Shreyas Misra +7Video Diffusion Models Diffusion Model Inference Acceleration
ComplexSync: High-Fidelity and Real-Time Lip Sync in Complex Scenarios
Sep 24, 2026Jiaran Cai, Xingpei Ma, Shenneng HuangVideo Diffusion Models Audio-Visual Synchronization
Guangzhou Quwan Network Technology
Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs
Sep 22, 2026Quan Nguyen-Tri, Mukul Ranjan, Zhiqiang ShenSpeculative Decoding Diffusion Language Model Inference
VILA Lab, MBZUAI Abu Dhabi, UAE
Diffusion Drafts, AR Verifies: Accelerating Document OCR with Self-Speculative Decoding
Sep 22, 2026Dohyun Kim, Sungjun Han, Hyungguk Kim +4Autoregressive Diffusion Speculative Decoding
Trillion Labs · Korea University · Seoul National University
Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation
Sep 17, 2026Haocheng Xi, Yiming Xie, Hexu Zhao +8Video Diffusion Models Streaming Video Generation
University of California, Berkeley · Impossible, Inc. · University of Texas at Austin
Zarya: A Hybrid Autoregressive--Masked Diffusion Language Model with Flexible Training and Dual-Mode Inference
Sep 17, 2026Leonid Sinev, Ilya Koziev, Vladislav LeshchukMasked Diffusion Models Autoregressive Diffusion
vidax: A Unified JAX Framework for Video Generative Models on Accelerator Meshes
Sep 16, 2026Congyue DengVideo Diffusion Models Tensor Parallelism
Massachusetts Institute of Technology
Efficient 3D Whole-Body PET Image Denoising via Conditional Rectified Flow With Optimized Sampling Strategy
Sep 15, 2026Jiale Shen, Guolin Wang, Chenhao Wang +3Rectified Flow 3D Medical Imaging
College of Biomedical Engineering & Instrument Science, Zhejiang University, Zhejiang, 310063, China
Efficient Text-to-Image Generation: An Adaptive Step Schedule Controller for Diffusion Models
Sep 15, 2026Kuluhan Binici, Cihan Acar, Shivam Aggarwal +2Diffusion Model Sampling Diffusion Timestep Scheduling
1SAP · 2National University of Singapore · Institute for Infocomm Research (I2R), A*STAR, Singapore
VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention
Sep 14, 2026Xingyang Li, Dongyun Zou, Shining Zhang +8Video Diffusion Models Diffusion Transformer
2MIT · 1Nunchux AI · 3CMU +3
Fixed State, Long Reach: What a Constant-Size Cache Buys Block Diffusion at Scale
Sep 14, 2026Vaibhav Singh, Pierre-André Noël, Torsten Scholak +2Blockwise Diffusion Language Models Diffusion Language Model Inference
Mila · Concordia University · ServiceNow Research
Diffusion Language Models for Mobile Edge Agentic AI: Foundations, Applications, and Challenges
Sep 7, 2026Chenqi Li, Minghui Min, Dusit Niyato +1On-Device Language Model Inference Diffusion Language Model Inference
School of Information and Control Engineering, China University of Mining and Technology, Xuzhou, 221116, Jiangsu, China · College of Computing and Data Science, Nanyang Technological University, Singapore, 639798, Singapore · School of Engineering, Edith Cowan University, Perth, Western Australia, 6027, Australia
RoLA: Rotary-Positioned Low-Rank Linear Attention for Efficient Diffusion Transformers
Sep 6, 2026Zekun Zhang, Yixiang Cai, Yuxi Liu +9Rotary Positional Embeddings Low-Rank Attention
Peking University, Melon Group · Alibaba Group · University of Electronic Science and Technology of China +1
GeoSPRINT: Geometric Redundancy-Aware Step Pruning for Inference in Diffusion Trajectories
Sep 2, 2026Arpita JoshiDiffusion Model Inference Acceleration Diffusion Models
The Scripps Research Institute 10550 N. Torrey Pines Road, La Jolla, San Diego CA, USA

Sep 29, 2026, cs.ROJ/K move · Enter open · S save

Urgent Actions Go First: Urgency-Aware Denoising for Real-Time VLA Control

Zibo Wang, Haochen Han, Pengzhen Ren, Mingtong Dai+1

Pengcheng Laboratory

Robotic Control Efficient VLA Model Inference Vision-Language-Action Models Diffusion Model Inference Acceleration

Open paper AskPDF arXiv

Diffusion and flow-matching Vision-Language-Action (VLA) policies generate action chunks through iterative denoising, incurring substantial inference latency that severely limits real-time robotic control. Existing acceleration methods treat an action chunk as a monolithic computational unit, ignoring a crucial physical reality of receding-horizon control: actions are generated jointly but consumed sequentially, resulting in inherently heterogeneous execution urgencies. We exploit this asymmetry to introduce Urgency-Aware Denoising (UAD), a novel inference-time framework that allocates denoising computation according to when each action is physically needed. UAD releases time-critical urgent actions after fewer denoising steps while overlapping the continued background refinement of tail actions with physical execution. However, heterogeneous denoising introduces two key challenges: early-release errors in urgent actions and trajectory inconsistency in tail actions. UAD elegantly resolves both through two core mechanisms: Trajectory Reconciliation, which reconstructs unified internal state evolution to restore joint denoising coherence without additional model evaluations, and Ghost Action Correction, which leverages non-executed ghost continuations to dynamically compensate for early-release errors across remaining executable actions. Extensive evaluations across multiple VLA architectures, simulation benchmarks, and real-world manipulation tasks demonstrate that UAD achieves up to a 1.89x speedup in average action availability latency while maintaining comparable success rates to vanilla inference with optimal denoising budget, offering a more favorable success-latency trade-off than state-of-the-art VLA acceleration baselines.

Momentum

Related topics

Latest papers 335