Diffusion Language Model Decoding

Follow this topic Ask about this topic

Momentum

26 papers in the last four weeks, up 271% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 164

All topics

Beyond Token Positions: Safety Alignment Across Denoising Steps in Diffusion Language Models
Aug 31, 2026Guoli Wang, Haonan Shi, Tu Ouyang +1Language Model Safety Evaluation Diffusion Language Model Decoding
Case Western Reserve University 10900 Euclid Avenue, Cleveland, OH 44106, USA
CARVE: Verified Expansion for Variable-Length Generation in Diffusion Language Models
Aug 31, 2026Wail Bouhedja, Amr Mohamed, Guokan ShangMasked Diffusion Models LLM Inference Acceleration
1MBZUAI · 2Sorbonne Université · 3Ecole Polytechnique
Ceiling-Clipped Acceptance Histograms Indicate Stranded Speed-up in Block-Diffusion Speculative Decoding
Aug 31, 2026Ephrem WuSpeculative Decoding Diffusion Language Model Decoding
Advanced Micro Devices, Inc., USA
LiLiCorr: Lightweight Likelihood Correlation of Parallel Drafts for Speculative Decoding
Aug 20, 2026Matan Rusanovsky, Yoav Miron, Roy Uziel +5Speculative Decoding LLM Inference Acceleration
NVIDIA
DARTree: Speculative Diffusion Decoding with Autoregressive Draft Trees
Aug 13, 2026Tianyi Li, Yaxin Luo, Xinyi Shang +1Speculative Decoding Diffusion Language Model Decoding
VILA Lab, MBZUAI
Ripple-Pivot Search: Active Parallel Decoding for Diffusion Large Language Models
Aug 12, 2026Yushi Ye, Xu Chen, Haoyun Jiang +7Language Model Decoding Diffusion Language Model Inference
Cooperative Medianet Innovation Center, Shanghai Jiao Tong University · Alibaba Group · TMLR Group, Department of Computer Science, Hong Kong Baptist University +2
LibraSpec: Dynamic Diffusion-Based Speculative Decoding via Marginal-Gain-Driven Optimization
Aug 9, 2026Zexun Lin, Yuan Feng, Junlin Lv +2Inference-Time Optimization Speculative Decoding for Diffusion Language Models
Suzhou Institute for Advanced Research, University of Science and Technology of China Suzhou, Jiangsu, China
Commitment Before Realization: When Classifier-Free Guidance Becomes Unnecessary in Masked Diffusion Language Models
Aug 8, 2026Fan Zhou, Weitian Wang, Tim Van de CruysClassifier-Free Guidance Controllable Text Generation
KU Leuven, Belgium · Ruhr University Bochum, Germany
Retrofitting Linear Attention into Diffusion Language Models
Aug 6, 2026Jinha Kim, Younghun Roh, Jaeyeon KimBlockwise Diffusion Language Models Diffusion Language Model Inference
Apple · *Work done at MIT · Google DeepMind +1
Lost in Interpolation: Why Predictive Feedback Fails in Diffusion Language Models
Aug 6, 2026Lavanya Nigam, Ishaan Bansal, Aryan Sood +2Masked Diffusion Models Diffusion Language Model Decoding
Indian Institute of Technology Roorkee, Roorkee, Uttarakhand, India
Answer First, Reason Later: Commitment Order in Diffusion LLMs
Aug 6, 2026Jewon Yeom, Jaewon Sok, Seonghyeon Park +3CoT Reasoning Diffusion Language Model Decoding
Graduate School of Data Science, Seoul National University · Department of Rural Systems Engineering, Seoul National University · Department of Aerospace Engineering, Seoul National University
DBLAST: Dependent Block Drafting for Stochastic Speculative Decoding
Aug 5, 2026Amirmohammad Karimi, Chao Gao, Negar HassanpourSpeculative Decoding LLM Inference Acceleration
Huawei Technologies Canada Co., Ltd.
OPTD: On-Policy Transition Distillation with Consistency-Guided Adaptive Compression for Few-Step Diffusion Language Models
Aug 3, 2026Xiaocheng Lu, Hualei Zhang, Shuhan Guo +8Diffusion Model Distillation Diffusion Language Model Decoding
HKUST · NWPU · PolyU
Escaping Confidence Trap: Evolutionary Decoding for Mathematical Reasoning in Diffusion LLMs
Aug 1, 2026Zhenhong Sun, Hanqing Zhao, Yatao Bian +7Test-Time Scaling Diffusion Language Model Decoding
Australian National University Canberra, Australia · Nanyang Technological University Singapore · National University of Singapore Singapore +2
DiffusionGemma Technical Report
Jul 31, 2026DiffusionGemma Team, Adrien Ali Taïga, James Assiene +41Blockwise Diffusion Language Models Diffusion Model Fine-Tuning
CORA-Diff: Confidence-Oriented Residual Acceptance for Efficient Diffusion Language Model Inference
Jul 31, 2026Yifan Wu, Yufeng Zhang, Kenli LiDiffusion Model Serving Diffusion Language Model Inference
College of Computer Science, Hunan University Changsha 410082, China
Commit Locally, Exit Globally: Coordinating Adaptive Sampling and Early Exit in Diffusion Language Models
Jul 30, 2026Chia-Ming Lee, Shao-Kai Liu, Ming-Ching Chang +3Diffusion Language Model Inference Diffusion Language Model Decoding
National Yang Ming Chiao Tung University · University at Albany, SUNY
AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding
Jul 28, 2026Hong Liu, Rui Cen, Junhan Shi +10LLM Inference Scheduling Speculative Decoding for Diffusion Language Models
Tencent Inc.
Rethinking the Generation Order of Block Diffusion Language Models
Jul 27, 2026Kai Syun Hou, James KwokDiffusion Model Sampling Blockwise Diffusion Language Models
Department of Computer Science and Engineering The Hong Kong University of Science and Technology
Neuromorphic Diffusion Language Models: Addressing Compute and Memory Bottlenecks via Sparsity and Block Denoising
Jul 24, 2026Dengyu Wu, Clement Ruah, Jiechen Chen +2Diffusion Language Model Decoding Neuromorphic Computing
Department of Engineering, King’s College London, London, UK · Institute for Intelligent Networked Systems (INSI), Northeastern University London, London, UK
Speculative Correction: Draft-then-Refine Decoding for Diffusion Language Models
Jul 21, 2026Brian K Chen, Chong Wu, Kenji KawaguchiLanguage Model Decoding Speculative Decoding for Diffusion Language Models
National University of Singapore · City University of Hong Kong
AdaFlash: Adaptive Speculative Decoding via On-Policy Distilled Diffusion Drafters
Jul 21, 2026Yu-Yang Qian, Hao-Cong Wu, Chen Chen +4Speculative Decoding for Diffusion Language Models Speculative Decoding
State Key Laboratory for Novel Software Technology, Nanjing University · School of Artificial Intelligence, Nanjing University · Huawei Foundation Model Dept
ST-Veto: Spatio-Temporal Token Veto for Diffusion MLLMs via Taylor Prediction and Visual Grounding
Jul 20, 2026Keuntae Kim, Beomseok Lee, Hyunwoo Kim +1VLM Reasoning Diffusion Language Model Decoding
Hanyang University · LG Electronics · KT Corporation
FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models
Jul 20, 2026Bing Tian, Haikun Liu, Xiaocheng Zhong +5Blockwise Diffusion Language Models Parallel Decoding
† Huazhong University of Science and Technology · § Xiaohongshu Inc., China
Adaptive Multi-Step Lookahead Decoding for Diffusion Language Models
Jul 17, 2026Yingqian Cui, Wei Deng, Lantao Mei +4Masked Diffusion Models Language Model Decoding
Michigan State University · Morgan Stanley · IBM T.J. Watson Research Center
Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques
Jul 14, 2026Daehoon Gwak, Minhyung Lee, Junwoo Park +1Masked Diffusion Models Inference-Time Scaling
KAIST AI · Yonsei University
Accepted Prefixes Are Not All You Need: A Negative Result on PEFT-Based Block-Diffusion Drafting
Jul 14, 2026Abdurrahman Javat, Allan KazakovSpeculative Decoding LLM Inference Acceleration
Bahçeşehir University, Department of Artificial Intelligence
DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding
Jul 9, 2026Saw S. Lin, Jyh-Shing Roger JangSpeculative Decoding LLM Inference Acceleration
Zhiqi Zhang · Department of Computer Science and Information Engineering, National Taiwan University.
Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata
Jul 8, 2026Meihua Dang, Stefano ErmonConstrained Generative Modeling Constrained Decoding
Stanford University
Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
Jul 7, 2026Yonggan Fu, Lexington Whalen, Abhinav Garg +23Autoregressive Diffusion Autoregressive Language Modeling
NVIDIA · Georgia Tech · Work done during internships at NVIDIA +3

Aug 31, 2026, cs.CLJ/K move · Enter open · S save

Beyond Token Positions: Safety Alignment Across Denoising Steps in Diffusion Language Models

Guoli Wang, Haonan Shi, Tu Ouyang, An Wang

Case Western Reserve University 10900 Euclid Avenue, Cleveland, OH 44106, USA

Language Model Safety Evaluation Diffusion Language Model Decoding Diffusion Language Models Refusal Behavior in Language Models

Open paper AskPDF arXiv

Diffusion large language models (dLLMs) generate text through iterative denoising rather than left-to-right decoding. This generation paradigm introduces two axes that can influence safety alignment: when tokens are generated during denoising and where they appear in the response. In this paper, we measure dLLM safety behavior under harmful prompts by tracing intermediate token distributions and commitment decisions throughout denoising. Our analysis shows that refusal signals are concentrated in early denoising steps and leading response positions, and the tokens committed early can strongly shape the final safety outcome. Our measurements further show that the denoising step and persistence of refusal-token commitment are important for understanding dLLM safety. Based on these findings, we propose Refusal-Aware Early Commitment (RAEC), a simple training-free decoding method that commits persistent refusal signals from early steps. Experiments on LLaDA and Dream show that RAEC reduces attack success rates while largely preserving utility. The code is available at https://github.com/Glresearch1/RAEC.

Momentum

Related topics

Latest papers 164