Diffusion Language Model Decoding

Follow this topic Ask about this topic

Momentum

26 papers in the last four weeks, up 271% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 164

All topics

Don't Commit Alone: Joint Token Commitment in Diffusion Large Language Models
Jul 5, 2026Lin YaoDiffusion Language Model Decoding Diffusion Language Models
School of Computer Science, Shanghai Jiao Tong University, Shanghai, 200240, China · Zhongguancun Academy, Beijing, 100097, China
dOPSD: On-Policy Self-Distillation for Diffusion Language Models
Jul 5, 2026Phuong Tuan Dat, Qi Li, Xinchao WangOn-Policy Self-Distillation Language Model Distillation
National University of Singapore
Quantize the Target, Quantize the Drafter: Efficient Inference with Qwen3.5-4B
Jul 5, 2026Jaeyeon Kim, Jewon Lee, Bo-Kyeong KimLLM Quantization Speculative Decoding
Nota Inc.
DELTA-TTS: Adapting Autoregressive Model into Diffusion Language Model for Text-to-Speech
Jul 5, 2026Junwon Moon, Seungbeom Kim, Yejin Lee +4TTS Synthesis Diffusion Model Fine-Tuning
1Sungkyunkwan University · University of Seoul
TACG: Trajectory-Aware Commit Gating for Diffusion Language Model Decoding
Jul 3, 2026Chengcheng Wang, Tingzhang Luo, Wenhao Li +2Diffusion Language Model Inference Diffusion Language Model Decoding
University of Sydney · City University of Hong Kong
Set Diffusion: Interpolating Token Orderings Between Autoregression and Diffusion for Fast and Flexible Decoding
Jul 2, 2026Marianne Arriola, Volodymyr KuleshovLanguage Model Decoding Diffusion Language Model Decoding
Department of Computer Science, Cornell University, Ithaca, NY, USA.
BlockPilot: Instance-Adaptive Policy Learning for Diffusion-based Speculative Decoding
Jun 30, 2026Hao Zhang, Yiming Hu, Yong Wang +3Speculative Decoding Diffusion Language Model Decoding
AMAP, Alibaba Group
Adaptive Block Diffusion: Resolving Training-Inference Mismatch in Diffusion Language Models
Jun 28, 2026Gagan JainBlockwise Diffusion Language Models Diffusion Language Model Decoding
Work done while at Microsoft AI.
Understanding Evaluation Illusion in Diffusion Large Language Models
Jun 28, 2026Hengxiang Zhang, Jiaxi Ren, Renchunzi Xie +1Prompt Sensitivity LLM Evaluation
Department of Statistics and Data Science, Southern University of Science and Technology · Intelligent Computing Research Center, Great Bay Institute for Advanced Study, Great Bay University
Multi-Block Diffusion Language Models
Jun 28, 2026Yijie Jin, Jiajun Xu, Yuxuan Liu +8Blockwise Diffusion Language Models Diffusion Language Model Decoding
Shanghai Jiao Tong University · Xi’an Jiao Tong University · Huawei
Masked Diffusion Decoding as $x$ -Prediction Flow
Jun 27, 2026Weitian Wang, Lianlei Shan, Shubham Rai +2Masked Diffusion Models Diffusion Language Model Decoding
Robert Bosch GmbH, Germany · University of the Chinese Academy of Sciences, China · Ruhr University Bochum, Germany
Affix Cache for Diffusion Large Language Models
Jun 26, 2026Kaihua Liang, An Zhong, Xin Tan +4KV Caching Memory-Efficient Inference
KAUST · CUHK · LUMS
Bifocal Diffusion Language Models: Asymmetric Bidirectional Context for Parallel Generation
Jun 26, 2026Yuhang Chen, Xianfeng Wu, Jinhao Duan +11Diffusion Language Model Inference Parallel Decoding
University of North Carolina at Chapel Hill · Meta AI
Speculative Refinement: A Hybrid Autoregressive Diffusion Decoding Strategy and Its Behavior Across Benchmarks
Jun 25, 2026Aditi Gupta, Neel Mishra, Kushagra Trivedi +1Masked Diffusion Models Language Model Generation Evaluation
IIIT Hyderabad, India · Microsoft
Scheduling Thoughts: Learning the Order of Thought in Diffusion Language Models
Jun 22, 2026Jiawei Xu, Minghui Liu, Aakriti Agrawal +2Masked Diffusion Models Language Model Decoding
University of Maryland, College Park · University of California, Los Angeles.
Walk fast but be careful: Understanding Parallel Sampling in Masked Diffusion
Jun 22, 2026Vansh Bansal, Cholyeon Cho, Syamantak Kumar +2Masked Diffusion Models Diffusion Sampling
UT Austin SDS · UT Austin CS · UT Austin ECE
When to Plan, When to Polish: Noise Level as a Granularity Axis for Diffusion Language Models
Jun 19, 2026Peihong Li, Yuanjie Shi, Yan YanLLM Planning Diffusion Language Model Decoding
Washington State University
HERALD: High-Throughput Block Diffusion LLM Serving via CPU-GPU Cooperative KV Cache Retrieval
Jun 19, 2026Omin Kwon, Doyeon Kim, Jongseok Park +3KV-Cache Offloading Diffusion Model Serving
Seoul National University Seoul, Republic of Korea · UC Berkeley Berkeley, CA, USA
Diffusion Language Models: An Experimental Analysis
Jun 17, 2026Thomas Bertolani, Davide Bucciarelli, Leonardo Zini +2Diffusion Language Model Inference Diffusion Language Model Decoding
University of Modena and Reggio Emilia, Italy · University of Pisa, Italy
VoidPadding: Let [VOID] Handle Padding in Masked Diffusion Language Models so that [EOS] Can Focus on Semantic Termination
Jun 16, 2026Chunyu Liu, Zhengyang Fan, Kaisen Yang +1Masked Diffusion Models Diffusion Language Model Inference
Tsinghua University
Self-Generated Error Training for Token Editing in Diffusion Language Models
Jun 15, 2026Lin YaoLLM Self-Correction Diffusion Model Fine-Tuning
School of Computer Science, Shanghai Jiao Tong University, Shanghai, 200240, China · Zhongguancun Academy, Beijing, 100097, China
LESS Is More: Mutual-Stability Sampling for Diffusion Language Models
Jun 15, 2026Amr Mohamed, Guokan Shang, Michalis VazirgiannisMasked Diffusion Models Diffusion Language Model Decoding
1MBZUAI · 2Ecole Polytechnique
Follow the Latent Roadmap: Navigating Revocable Decoding for Diffusion LLMs with Anchor Tokens
Jun 15, 2026Yizhen Yao, Qinglin Zhu, Runcong Zhao +4Diffusion Language Model Inference Diffusion Language Model Decoding
King’s College London · The Chinese University of Hong Kong · The Alan Turing Institute, UK
Who Should Lead Decoding Now? Tracking Reliable Trajectories for Ensembling Masked Diffusion Language Models
Jun 15, 2026Heecheol Yun, Joonhyung Park, Joowon Kim +1Masked Diffusion Models Diffusion Language Model Decoding
1KAIST · 2AITRICS
Mean-Field Parallel Decoding for Discrete Diffusion Language Models
Jun 14, 2026Tamim Zoabi, Ameen Ali, Liran Ringel +1Parallel Decoding Diffusion Language Model Decoding
School of Electrical & Computer Engineering Tel Aviv University, Israel · School of Computer Science and AI Tel Aviv University, Israel · Department of Computer Science Technion, Israel Institute of Technology, Israel
Neither Parallel Nor Sequential: How DiffusionGemma Actually Commits Tokens
Jun 12, 2026Ali Asaria, Tony Salomone, Deep GandhiMasked Diffusion Models Diffusion Sampling
Transformer Lab
A2D2: Fine-Tuning Any-Length Discrete Diffusion for Adaptive Decoding
Jun 11, 2026Sophia Tang, Yuchen Zhu, Molei Tao +1Diffusion Model Fine-Tuning Diffusion Language Model Decoding
Department of Computer and Information Science, University of Pennsylvania · School of Mathematics, Georgia Institute of Technology · Department of Bioengineering, University of Pennsylvania
Efficient On-Device Diffusion LLM Inference with Mobile NPU
Jun 11, 2026Tuowei Wang, Yanfan Sun, Ju RenAI Accelerator Inference On-Device Language Model Inference
Beihang University China · Tsinghua University China
Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models
Jun 10, 2026Jia Deng, Junyi Li, Wayne Xin Zhao +3Masked Diffusion Models Diffusion Model Fine-Tuning
Gaoling School of Artificial Intelligence, Renmin University of China · Department of Data Science, City University of Hong Kong · Beijing Key Laboratory of Research on Large Models and Intelligent Governance +2
Re-evaluating Confidence Remasking in Masked Diffusion Language Models
Jun 10, 2026Stipe Frkovic, Metod Jazbec, Dan Zhang +3Masked Diffusion Models Diffusion Language Model Decoding
UvA-Bosch Delta Lab, University of Amsterdam · Bosch Center for AI · University of Basel +1

Jul 5, 2026, cs.CLJ/K move · Enter open · S save

Don't Commit Alone: Joint Token Commitment in Diffusion Large Language Models

Lin Yao

School of Computer Science, Shanghai Jiao Tong University, Shanghai, 200240, China · Zhongguancun Academy, Beijing, 100097, China

Diffusion Language Model Decoding Diffusion Language Models

Open paper AskPDF arXiv

Diffusion large language models (dLLMs) commit multiple tokens per denoising step by decoding each selected position independently from the shared context; when those positions are dependent, the resulting factorization error is captured by conditional total correlation, which confidence-based selection cannot observe from marginals alone. We propose CoCommit, a marker-gated coordination pass that briefly defers commitment: after the usual bundle selection, a learned marker announces the commit set and the backbone's last-

n

layers are re-applied so marked positions coordinate -- approximating joint-mode decoding -- before greedy argmax writes tokens. The method reuses existing weights with one extra partial forward pass and no auxiliary model. On LLaDA2.1-mini with LoRA adapters and matched greedy inference, joint commitment improves accuracy on all six benchmarks we evaluate, with the largest gains on reasoning and exact-answer tasks.

Momentum

Related topics

Latest papers 164