Diffusion Language Model Decoding

Overview

Diffusion language model decoding generates text by repeatedly refining masked or noisy token positions, often updating many positions in parallel instead of predicting one token at a time. Common approaches use confidence, attention, token dependencies, or prediction stability to choose what to reveal and when; blockwise schedules, remasking, and learned ordering policies aim to make those choices more reliable. Speculative drafting and verification, search, adaptive length control, and cache or hardware optimizations further target faster inference across reasoning, code, long-form, and multimodal tasks. The central tension is that parallel updates can miss dependencies or commit errors too early, while cautious decoding costs more, so improving speed without sacrificing accuracy, coherence, or diversity remains an open challenge.

Latest papers

CardsList

268 papers23 papers in the last four weeks, down 47% on the four weeks before. 0.2% of all new papers.

  1. Beyond Replacement: Levenshtein Editing for Diffusion Language Models

    Nov 18, 2026Shuaidi Wang, Zhuocheng Gong, Xuejie Liu +2Diffusion Language Model DecodingDiffusion Language Models

  2. ReMaRL: Learning to Unmask and Remask in Frozen Diffusion Language Models

    Nov 17, 2026Egor Shibaev, Danila Biktimirov, Ivan Klimov +3Diffusion Language Model InferenceDiffusion Language Model Decoding

  3. The Hidden Cost of MoE Diffusion Decoding: Profiling and Fixing the Sampler

    Nov 16, 2026Harshit Samrat, Ramakrishna Paramahamsa KompellaDiffusion Language Model InferenceDiffusion Language Model Decoding

  4. Learning When Diffusion Language Models Should Regenerate

    Nov 12, 2026Minhae Oh, Jeonghye Kim, Jinwoo Koo +4Diffusion Language ModelsDiffusion Language Model Decoding

  5. Token Commitment as a Control Surface for Steering Masked Diffusion Generation

    Nov 11, 2026Ambroise Aigueperse, Hugo Buurmeijer, Carmen Amo ALonso +1Diffusion ModelsMasked Diffusion Models

  6. Schedule-Calibrated Commitment Order in Blockwise Masked Diffusion Language Models

    Nov 11, 2026Gaurav Sarkar, Umang Pandey, Pratik Prabhanjan Brahma +2Diffusion Language ModelsMasked Diffusion Models

  7. When Should Diffusion Language Models Reconsider Their Commitments?

    Nov 8, 2026Haoyang Zheng, Yidong Ouyang, Blake Jianhang Chen +5Diffusion Language Model DecodingParallel Decoding for Diffusion Language Models

  8. Test-Time Scaling for Diffusion Language Models with Frequency-Aware Remasking

    Nov 7, 2026Bowen Zuo, Yue Yu, Dongruo Zhou +1Diffusion Language ModelsDiffusion Language Model Decoding

  9. Training-Free Character-Length Control in Summarization with Diffusion Language Models

    Nov 4, 2026Steffen Castle, Nils Feldhus, Christopher Ebert +2Text SummarizationDiffusion Language Model Decoding

  10. PACT: Certifying What Is Written in Parallel Decoding of Diffusion Language Models

    Nov 3, 2026Yanchao Li, Yusu Zhang, Jiaqing Xie +5Diffusion Language Model DecodingParallel Decoding for Diffusion Language Models

  11. Cord: Confidence-Anchored Order Residual Decoding for Masked Diffusion Language Models

    Oct 29, 2026Chengwei Zhou, Zhaoyan Jia, Massoud Pedram +1Diffusion Language Model DecodingMasked Diffusion Models

  12. HiLo-RD: Cross-Budget Self-Distillation for Masked Diffusion Language Models

    Oct 27, 2026Xiang Li, Chengting Yu, Jungang Li +5Diffusion Language Model DecodingDiffusion Language Models

  13. One Call Ahead: Packed Self-Speculative Decoding with Diffusion Drafting

    Oct 24, 2026Yuxiao Chen, Changxiao CaiSpeculative DecodingLLM Inference Acceleration

  14. DELA: Learning Controllable Edits for Diffusion Language Models

    Oct 23, 2026Xinsong Feng, Chenan Wang, Leshu Tang +4Diffusion Language ModelsDiffusion Language Model Decoding

  15. Speculative Diffusion is a Tale of Two Tradeoffs

    Oct 22, 2026Aaron Zorel, Guy Van den Broeck, Aditya Grover +1LLM InferenceSpeculative Decoding

  16. What Makes a Good Unmasking Policy? A Controlled Study of Learned Unmasking in Diffusion Language Models

    Oct 22, 2026Jinya Sakurai, Xun Xu, Jaehong YoonDiffusion Language Model DecodingDiffusion Language Models

  17. Cola2: Co-Adaptive Hierarchical Language Modeling with Continuous Semantic Compression and Balanced Discrete Generation

    Oct 22, 2026Hongcan Guo, Yian Zhao, Feng Wang +4Language ModelingDiffusion Language Model Decoding

  18. DConstrain: Compiling Context-Parameterized Transitions for Diffusion Language Model Constrained Decoding

    Oct 22, 2026Shidong Cao, Jing Ma, Wenhao Chai +3Constrained DecodingGrammar-Constrained Decoding

  19. Hierarchical Masked Diffusion Language Models

    Oct 21, 2026Parul Gupta, Satwik, Avni Aggarwal +5Masked Diffusion ModelsDiffusion Language Model Decoding

  20. DiffResearch: Accelerating Deep Research with Diffusion Language Models

    Oct 20, 2026Alan-Barsag Gazzaev, Alexey Gavrilov, Mikhail Mozikov +1Diffusion Language ModelsDiffusion Language Model Decoding

  21. Keep the Lineages Alive: Diversity-Preserving SMC for Diffusion LLM Decoding

    Oct 19, 2026Minoo Ahmadi, Seyedarmin Azizi, Mehdi Kamal +1Language Model DecodingDiffusion Language Model Decoding

  22. CoTA++: Understanding the Repeat Curse in dMLLMs from an Information Flow Perspective

    Oct 16, 2026Qiyan Zhao, Xiaofeng Zhang, Xu-Yao Zhang +4Diffusion Language Model DecodingDiffusion Language Models

  23. LED: Improving Masked Diffusion Language Models by Lookahead Editing

    Oct 16, 2026Yuyan Zhou, Zeyuan Yang, Yuxuan Song +5Diffusion Language Model DecodingMasked Diffusion Models