Speculative Decoding for Diffusion Language Models

Overview

This field studies how to reduce the sequential cost of diffusion language model generation while preserving the output quality of a verifier. Common approaches use a lightweight or self-speculative drafter followed by block verification, and extend drafting with trees, adaptive candidate budgets, or draft editing and refinement. Training methods align parallel predictions with left-to-right verification, while systems work reduces verifier calls and reuses computation across branches; evaluations often include reasoning and code benchmarks such as GSM8K, MATH, HumanEval, and MBPP, as well as throughput under concurrent serving. A central tension is that broader parallel exploration can increase drafting and verification costs or cause trajectory drift, so methods must maximize verified progress rather than draft length alone; multimodal applicability also remains unsettled.

Latest papers

CardsList

44 papers13 papers in the last four weeks, up 44% on the four weeks before. 0.1% of all new papers.

  1. DNeo: Your Parallel Draft Model Needs Better Target Feature Encoding

    Nov 16, 2026Jameson Sandler, Shane Bergsma, Mostafa Elhoushi +5Speculative DecodingLLM Inference Acceleration

  2. MMFlash: Faster Speculative Decoding for Vision-Language Models

    Nov 13, 2026Sicheng Feng, Zigeng Chen, Song Wang +2Efficient VLM InferenceSpeculative Decoding

  3. DForkTree: Accelerating Speculative Decoding with Fork-Aware Block Diffusion Draft Trees

    Nov 9, 2026Zhicheng Zheng, Cheng Zhang, Chenkai Tang +1Speculative DecodingLLM Inference Acceleration

  4. D3Tree: Learning to Prune Block-Diffusion Draft Trees for Efficient Verification

    Nov 8, 2026Hong Nie, Zhangchi Gao, Jun Yu +3Speculative DecodingLLM Inference Scheduling

  5. D3D: Decoupled Diffusion Drafting for Asynchronous Speculative Decoding

    Nov 4, 2026Baoyou Chen, Ruiqiao Mei, Guancong Lin +4Speculative DecodingSpeculative Decoding for Diffusion Language Models

  6. Split-KV: Efficient Context Parallelism for Training Diffusion Drafters

    Nov 4, 2026Geng Zhang, Fangzhao Zhang, Cong Xie +2Context ParallelismCommunication-Efficient Distributed Training

  7. One Call Ahead: Packed Self-Speculative Decoding with Diffusion Drafting

    Oct 24, 2026Yuxiao Chen, Changxiao CaiSpeculative DecodingLLM Inference Acceleration

  8. Speculative Diffusion is a Tale of Two Tradeoffs

    Oct 22, 2026Aaron Zorel, Guy Van den Broeck, Aditya Grover +1LLM InferenceSpeculative Decoding

  9. On the SPOT: Enhancing Speculative Decoding for Diffusion Language Models via Commit-Order Prediction

    Oct 15, 2026Eliezer Shlomi, Eliron Rahimi, Avi Mendelson +1Speculative Decoding for Diffusion Language ModelsDiffusion Language Models

  10. Contextual Correction of Parallel Draftsfor Speculative Decoding

    Oct 8, 2026Roy Eisenstadt, Harel Lidar, Tal Gonen +5Speculative DecodingLLM Inference Acceleration

  11. D-Loop: Looped Diffusion Drafting for Speculative Decoding

    Oct 5, 2026Kecheng Chen, Yuyang He, Cheng Gong +8Speculative Decoding for Diffusion Language ModelsDiffusion Language Model Decoding

  12. Fork-dLLM: Avoiding the Flexibility Trap in Diffusion Language Models

    Sep 30, 2026Stipe Frković, Metod Jazbec, Christian A. NaessethMasked Diffusion ModelsSpeculative Decoding for Diffusion Language Models

  13. DEdit: Iterative Draft Editing for Speculative Decoding

    Sep 29, 2026Longxuan Yu, Bingsen Chen, Peng Shi +9Efficient Language Model InferenceSpeculative Decoding for Diffusion Language Models

  14. Tsubame: Tree Replay for Diffusion-Based Speculative Decoding

    Sep 27, 2026Yepeng Weng, Qiao Hu, Takehisa YairiSpeculative Decoding for Diffusion Language ModelsSpeculative Decoding

  15. DFlow: Enabling Verifier Information Flow in Block Diffusion Speculative Decoding

    Sep 6, 2026Yaojie Zhang, Linfeng Zhang, Bin Cui +1Self-ConditioningSpeculative Decoding for Diffusion Language Models

  16. Is Multimodal Speculative Decoding Ready for Diffusion-Based Parallel Drafting? A Survey and Empirical Diagnosis

    Aug 21, 2026Yantao Li, Huanlin Gao, Fang Zhao +12Speculative DecodingSpeculative Decoding for Diffusion Language Models

  17. LibraSpec: Dynamic Diffusion-Based Speculative Decoding via Marginal-Gain-Driven Optimization

    Aug 9, 2026Zexun Lin, Yuan Feng, Junlin Lv +2Inference-Time OptimizationSpeculative Decoding for Diffusion Language Models

  18. XPress: Parallel Refinement for Diffusion Drafters in Speculative Decoding

    Aug 3, 2026Zheng Wang, Davis Wertheimer, Yu Chin Fabian Lim +4Speculative Decoding for Diffusion Language ModelsSpeculative Decoding