cs.CLSep 6, 2026

DFlow: Enabling Verifier Information Flow in Block Diffusion Speculative Decoding

Authors: Yaojie Zhang, Linfeng Zhang, Bin Cui, Xupeng Miao

Organizations: School of Computer Science & Beijing Key Laboratory of Software and Hardware Cooperative Artificial Intelligence Systems, Peking University · University of Electronic Science and Technology of China · Shanghai Jiao Tong University · Institute of Computational Social Science, Peking University (Qingdao)

Abstract

Block diffusion speculative decoding improves LLM inference efficiency by proposing a block of future tokens in parallel and verifying them with a single forward pass through the target model. However, existing methods retain only the accepted prefix and discard the rejected suffix, preventing the computation spent on these positions from benefiting subsequent drafting rounds and forcing the drafter to repeatedly reconstruct representations for future tokens from scratch. We observe that rejection only determines whether a proposed token can be committed, while the verifier representations at rejected positions can still provide useful information for subsequent predictions. Based on this observation, we propose DFlow, a simple yet effective framework that enables verifier information to flow across drafting rounds. DFlow reuses the hidden states produced by the target verifier for the rejected suffix to guide subsequent drafting without additional target computation. To effectively learn this information flow across drafting rounds, we introduce a self-condition train strategy that feeds verifier representations from earlier predictions back into subsequent predictions. Experiments on Qwen3 models across diverse benchmarks demonstrate that DFlow consistently improves draft quality and acceptance length over DFlash.

Figures & tables

Explore similar work

CardsList
  1. BV Loss: Block Verification-Aware Loss for Block Diffusion Speculative Decoding

    Sep 28, 2026Suyoung Kim, Jahyun Koo, Hyeonjin Kim +5Speculative DecodingDiffusion Language Model Decoding

  2. xPress: Parallel Refinement for Diffusion Drafters in Speculative Decoding

    Aug 3, 2026Zheng Wang, Davis Wertheimer, Yu Chin Fabian Lim +4Speculative Decoding for Diffusion Language ModelsSpeculative Decoding