cs.CLJul 30, 2026

Commit Locally, Exit Globally: Coordinating Adaptive Sampling and Early Exit in Diffusion Language Models

Authors: Chia-Ming LeeShao-Kai LiuMing-Ching ChangXin LiYu-Lun LiuChih-Chung Hsu

Organizations: National Yang Ming Chiao Tung University · University at Albany, SUNY

Abstract

Diffusion language models expose a provisional prediction at every denoising step, and on many tasks the candidate answer inside it stabilizes before the step schedule is exhausted. This creates two acceleration opportunities, leaving a block early and stopping the sequence early, but the two require different criteria because block acceleration is local whereas sequence termination is global and freezes the graded answer. Existing methods usually optimize only one axis, and existing exit gates rely on fixed-region confidence or schedule-dependent rules rather than the candidate answer itself. We present C4\textbf{C}^4, which coordinates the two axes by giving each decision its own gate. C\textbf{C}onfidence-Verified Early Exit (CVEE) decides when the sequence may stop, requiring confidence and sustained argmax stability over a candidate span re-extracted at every step. C\textbf{C}ommit-C\textbf{C}ore-Then-C\textbf{C}onfirm (CCTC) decides which token positions a step may commit by borrowing an autoregressive freezing order inside each block: it commits a boundary-anchored core and confirms deferred positions one step later, so the answer block can be accelerated without allowing local commits inside the answer span to determine sequence-level termination. On 12 zero-shot tasks with LLaDA and Dream, one frozen configuration removes 64--95% of decoding steps and delivers measured end-to-end speedups of 2.6 to 8.6 over full decoding. Code is available at https://github.com/ming053l/C4-dLLM.

Explore similar work

CardsList
  1. Supportive Token Revealing for Fast Diffusion Language Model Decoding

    Jun 2, 2026Giries Abu Ayoub, Mario Barbara, Lluís Pastor-Pérez +4Diffusion Language Models