cs.LGJun 4, 2026

Plug-and-Play Guidance for Discrete Diffusion Models via Gradient-Informed Logit Correction

Authors: Hongkun DouZike ChenFengji LiHongjue LiYue Deng

Abstract

Controllable generation with discrete diffusion models is often hindered by high computational overhead or the need for retraining. In this paper, we present \underline{\textbf{G}}radient-\underline{\textbf{I}}nformed \underline{\textbf{L}}ogit \underline{\textbf{C}}orrection (\textbf{GILC}), a plug-and-play framework that efficiently estimates guidance signals by repurposing the pretrained denoising network as a variational proxy. To circumvent the gradient instability inherent in high-dimensional discrete spaces, we introduce a Jacobian-free mechanism that directly corrects the clean prediction logits, facilitating stable and effective guidance. Our method accommodates both differentiable and non-differentiable reward functions. Extensive experiments across DNA, protein sequence, and molecular generation tasks demonstrate that GILC achieves state-of-the-art performance without additional training, frequently outperforming fine-tuning approaches.

Explore similar work

CardsList
  1. A2D2: Fine-Tuning Any-Length Discrete Diffusion for Adaptive Decoding

    Jun 11, 2026Sophia Tang, Yuchen Zhu, Molei Tao +1