cs.CVNov 9, 2026

Four-Step Text-Bearing Image Generation via Distillation with Local Response Regularization and Teacher-Guided Training

Authors: Kairui Wen, Sheng Ye, Yong-Jin Liu

Organizations: Tsinghua University, China

Abstract

Generating text-bearing images requires coherent scenes and accurate characters. Large text-to-image models improve both capabilities through repeated denoising, at substantial sampling cost. Few-step distillation reduces this cost but requires the student to organize scenes and refine glyphs within a short trajectory. We present a four-step distillation framework combining local response regularization with teacher-guided text training. Built on distribution matching, the framework distills the GLM-Image DiT while retaining its autoregressive visual prior, glyph encoder, and VAE. A path-length penalty promotes consistent local responses of the conditional denoising field. Progressive training combines synthetic strings with teacher-generated imagery to preserve character accuracy and scene-integrated typography. The student achieves GenEval Overall 0.84 and CVTG-2K word accuracy 0.5045, compared with 0.81 and 0.1690 for four-step TDM. A coefficient study favors 10−510^{-5}, and Qwen-Image experiments show additional gains from response regularization and text supervision. Single-image inference takes 1.742 s, compared with 5.818 s for the teacher, yielding a 3.34×3.34\times speedup at the same 40 GB GPU memory requirement.

Figures & tables

Explore similar work

CardsList
  1. RL-Native Distillation: Exploiting Scored Trajectories for Few-Step Image Generation

    Aug 10, 2026Yuhan Li, Fangao Zeng, Sicong Kang +7Diffusion Model DistillationFew-Step Diffusion Sampling

  2. Fast and Useful: Adapting Distilled Generators for Visual Learning

    Oct 23, 2026Patryk Bartkowiak, Dominik Michels, Sören Pirk +1Diffusion Model AdaptationSynthetic Data Augmentation