cs.CVNov 19, 2026

Text Lives in the Guidance: Preventing Silent Text Rewriting in Cached Diffusion Transformers

Authors: Kun Zhou, Wenmian Yang, Zhensheng Wang, Weijia Jia

Abstract

Diffusion transformers (DiTs) now render long, legible text in images, and feature caching is a standard way to accelerate them. Caches are judged by image-level metrics, which do not check whether the rendered text is still correct. We find that caching silently rewrites this text. On Z-Image, TaylorSeer at 2.9x fewer FLOPs lowers word accuracy from 62% to 46%, while ImageReward and CLIP Score barely change. Sampling with fewer steps at the same compute keeps almost all of this text, so the loss comes from how the cache predicts the skipped steps. Decomposing the cache error along classifier-free guidance (CFG), we trace this loss mainly to the guidance term, the difference between the conditional and unconditional predictions, which caches extrapolate worst on text. Correcting the guidance inside the text alone recovers most of the lost text. We therefore propose GuideCache, which recomputes both CFG branches only on the tokens with the largest predicted guidance error, using the guidance terms that the cache already stores. At 2.4x fewer FLOPs, GuideCache restores full-compute prompt fidelity on Z-Image and Qwen-Image, and on Z-Image it renders text as well as or better than ToCa, TeaCache, and FasterCache while staying much closer to the full model's output. GuideCache works with caches of any order, and on top of fewer sampling steps it keeps more text than step reduction at a higher speedup. These results suggest that acceleration methods for text-rendering models should be evaluated on the text they render.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Z-Cache: Accelerating Diffusion Transformers via Self-Reflection

    Nov 1, 2026Zegang Cheng, Zhikai Wang, Jiacheng Liu +8Diffusion Model CachingDiffusion Model Inference Acceleration

  2. IdealCache: Rethinking Cache Scheduling in Diffusion Transformers via Ideal Trajectories

    Nov 7, 2026Shang Xue, Li Zhu, Ping ChenDiffusion Model CachingDiffusion Model Acceleration

  3. Rethinking What to Cache in Few-Step Diffusion Transformers: Solver-Aware Target Selection

    Oct 2, 2026Shuo Yang, Lihao Fang, Yi Zhang +5Diffusion Model CachingDiffusion Model Inference Acceleration