cs.CVApr 29, 2026

Delta Score Matters! Spatial Adaptive Multi Guidance in Diffusion Models

Authors: Haosen LiWenshuo ChenLei WangShaofeng LiangBowen TianSoning LaiYutao Yue

Organizations: 1The Hong Kong University of Science and Technology (Guangzhou) · 2Griffith University & Data61/CSIRO

Abstract

Diffusion models have achieved remarkable success in synthesizing complex static and temporal visuals, a breakthrough largely driven by Classifier-Free Guidance (CFG). However, despite its pivotal role in aligning generated content with textual prompts, standard CFG relies on a globally uniform scalar. This homogeneous amplification traps models in a well-documented "detail-artifact dilemma": low guidance scales fail to inject intricate semantics, while high scales inevitably cause structural degradation, color over-saturation, and temporal inconsistencies in videos. In this paper, we expose the physical root of this flaw through the lens of differential geometry. By analyzing Tweedie's Formula, we reveal that CFG intrinsically performs a tangential linear extrapolation. Because the natural data manifold is highly curved, this uniform linear step introduces a severe orthogonal deviation. To keep the generation trajectory safely bounded, we formulate a theoretical upper bound for spatial and adaptive guidance. Based on these geometric insights, we propose Spatial Adaptive Multi Guidance (SAMG), a training-free and virtually zero-cost sampling algorithm. SAMG dynamically computes point-wise conditional guidance energy, applying a conservative minimum scale to high-energy boundary regions to preserve delicate micro-textures, while deploying an aggressive maximum scale in low-energy regions to maximize semantic injection. Extensive experiments across diverse image (SD 1.5, SDXL, SD3.5 Medium) and video (CogVideoX, ModelScope) architectures demonstrate that SAMG effectively resolves the detail-artifact dilemma, achieving superior semantic alignment, structural integrity, and temporal smoothness without any computational overhead.

Explore similar work

CardsList
  1. Spectral Guidance for Flexible and Efficient Control of Diffusion Models

    May 27, 2026Gabriel Moreira, Manuel Marques, João Paulo Costeira +1Generative Processes

  2. Probability-Conserving Flow Guidance

    May 19, 2026Parsa Esmati, Junha Hyung, Amirhossein Dadashzadeh +2Generative Flow NetworksNeural Guidance

  3. A Frozen Pixel-Space Diffusion Model Can Guide Itself with Its Own Samples

    Jul 31, 2026Zixuan Fu, Chong Wang, Lanqing Guo +3