Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformers
Organizations: iFLYTEK
Abstract
Training-free control over editing intensity is a critical requirement for diffusion-based image editing models built on the Diffusion Transformer (DiT) architecture. Existing attention manipulation methods focus exclusively on the Key space to modulate attention routing, leaving the Value space -- which governs feature aggregation -- entirely unexploited. In this paper, we first reveal that both Key and Value projections in DiT's multi-modal attention layers exhibit a pronounced bias-delta structure, where token embeddings cluster tightly around a layer-specific bias vector. Building on this observation, we propose Dual-Channel Attention Guidance (DCAG), a training-free framework that simultaneously manipulates both the Key channel (controlling where to attend) and the Value channel (controlling what to aggregate). We provide a theoretical analysis showing that the Key channel operates through the nonlinear softmax function, acting as a coarse control knob, while the Value channel operates through linear weighted summation, serving as a fine-grained complement. Together, the two-dimensional parameter space enables more precise editing-fidelity trade-offs than any single-channel method. Extensive experiments on the PIE-Bench benchmark (700 images, 10 editing categories) demonstrate that DCAG consistently outperforms Key-only guidance across all fidelity metrics, with the most significant improvements observed in localized editing tasks such as object deletion (4.9% LPIPS reduction) and object addition (3.2% LPIPS reduction).
Figures & tables
| Method | LPIPS | SSIM | PSNR | MSE | ||
| No Guidance | 1.00 | 1.00 | 0.3523 | 0.6307 | 15.56 | 3902 |
| group | ||||||
| GRAG | 1.10 | 1.00 | 0.2588 | 0.7444 | 17.93 | 2588 |
| DCAG | 1.10 | 1.05 | 0.2575 | 0.7453 | 17.92 | 2585 |
| DCAG | 1.10 | 1.10 | 0.2555 | 0.7468 | 17.90 | 2570 |
| DCAG | 1.10 | 1.15 | 0.2542 | 0.7477 | 17.89 | 2557 |
| Category | GRAG | DCAG | ||
|---|---|---|---|---|
| Random | 0.2676 | 0.2594 | 3.1% | 140 |
| Change Object | 0.2364 | 0.2299 | 2.7% | 80 |
| Add Object | 0.1097 | 0.1068 | 2.7% | 80 |
| Delete Object | 0.1752 | 0.1677 | 4.3% | 80 |
| Change Attribute | 0.1538 | 0.1554 | 1.0% | 40 |
| Change Count | 0.2688 | 0.2654 | 1.3% | 40 |
| LPIPS | SSIM | PSNR | MSE | |
|---|---|---|---|---|
| 1.00 | 0.2588 | 0.7444 | 17.93 | 2588 |
| 1.05 | 0.2575 | 0.7453 | 17.92 | 2585 |
| 1.10 | 0.2555 | 0.7468 | 17.90 | 2570 |
| 1.15 | 0.2542 | 0.7477 | 17.89 | 2557 |
| 1.20 | 0.2546 | 0.7466 | 17.81 | 2563 |
Diffusion-Based Image Editing
Diffusion-based image editing changes image content, style, or attributes while aiming to preserve the parts users want to keep.
See all 225 papers