MT Forcing: Towards Stable and Consistent Multi-Turn Image Editing with Autoregressive Diffusion
Organizations: SenseTime Research · HKUST MMLab · Stanford University · AIR, Tsinghua University
Abstract
Multi-turn image editing aims to modify an image according to a sequence of instructions, enabling more effective interactive visual content creation for users. However, existing methods often exhibit noticeable drift after only a few editing turns, manifesting in two aspects: 1) unstable visual quality, with accumulating artifacts and degraded details; and 2) inconsistent image content, with unintended changes to preserved regions and prior edits. To address these challenges, we propose MT Forcing, a novel training paradigm for multi-turn image editing with unified multimodal models (UMMs) based on autoregressive diffusion. Specifically, we propose Single-Turn Distribution Matching Distillation (Single-Turn DMD), which supervises student self-rollouts with a teacher that applies cumulative edits to the source image in a single turn, providing visual-quality guidance without recursive error accumulation. Additionally, we introduce Teacher-Forcing Guidance, which supervises history-dependent transitions on reference trajectories during warmup and as a regularizer during distillation, encouraging cross-turn content consistency beyond what per-turn distribution matching alone can ensure. Extensive experiments demonstrate that our approach significantly improves the multi-turn image editing capabilities of UMMs, yielding more stable visual quality and stronger cross-turn consistency.
Figures & tables
| Method | Turn 1 | Turn 2 | Turn 3 | Turn 4 | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| IF | CC | IF | CC | IF | CC | IF | CC | |||||||||
| SenseNova-U1 [ 15 ] | 9.29 | 9.06 | 4.07 | 6.63 | 8.95 | 8.51 | 4.14 | 13.19 | 8.53 | 7.61 | 4.12 | 12.28 | 7.37 | 5.95 | 3.90 | 3.37 |
| + MT Forcing | 9.71 +.42 | 8.85 -.21 | 4.25 +.18 | 1.23 -5.40 | 9.78 +.83 | 8.55 +.04 | 4.23 +.09 | 0.39 -12.80 | 9.65 +1.12 | 8.57 +.96 | 4.23 +.11 | 0.38 -11.90 | 9.56 +2.19 | 8.47 +2.52 | 4.25 +.35 | 0.35 -3.02 |
| SenseNova-U1.5 [ 14 ] | 9.90 | 9.49 | 4.09 | 4.74 | 9.85 | 9.16 | 4.14 | 3.10 | 9.76 | 8.76 | 4.16 | 3.86 | 9.46 | 8.04 | 4.09 | 7.30 |
| + MT Forcing | 9.74 -.16 | 8.82 -.67 | 4.20 +.11 | 1.07 -3.67 | 9.81 -.04 | 8.71 -.45 | 4.25 +.11 | 0.54 -2.56 | 9.77 +.01 | 8.64 -.12 | 4.29 +.13 | 0.79 -3.07 | 9.81 +.35 | 8.49 +.45 | 4.32 +.23 | 0.72 -6.58 |
| Method | Turn 5 | Turn 6 | Turn 7 | Turn 8 | ||||||||||||
| Single-Turn DMD | Teacher-Forcing Guidance | IF | CC | ||
|---|---|---|---|---|---|
| 8.47 | 7.09 | 3.83 | 6.34 | ||
| 9.02 | 7.64 | 4.12 | 2.51 | ||
| 9.10 | 7.83 | 3.92 | 2.74 | ||
| 9.66 | 8.40 | 4.30 | 0.74 |