While diffusion models excel at image generation, their denoising trajectories pass through corrupted intermediate states far from the image manifold. We ask whether generation can instead proceed through recognizable images throughout the entire trajectory. We introduce a generative framework built around a variation-reducing degradation process that contracts diverse images toward a shared prototype while preserving recognizable intermediate states. Because such manifold traversal lacks a simple analytical form, we construct the trajectories using generative-prior-based image morphing. We then distill the reverse process into a diversification operator that transforms the prototype into increasingly varied samples. To resolve the one-to-many ambiguity of the reverse process, we associate each trajectory with its initial noise latent and apply perturbations to improve robustness against accumulated errors. At inference, every step yields a recognizable image, allowing early termination and enabling a controllable speed--variation trade-off.
Figures & tables
Figure 1: (a) Standard diffusion generates images by denoising Gaussian noise toward the data manifold, producing corrupted intermediate states for most of the trajectory. (b) Our method instead starts from a shared prototype already on the data manifold and reverses our variation-reducing degradation process, moving the point within the data distribution to gradually diversify it, enabling a controllable speed–variation trade-off.
Figure 2: Overview. (a) Generate images with a pretrained LDM, select a prototype, and construct variation-reducing trajectories. (b) We train the diversification operator using noise and variation perturbations to improve robustness during iterative generation, conditioned on the associated noise latent η . (c) The trained model generates clean, natural trajectories with a controllable speed-variation trade-off.
Figure 3
Figure 3: Qualitative comparison of generated sequence strips across FFHQ, CelebA, Church, and Bedroom datasets. For each dataset grid, the top section shows xt , the middle section shows x^0 , and the bottom section shows Ours.
Figure 4: Image quality versus diversity across inference steps. Image quality is measured using ImageReward, while diversity is measured using the Vendi Score. Arrows indicate the direction of generation, while circles ( ∙ , ∙ , ∙ , ∙ ) and squares mark ( ■ , ■ , ■ , ■ ) the initial and final steps, respectively. We compare our trajectory with the diffusion baseline’s intermediate states xt and predicted clean images x^0 . The dashed curve represents the variation-reducing trajectories in the curated training dataset. Our method maintains high image quality as diversity progressively increases.
Figure 5: Comparison of our method with and without noise association η . Noise association η enables greater variation throughout the trajectory, whereas omitting it results in trajectories with limited variation and minimal changes.
Figure 6: Comparison of our method with ( smax=5 ) and without ( smax=1 ) variation perturbation smax . Using variation perturbation produces trajectories that more faithfully match the curated ground-truth trajectories.
Figure 7: Effect of noise perturbation τ on image quality. Both insufficient ( τ=0 ) and excessive ( τ=500 and τ=800 ) noise perturbation degrade image quality, resulting in corrupted, distorted, or blurry images. In contrast, a moderate noise perturbation ( τ=300 ) provides the best balance and produces the highest-quality results with lowest FID as shown in Table 2 .
Table 9
Figure 8: Examples of low-quality trajectories from the LSUN-Church dataset.