Organizations: Data Science & Artificial Intelligence Research Institute, China Unicom · Unicom Data Intelligence, China Unicom · School of Computer Science and Software Engineering, Southwest Petroleum University · National University of Singapore · School of Computing and Artificial Intelligence, Southwest Jiaotong University
Diffusion models operate in a reflexive System 1 mode, constrained by a fixed, content-agnostic sampling schedule. This rigidity arises from the curse of state dimensionality, where the combinatorial explosion of possible states in the high-dimensional noise manifold renders explicit trajectory planning intractable and leads to systematic computational misallocation. To address this, we introduce Chain-of-Trajectories (CoTj), a train-free framework enabling System 2 deliberative planning. Central to CoTj is Diffusion DNA, a low-dimensional signature that quantifies per-stage denoising difficulty and serves as a proxy for the high-dimensional state space, allowing us to reformulate sampling as graph planning on a directed acyclic graph. Through a Predict-Plan-Execute paradigm, CoTj dynamically allocates computational effort to the most challenging generative phases. Experiments across multiple generative models demonstrate that CoTj discovers context-aware trajectories, improving output quality and stability while reducing redundant computation. This work establishes a new foundation for resource-aware, planning-based diffusion modeling. The code is available at https://github.com/UnicomAI/CoTj.
Figures & tables
Figure 1: The Paradigm Shift from Fixed Scheduling to Chain-of-Trajectories (CoTj). Top: Comparison of inference mechanisms. Standard diffusion acts as a System 1 process, relying on a fixed time series that constrains potential. In contrast, CoTj introduces a System 2 approach via a CoTj-guided Optimal Planner, generating an optimized time series tailored to the input. Bottom: Real-world comparisons across modalities. In text-to-image generation (QwenImage [ 37 ] , Z-image-Turbo [ 3 ] ), CoTj achieves superior visual results under limited computational resources. In text-to-video tasks (Wan2.2 [ 35 ] ), our CoTj significantly enhances motion dynamics and realism while maintaining high spatial quality.
Figure 2: Super-Node DAG for trajectory planning. Visualization of the dense reverse-time DAG G=(V,E) , showing aggregated high-dimensional states as Super-Nodes and possible transitions as edges. The DAG encodes all feasible generative trajectories, allowing the CoTj planner to find globally optimal paths while avoiding regressive or non-convergent regions.
Figure 3: Entropic divergence patterns reveal intrinsic Diffusion DNA. Profiles of C(t) expose heterogeneous error-decay dynamics across inputs. Structurally constrained, low-entropy visual targets exhibit rapid stabilization, whereas abstract and visually uncertain compositions lead to prolonged refinement phases. The shaded region illustrates the additional computational burden induced by entropic complexity, highlighting that generative difficulty is governed primarily by intrinsic visual uncertainty rather than surface-level prompt properties (e.g., length or linguistic complexity).
Figure 4: Statistical landscape of Diffusion DNA. We analyze large-scale structural properties of difficulty profiles using 1,000,000 prompt pairs derived from the PickScore training set. (A) DNA cosine similarity distribution: pairwise similarities concentrate in a high-similarity regime, suggesting that diffusion difficulty profiles inhabit a structured region of the generative landscape. (B) Semantic–difficulty relationship: the correlation between semantic embedding similarity and DNA similarity is low ( r=0.046 ), revealing a statistical decoupling between surface-level prompt semantics and intrinsic generative difficulty.
Figure 5: Predicting Diffusion DNA from condition embeddings. Distribution of pairwise cosine similarities between predicted ( D^ ) and true DNA trajectories. The model effectively captures structural patterns of generative difficulty across low- and high-entropy scenarios, providing a reliable signal for resource-aware, System 2 trajectory planning.
Model
Params (M)
FLOPs (M)
Latency (ms)
DNA Predictor
0.96
1.93
0.073
Table 1: Efficiency of the Diffusion DNA predictor.
Model / Method
Steps
Colors
Single Obj
Two Obj
Attribute
Counting
Position
Overall ↑
Pretrained Multi-Step-Based Models (not included in main comparison)
SDXL [ 18 ]
50
0.85
0.98
0.74
0.23
0.39
0.15
0.55
PixArt- Σ [ 4 ]
20
0.80
0.98
0.59
0.15
0.50
0.10
0.52
SD3-Medium [ 7 ]
28
0.67
0.98
0.74
0.36
0.63
0.34
0.62
FLUX-Dev [ 16 ]
50
0.79
0.98
0.81
0.35
0.74
0.22
0.66
Lumina-Image-2.0 [ 26 ]
18
-
-
0.87
0.67
0.62
-
0.73
Table 2: Compositional Reasoning under Fixed-Step Planning. Performance comparison of CoTj (Ours) and baseline models on base and distilled models in text-to-image generation, evaluated using GenEval . All evaluations use a 1st-order solver, with Baseline employing Euler and CoTj (Ours) using our planned sequence. Results demonstrate that trajectory planning consistently improves reasoning performance under identical step budgets.
Figure 6: Navigating the Path of Least Action. (Center) Transition cost heatmap visualizing drift penalties and correction costs from Diffusion DNA. (Left) Low-entropy prompt: CoTj-selected trajectory of 8 steps for visualization. (Right) High-entropy prompt: CoTj-selected trajectory of 10 steps for visualization. All baseline trajectories use the same number of steps as the CoTj-selected path for fair comparison.
Figure 7: Inference Dynamics: Explained Gain Ratio ( ρ ) vs. Adaptive Sampling Steps. Mean adaptive step count as a function of the cumulative trajectory gain ρ(n) under the Qwen-Image model. Shaded regions denote the min–max range and standard deviation across 25,432 prompts. A clear transition emerges near ρ=0.99 (red dashed line), beyond which required steps grow super-linearly, indicating diminishing marginal returns. This phase transition justifies our termination criterion, capturing near-optimal reconstruction while avoiding the exponential cost of approaching ρ→1 .
Figure 8: System 2 Resource Allocation Across 25,432 Prompts (Qwen-Image). (A) Discrete timestep histogram: The Euler baseline (red) uses a uniform, input-agnostic grid, whereas CoTj (blue) adaptively distributes steps, resulting in variable, prompt-specific intervals. (B) Kernel Density Estimation (KDE): The continuous density shows Euler’s uniform placement (dashed red) versus CoTj’s adaptive allocation (solid blue), concentrating computation in early high-curvature regions where global semantic structures emerge and sparsifying late low-gradient intervals.
Method
Solver Type
Steps
GenEval ↑
Few-Step Regime (Extreme Acceleration)
Baseline
Euler (1st-Order)
5
0.428
Baseline
UCGM (High-Order)
5
0.528
CoTj (Ours)
Planned 1st-Order
5
0.626
CoTj (Ours)
UCGM (High-Order)
5
0.775
Standard Regime (Quality Saturation)
Table 3: Decoupling Trajectory Planning from Solver Complexity. Comparison of GenEval scores across trajectory schedules and solver types.
Figure 9: Visual Ablation at 5 Steps on Qwen-Image (Prompt: “a photo of an apple”). Top-Left: Baseline shows blurred structure. Top-Right: Baseline + UCGM improves silhouette but lacks texture fidelity. Bottom-Left: CoTj (1st-Order) preserves geometry and lighting. Bottom-Right: CoTj + UCGM yields the highest realism, capturing fine textures and specular highlights.
Trajectory Reachability
Steps
Method
MSE ↓
SSIM ↑
PSNR ↑
LPIPS ↓
10
Baseline
39.67
0.63
13.78
0.51
CoTj -
16.56
0.83
19.82
0.27
CoTj
15.36
0.84
20.36
0.26
17
Baseline
26.11
0.76
17.08
0.33
CoTj -
7.40
0.92
25.53
0.14
Table 4: Trajectory Reachability and Cache Adaptation. Top: Planned trajectories demonstrate Trajectory Reachability , showing how the method follows geometrically optimal paths while preserving latent structure. Bottom: Cache comparison ( Cache Adaptation ) highlights how partial representations are efficiently reused, reducing reconstruction cost and preserving fine-grained information. Even under limited resources, relevant latent traces remain accessible, suggesting that what is present can still be recovered.
Figure 10: Trajectory Condensation and Structural Reachability. Left: Step-wise L2 norm of latent states over diffusion time. Blue: Euler 50-step reference; gray dashed: Euler 10-step; red dashed: CoTj+Euler 10-step; yellow: CoTj 10-step. CoTj trajectories condense long evolutions into shorter paths while closely tracking the high-fidelity reference. Right: Visual reconstructions corresponding to each trajectory (border colors match curves on the left). Within the same 10-step budget, CoTj preserves fine-grained structures lost under uniform scheduling, showing that detailed latent information can remain accessible when the correct geometric path is followed. Even when condensed, traces of what once existed persist, recoverable by mechanisms that respect the underlying structure.
Figure 11: Qualitative comparison of 10-step structural grounding. (Top) The baseline UniPC sampler [ 42 ] exhibits erroneous motion characterized by color shifts and structural instability beginning from the first frame. (Bottom) CoTj follows a fidelity-first planning strategy, maintaining sharp textures and stable palettes before gradually introducing motion. For the emergence of full 40-step dynamics, refer to Fig. 1 .
Method
Steps
Subject Consistency ↑
Background Consistency ↑
Motion Smoothness ↑
Dynamic Degree ↑
Aesthetic Quality ↑
Imaging Quality ↑
Baseline
40
0.9522
0.9549
0.9769
0.6460
0.5820
69.1599
CoTj (Ours)
40
0.9460
0.9528
0.9784
0.6549
0.5882
68.7761
Baseline
10
0.9392
0.9493
0.9713
0.5877
0.5659
59.8147
CoTj (Ours)
10
0.9398
0.9511
0.9708
0.4912
0.5666
60.2905
Table 5: VBench evaluation on Wan2.2 ( T=49 frames). All experiments use the high-order UniPC sampler [ 42 ] . CoTj trajectories are planned using one-shot DNA derived from 40-step estimates. Best results are in bold.
Figure 12: Radiographic analysis of denoising dynamics. Curves show the dataset-averaged Diffusion DNA trajectories computed over the PickScore training set (25,432 unique prompts), ensuring consistent cross-model comparison. (Left) DNA magnitude trajectory, representing absolute step-wise reconstruction error ( ε ) across diffusion time. (Right) Step-wise reconstruction gain, isolating the temporal derivative of denoising progress. Qwen-Image exhibits strictly positive and monotonically decaying gain, indicative of stable convergence. SD3.5 shows late-stage oscillatory behavior near zero gain, reflecting corrective inefficiencies. Z-Image-Turbo displays a pronounced negative gain at t=1.0 and persistently high late-stage gain (red shaded region), revealing structural non-convergence and explaining its susceptibility to over-cooking under extended sampling. The initial negative gain further highlights why the optimal starting point for denoising may not coincide with t=1 in SDE-based models, motivating the Super-DAG planning design (Sec. 3.2 ).