cs.CVJun 21, 2026

Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectories

Authors: Merve KocabasGege GaoBernhard SchölkopfAndreas Geiger

Organizations: University of Tübingen, Tübingen, Germany · Max Planck Institute for Intelligent Systems, Tübingen, Germany · ETH Zürich, Zürich, Switzerland · ELLIS Institute, Tübingen, Germany · Tübingen AI Center, Tübingen, Germany

Abstract

Diffusion and flow-based generative models produce strong images, yet their controllability remains largely endpoint-centric: users specify conditions and receive final outputs, while the intermediate generative dynamics remain hidden. Recent methods have begun to exploit generation order and process decomposition to improve sample quality, but still treat intermediate states as internal computation rather than objects for interaction. We propose Trajectory Forcing (TF), a trajectory-centric framework that makes the generation path explicit, semantic, and editable. TF organizes synthesis as a sequence of semantically structured stages, progressing from global layout to object-, part-, and detail-level representations. Each stage produces a decodable latent state that can be inspected, evaluated, and locally edited before the next stage begins. To instantiate this path, we derive coarse-to-fine teacher hierarchies by clustering pretrained visual representations such as DINOv2, and train a hierarchy-conditioned one-step flow-matching model at each level. We further introduce trajectory-aware metrics that measure structural consistency and local controllability beyond endpoint quality metrics such as FID. Experiments show that TF achieves competitive sample quality while exposing coherent intermediate states and supporting localized edits across semantic levels. By shifting the focus from final images to the generative path itself, TF opens a route toward controllable, trajectory-aware image synthesis.

Explore similar work

CardsList
  1. Normalizing Trajectory Models

    May 8, 2026Jiatao Gu, Tianrong Chen, Ying Shen +3Denoising TrajectoryNormalizing Flows

  2. Follow the Mean: Reference-Guided Flow Matching

    May 11, 2026Pedro M. P. Curvo, Maksim Zhdanov, Floor Eijkelboom +1Generative Flow NetworksNeural Guidance