cs.CVNov 18, 2026

Where Should a Diffusion Transformer Meet Its Teacher?

Authors: Zhuoqi Hu, Shiwei Li, Haozhao Wang, Xiandi Luo, Yihao Ouyang, Wenting Shen, Ang Wang, Jiamang Wang, 

Organizations: Huazhong University of Science and Technology · Alibaba Group · Shanghai Jiao Tong University

Abstract

Representation Alignment (REPA) significantly accelerates Diffusion Transformer training by guiding intermediate student features with a pretrained visual teacher, yet existing methods typically attach supervision to a single fixed layer. As student representations evolve, however, we find that the most effective layer for alignment varies across training stages. To track this evolving layer suitability online without costly search, we measure gradient compatibility between the flow-matching and alignment objectives, and propose AdaREPA, an online routing framework that adaptively selects the supervision layer as training progresses. AdaREPA uses a softmax distribution over smoothed layer compatibility scores to sample a layer for alignment at each training step. This probabilistic routing adapts teacher supervision to the student's changing learning needs, with minimal training overhead and no additional inference cost. On ImageNet-256, AdaREPA accelerates convergence and improves generation quality across model sizes, while revealing how the most suitable layers for supervision shift over training.

Figures & tables

Explore similar work

CardsList
  1. What Visual Generators Need from Teachers: Rethinking Representation Alignment

    Sep 28, 2026Yongcong Wang, Hingchin Chen, Mingyu Fan +6Diffusion Model AlignmentDiffusion Transformer

  2. Representation Conditioning for Generation

    Oct 14, 2026Saeed Razavi, Xingjian Leng, Liang ZhengDiffusion-Based Image GenerationDiffusion Transformer

  3. AHPA: Adaptive Hierarchical Prior Alignment for Diffusion Transformers

    May 5, 2026Ruibin Min, Yexin Liu, Aimin Pan +5Diffusion Model AlignmentDiffusion Transformer