cs.CVNov 2, 2026

RouteREPA: Routed Representation Alignment for Just Image Transformers

Authors: Yi Tan, Beier Zhu, Sirui Chen, Cheng Chen, Xingyu Zhu, Yuan Zhou, Zhenshan Tan, Tianrun Chen, 

Organizations: NTU · USTC · Tongji University · NUS · 

Abstract

Representation alignment (REPA) is widely used to accelerate the training of latent-space diffusion transformers (DiTs). However, applying it to pixel-space models such as Just Image Transformers (JiT) is challenging. Our analysis reveals a pronounced representation conflict between discriminative alignment and pixel-space generation. Compared with its latent counterpart, JiT learns representations that are substantially less aligned with DINOv2. Applying REPA to JiT consistently reduces the reconstructability of its intermediate representations, whereas this effect is not observed in Latent JiT. We attribute this conflict to JiT directly reconstructing pixels, which requires its representations to hierarchically encode discriminative semantics and reconstruction-relevant visual information across network depths. To address these challenges, we propose Routed Representation Alignment (RouteREPA), which uses lightweight, representation-dependent routers to adaptively route task-oriented representations for alignment and generation. We further apply routing across multiple network depths to accommodate their depth-dependent representation requirements. Extensive experiments on ImageNet-1K at 256x256 resolution show that RouteREPA consistently improves JiT across model scales and training budgets, outperforming standard REPA. On JiT-H/16, RouteREPA further surpasses PixelREPA using only one-third of its training epochs without classifier-free guidance.

Figures & tables

Appendix figures & tables12 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Representation Alignment for Just Image Transformers is not Easier than You Think

    Mar 15, 2026Jaeyo Shin, Jiwook Kim, Hyunjung ShimDiffusion ModelsDiffusion Model Alignment

  2. Just Image Transformers with Late-Stage Pixel Refinement

    Nov 9, 2026Denis Lukovnikov, Andreas Müller, Asja FischerDiffusion-Based Image GenerationDiffusion Transformer

  3. Beyond Point-Wise Matching: Structural Representation Alignment for Accelerating Diffusion Transformers

    May 16, 2026Shaodong Xu, Zhendong Wang, Litong Gong +4Diffusion Model AlignmentDiffusion Transformer