Diffusion Transformer

Also known as DiT

Overview

Diffusion Transformers (DiTs) use transformer networks to turn noise into data, typically by repeatedly predicting denoising updates or following a learned flow. Work explores latent- and pixel-space models, conditioning through text, images, geometry, or other modalities, and representation-learning methods that improve generation and downstream perception. To lower the cost of training and inference, researchers use sparse attention, token reduction, caching, quantization, distillation, and hardware-aware designs. A central challenge is balancing speed, memory, and model size against fidelity, temporal or spatial consistency, and reliable performance across tasks and benchmarks.

Latest papers

CardsList

519 papers46 papers in the last four weeks, down 47% on the four weeks before. 0.3% of all new papers.

  1. RL Post-Training in Diffusion Transformers Is Activation Steering

    Nov 19, 2026Tuna Han Salih Meral, Kaan Oktay, Alec Helbling +3RL Post-TrainingRL for Diffusion Models

  2. Direct3D-V3: Latent-Free Diffusion Transformers in the Native Voxel Domain

    Nov 19, 2026Shuang Wu, Jiachen Qian, Youtian Lin +43D Diffusion Models3D Mesh Generation

  3. Asuka-FM: A System-Architectural Co-Design Framework for Efficient Text-to-Image Pretraining on Consumer Hardware

    Nov 19, 2026Víctor Rodrigo González, Pablo M. Olmos, Ignacio Peis +1T2I Diffusion ModelsDiffusion Transformer

  4. Online Temporal Rotations for 2 Bit KV-Cache Quantization in Video Diffusion Transformers

    Nov 19, 2026Ryan Lucas, Petros Prastakos, Rahul MazumderKV-Cache QuantizationDiffusion Model Quantization

  5. D3-Cache: Accelerating Diffusion Models with Dynamic Mode Decomposition

    Nov 19, 2026Yanbo Li, An Xiang, Xiaoxin Hu +4Diffusion Model Inference AccelerationDiffusion Model Caching

  6. CalibCache: Cache-to-Full Feature Dynamics Calibration for Diffusion Transformers

    Nov 18, 2026Mingyu Liang, Dingkun Xu, Jingwei XuDiffusion-Based Image GenerationDiffusion Model Caching

  7. Every Query Routes Itself: Accelerating Video Diffusion Transformers with Per-Query Routed Sparse Attention

    Nov 18, 2026Zhen Huang, Shuwei Li, Ruizhe Yao +9Sparse AttentionDiffusion Model Inference Acceleration

  8. Where Should a Diffusion Transformer Meet Its Teacher?

    Nov 18, 2026Zhuoqi Hu, Shiwei Li, Haozhao Wang +7Diffusion TransformerRepresentation Alignment

  9. Spark-H3: Adaptive Block Sparse Attention for Video Diffusion Models

    Nov 18, 2026Zecheng Tang, Jiaye Fu, Youtian Lin +5Block-Sparse AttentionDiffusion Model Inference Acceleration

  10. Hierarchical Diffusion Transformer for End-to-End Image Generation

    Nov 17, 2026Xiaoyu Wu, Yifei Wang, Weihang Guo +4Diffusion-Based Image GenerationDiffusion Models

  11. LoopPrune: Recurrent Pruning for Looped Diffusion Transformers

    Nov 17, 2026Weizhong Huang, Huaijia Kou, Yan Zhang +3Diffusion Model PruningDiffusion Transformer

  12. Decoding Without a Decoder: Direct Pixel Prediction from Diffusion Transformers

    Nov 17, 2026Hansheng Chen, Shengqu Cai, Jan Ackermann +4Diffusion ModelsDiffusion Transformer

  13. QASK-Edit: Adaptive Sparse Attention Across Queries and Key Sources for Efficient Video Editing

    Nov 16, 2026Hengrui Liu, Wenbo Xu, Ziqi Sheng +1Sparse AttentionDiffusion-Based Video Editing

  14. Few-Shot Visual Concept Extraction for Steering Diffusion Transformers

    Nov 14, 2026Nabyl Quignon, Antitza DantchevaControllable Image GenerationActivation Steering

  15. dit.xpu : Taming DiT Sparse Inference on Mobile SoCs

    Nov 14, 2026Jiayu Chen, Jinye Hu, Maoliang Li +8Diffusion Model Inference AccelerationOn-Device Inference

  16. Beyond Alignment: Supervising the Generator for EEG-to-Image Reconstruction

    Nov 14, 2026Sangmin Jo, Wootaek Jeong, Heung-Il SukEEG-to-Image ReconstructionEEG-Based Visual Decoding

  17. Role-Separated Diffusion Transformers: Global Rule Isolation and Deterministic Sampling Manifold Compression

    Nov 13, 2026Zhiguang Liu, Yi ShangDiffusion TransformerDiffusion Models

  18. JVT: Just Video Transformer makes pixel-space video diffusion simple

    Nov 13, 2026Jianjun Zhou, Hua Geng, Haoyu GuoVideo Diffusion ModelsPixel-Space Diffusion Models

  19. Graph diffusion transformer for interpretable generation and inverse design of disordered atomic structures

    Nov 13, 2026Jiani Hu, Chenyan Wang, Yongkun Yang +4Materials ScienceInverse Design

  20. Thompson Sampling using Prior-fitted Diffusion Transformers

    Nov 10, 2026Sihwa Park, Jingsen Zhu, Vinamr Jain +2Thompson SamplingBlack-Box Optimization

  21. Just Image Transformers with Late-Stage Pixel Refinement

    Nov 9, 2026Denis Lukovnikov, Andreas Müller, Asja FischerDiffusion-Based Image GenerationDiffusion Transformer

  22. What kills vv-prediction? A Patch-wise PCA Perspective on Pixel-Space Flow Matching

    Nov 9, 2026Tianze Luo, Haofeng Huang, Yuan YaoFlow MatchingDiffusion Transformer

  23. MPEG-Diffusion: Mixed-Resolution Video Generation

    Nov 9, 2026Dennis Menn, Tianpei Gu, Guande He +7Video Diffusion ModelsEfficient Video Generation

  24. MG-Cache: Multi-Granularity Caching for Accelerating Diffusion Transformer Inference

    Nov 8, 2026Zesen Chen, Youxuan Xu, Shigang LiDiffusion Model Inference AccelerationDiffusion Model Caching

  25. FADE: Fractional Anomalous Dynamics Extrapolation for Training-Free Diffusion Transformers Acceleration

    Nov 7, 2026Jinlong Yang, Lizilin, Jinke Wu +1Diffusion Model AccelerationDiffusion Model Inference Acceleration

  26. IdealCache: Rethinking Cache Scheduling in Diffusion Transformers via Ideal Trajectories

    Nov 7, 2026Shang Xue, Li Zhu, Ping ChenDiffusion Model CachingDiffusion Model Acceleration