Diffusion Transformer

Also known as DiT

Ask about this topic

Overview

Diffusion Transformers (DiTs) use transformer networks to turn noise into data, typically by repeatedly predicting denoising updates or following a learned flow. Work explores latent- and pixel-space models, conditioning through text, images, geometry, or other modalities, and representation-learning methods that improve generation and downstream perception. To lower the cost of training and inference, researchers use sparse attention, token reduction, caching, quantization, distillation, and hardware-aware designs. A central challenge is balancing speed, memory, and model size against fidelity, temporal or spatial consistency, and reliable performance across tasks and benchmarks.

Latest papers

CardsList

473 papers78 papers in the last four weeks, up 100% on the four weeks before. 0.5% of all new papers.

  1. Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers

    Mar 11, 2026Wenhao Sun, Ji Li, Zhaoqiang LiuDiffusion Model Inference AccelerationDiffusion Models

    University of Electronic Science and Technology of China · Capital Normal University

  2. Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers

    Mar 11, 2026Yuntao Shou, Xiangyong Cao, Qian Zhao +1Image GenerationMedical Image Synthesis

    Xi’an Jiaotong University

  3. FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generation

    Mar 10, 2026Minh Khoa Le, Kien Do, Duc Thanh Nguyen +1Efficient Video GenerationVideo Diffusion Models

    Applied Artificial Intelligence Initiative, Deakin University, Australia · FPT Smart Cloud, Vietnam · Deakin University, Australia

  4. When to Lock Attention: Training-Free KV Control in Video Diffusion

    Mar 10, 2026Tianyi Zeng, Jincheng Gao, Tianyi Wang +8Video Diffusion ModelsVideo Editing

    Shanghai Jiao Tong University, Shanghai, China · Tongji University, Shanghai, China · The University of Texas at Austin, Austin, TX, USA +3

  5. BinaryAttention: One-Bit QK-Attention for Vision and Diffusion Transformers

    Mar 10, 2026Chaodong Xiao, Zhengqiang Zhang, Lei ZhangAttention QuantizationAttention Mechanisms

    The Hong Kong Polytechnic University · OPPO Research Institute

  6. RAE-NWM: Navigation World Model in Dense Visual Representation Space

    Mar 10, 2026Mingkun Zhang, Wangtian Shen, Fan Zhang +3Visual NavigationWorld Model Learning

    Department of Precision Instrument, Tsinghua University, Beijing, China · University of Rochester, Rochester, NY, USA · Beijing Information Science and Technology University, Beijing, China

  7. TIDE: Text-Informed Dynamic Extrapolation with Step-Aware Temperature Control for Diffusion Transformers

    Mar 9, 2026Yihua Liu, Fanjiang Ye, Bowen Lin +2T2I Diffusion ModelsDiffusion Transformer

    Independent Researcher · Rice University · University of Houston

  8. Contact-Guided 3D Genome Structure Generation of E. coli via Diffusion Transformers

    Mar 8, 2026Mingxin Zhang, Xiaofeng Dai, Yu Yao +1GenomicsConditional Diffusion Models

    The University of Tokyo · The University of Michigan · Waseda University

  9. SODA: Sensitivity-Oriented Dynamic Acceleration for Diffusion Transformer

    Mar 7, 2026Tong Shao, Yusen Fu, Guoying Sun +3Diffusion Model Inference AccelerationDiffusion-Based Image Generation

    Harbin Institute of Technology, Shenzhen

  10. DC-DiT: Adaptive Compute and Elastic Inference for Visual Generation via Dynamic Chunking

    Mar 6, 2026Akash Haridas, Utkarsh Saxena, Parsa Ashrafi Fashi +3Adaptive TokenizationDiffusion Transformer

    Advanced Micro Devices Inc. (AMD)

  11. Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution

    Mar 6, 2026Jingkai Wang, Yixin Tang, Jue Gong +6Diffusion TransformerDiffusion Model Distillation

    Shanghai Jiao Tong University, China · Shenzhen Transsion Holdings Co., Ltd., China

  12. Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers

    Mar 6, 2026Ruidong Chen, Yancheng Bai, Xuanpu Zhang +6Controllable Image GenerationCompositional T2I Generation

    Tianjin University · Independent Researcher

  13. Accelerating Text-to-Video Generation with Calibrated Sparse Attention

    Mar 5, 2026Shai Yehezkel, Shahar Yadin, Noam Elata +2Diffusion Model Inference AccelerationT2V Generation

    Apple · Tel Aviv University

  14. Frequency-Aware Error-Bounded Caching for Accelerating Diffusion Transformers

    Mar 5, 2026Guandong LiDiffusion Model CachingDiffusion Model Inference Acceleration

    iFLYTEK

  15. DiverseDiT: Towards Diverse Representation Learning in Diffusion Transformers

    Mar 4, 2026Mengping Yang, Zhiyu Tan, Binglei Li +3Diffusion TransformerDiffusion Models

    Fudan University · Shanghai Academy of AI for Science · Shanghai Innovation Institute

  16. COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data

    Mar 3, 2026Miguel Espinosa, Eva Gmelich Meijling, Valerio Marsocci +2Conditional Generative ModelingMultimodal Diffusion Models

    School of Engineering, University of Edinburgh · European Space Agency (ESA) · Asterisk Labs

  17. SemanticDialect: Semantic-Aware Mixed-Format Quantization for Video Diffusion Transformers

    Mar 3, 2026Wonsuk Jang, Thierry TambeDiffusion Model QuantizationNeural Network Quantization

    Stanford University

  18. TerraDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesis

    Mar 2, 2026Srikumar Sastry, Dan Cher, Brian Wei +4Diffusion TransformerControllable Image Generation

    Washington University, St. Louis MO 63130, USA

  19. Accelerating Video Generation Inference with Sequential-Parallel 3D Positional Encoding Using a Global Time Index

    Mar 2, 2026Chao Yuan, Pan LiDiffusion Model Inference AccelerationAutoregressive Video Generation

  20. Investigating Group Relative Policy Optimization for Diffusion Transformer based Text-to-Audio Generation

    Mar 2, 2026Yi Gu, Yanqing Liu, Chen Yang +1Text-to-Audio GenerationRL for Diffusion Models

    Tsinghua University · Microsoft

  21. Jano: Adaptive Diffusion Generation with Early-stage Convergence Awareness

    Feb 28, 2026Yuyang Chen, Linqian Zeng, Yijin ZHou +2Diffusion Timestep SchedulingDiffusion Model Inference Acceleration

    Shanghai Jiaotong University · Tsinghua University

  22. NNiT: Width-Agnostic Neural Network Generation with Structurally Aligned Weight Spaces

    Feb 26, 2026Jiwoo Kim, Swarajh Mehta, Hao-Lun Hsu +3Diffusion TransformerNeural Network Generalization

    Department of Electrical and Computer Engineering, Duke University, NC, USA · Department of Computer Science, Duke University, NC, USA · Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, MA, USA

  23. Absorbing Discrete Diffusion for Speech Enhancement

    Feb 25, 2026Philippe GonzalezSpeech EnhancementDiffusion Models

    Department of Health Technology, Technical University of Denmark

  24. A Hidden Semantic Bottleneck in Conditional Embeddings of Diffusion Transformers

    Feb 25, 2026Trung X. Pham, Kang Zhang, Ji Woo Hong +1Diffusion TransformerConditional Diffusion Models

    Korea Advanced Institute of Science and Technology (KAIST)

  25. LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration

    Feb 24, 2026Peiliang Cai, Jiacheng Liu, Haowen Xu +3Diffusion Model Inference AccelerationDiffusion Models

    Shanghai Jiao Tong University

  26. Relational Feature Caching for Accelerating Diffusion Transformers

    Feb 23, 2026Byunggwan Son, Jeimin Jeon, Jeongwoo Choi +1Diffusion Model CachingDiffusion Model Inference Acceleration

    Yonsei University · Korea Institute of Science and Technology (KIST)

  27. Exploiting Completeness Perception with Diffusion Transformer for Unified 3D MRI Synthesis

    Feb 20, 2026Junkai Liu, Nay Aung, Theodoros N. Arvanitis +3Medical Image Synthesis3D Medical Imaging

    School of Engineering, University of Birmingham, UK · William Harvey Research Institute, Queen Mary University London, UK · Barts Heart Centre, St Bartholomew’s Hospital, Barts Health NHS Trust, UK +1

  28. Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformers

    Feb 20, 2026Hanshuai Cui, Zhiqing Tang, Qianli Ma +3Diffusion Model AccelerationDiffusion Sampling

    School of Artificial Intelligence, Beijing Normal University, Beijing, China · Institute of Artificial Intelligence and Future Networks, Beijing Normal University, Zhuhai, China · Shenzhen University of Advanced Technology, Shenzhen, China

  29. Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformers

    Feb 20, 2026Guandong LiDiffusion-Based Image EditingDiffusion Model Guidance

    iFLYTEK

  30. CORAL: Correspondence Alignment for Improved Virtual Try-On

    Feb 19, 2026Jiyoung Kim, Youngjin Shin, Siyoon Jin +6Virtual Try-OnDiffusion Model Alignment

    KAIST AI · NC AI Co., Ltd.