Diffusion Transformer

Also known as DiT

Follow this topic Ask about this topic

Momentum

35 papers in the last four weeks, up 169% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 297

All topics

TSGate: Timestep-Aware Gated Attention for Diffusion Transformers
Sep 28, 2026Boyu Zhang, Yifan Liu, Shuxia Lin +3Diffusion Transformer Gated Attention
Alibaba Token Hub, Alibaba Group · Southeast University
SAGE: Subspace Alignment for Classifier-Free Guidance in Mixture-of-Experts Diffusion Models
Sep 28, 2026Boyu Zhang, Yangming Cheng, Ning Zhang +5Classifier-Free Guidance Diffusion Transformer
Alibaba Token Hub, Alibaba Group
KiT: A Foundation Model for Financial Time-Series Forecasting using DiffusionTransformers
Sep 28, 2026Boyu Zhang, Haorui LiDiffusion Transformer Financial Forecasting
University of California, Los Angeles · Southeast University
Residual-Stream Burden Shapes Representation Learning in Diffusion Transformers
Sep 27, 2026Tongtong Liang, Siqi Kou, Ziqiao Xi +6Diffusion Transformer Residual Learning
UC San Diego · Shanghai Jiao Tong University · Aether AI
GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code
Sep 27, 2026Haosen Li, Wenshuo Chen, Shaofeng Liang +3Video Diffusion Models Diffusion Transformer
The Hong Kong University of Science and Technology (Guangzhou) · Griffith University · Data61, CSIRO +1
Fill2SR: Repurposing Inpainting Diffusion Transformers for Real-World Super-Resolution
Sep 27, 2026Xingfu Yi, Xiaoxue YuDiffusion Models for Image Restoration Diffusion Transformer
Independent Researcher, Hangzhou, China · Zhejiang University, Hangzhou, China
In-Token Learning for High-Fidelity Image Restoration via Diffusion Transformers
Sep 27, 2026Xingfu Yi, Xiaoxue YuImage-to-Image Translation Diffusion Transformer
Independent Researcher, Hangzhou, China · Zhejiang University, Hangzhou, China
PulseQuant: Propagation-Guided Subspace Correction for 4-Bit Video Diffusion Transformers
Sep 27, 2026Yutong Wang, Xingtong Ge, Enhuai Liu +4Video Diffusion Models Diffusion Transformer
The University of Sydney · The Hong Kong University of Science and Technology · The Chinese University of Hong Kong +1
PixelDiT2: Representation-Grounded Pixel Diffusion Transformers
Sep 21, 2026Yongsheng Yu, Wei Xiong, Yichen Sheng +2Diffusion Model Guidance Diffusion Transformer
NVIDIA · University of Rochester
SlotDiT: Object-Centric Representations for Diffusion Transformers
Sep 15, 2026Gjergj Plepi, Sven BehnkeDiffusion Transformer Latent Diffusion Models
Autonomous Intelligent Systems, Computer Science Institute VI – Intelligent Systems and Robotics, Center for Robotics and the Lamarr Institute for Machine Learning and Artificial Intelligence, University of Bonn, Germany
LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows
Sep 14, 2026Xiaofeng Mao, Peijia Lin, Shaohao Rui +3Diffusion Transformer Long Video Generation
LynnReal AI
VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention
Sep 14, 2026Xingyang Li, Dongyun Zou, Shining Zhang +8Video Diffusion Models Diffusion Transformer
2MIT · 1Nunchux AI · 3CMU +3
Exploring Diffusion Transformers for Cross-Modal Augmentation in Multimodal Brain State Decoding
Sep 12, 2026Ziwei Wang, Xingyi He, Hongbin Wang +3Data Augmentation Diffusion Transformer
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, China
Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation
Sep 11, 2026Niange Yu, Ye Tian, Biaolong Chen +5Diffusion Transformer Identity-Preserving Video Generation
Alibaba Group · Peking University
AcFlow: Controlling Text-to-Image Diffusion Transformers via Learned Conditional Activation Flow
Sep 9, 2026Junran Wang, Zehao Jin, Tianyu Luan +3Diffusion Transformer T2I Generation
Georgia Institute of technology · South China University of Technology
Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
Sep 8, 2026Igor Pavlovic, Thiemo Wandel, Anton Obukhov +6Diffusion Transformer OOD Generalization
EPFL, HUAWEI Bayer Lab, Switzerland · HUAWEI Bayer Lab, Switzerland · University of Bologna, Italy +1
RoLA: Rotary-Positioned Low-Rank Linear Attention for Efficient Diffusion Transformers
Sep 6, 2026Zekun Zhang, Yixiang Cai, Yuxi Liu +9Rotary Positional Embeddings Low-Rank Attention
Peking University, Melon Group · Alibaba Group · University of Electronic Science and Technology of China +1
SPARK: Input-Conditioned Sparse Activation Modulation for Frozen DiT-based Super-Resolution
Sep 3, 2026Federico Putamorsi, Leonardo Zini, Marcella Cornia +1Diffusion Models for Image Restoration Diffusion Transformer
University of Modena and Reggio Emilia, Italy
LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes
Sep 3, 2026Chuyan Chen, Haoxing Chen, Kun Chen +27Diffusion Transformer T2I Diffusion Models
AGI Research Center, Inclusion AI
GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors
Sep 2, 2026Qiang Xiang, Shuang Sun, Binglei Li +4T2I Generation Image Editing
Fudan University · Xiaohongshu Inc. · Shanghai Innovation Institute
ReFlowSET: Representation-Aligned Latent Flow Matching for SAR-to-EO Image Translation
Sep 1, 2026Jeonghyeok Do, Seungchul Lee, Munchurl KimFlow Matching Image-to-Image Translation
KAIST · Stellarvision Inc.
Beyond Attention Masks: Instruction Anchoring for Efficient In-Context Diffusion Generation
Aug 21, 2026Yangshuai Liu, Zheming Li, Jiaao Li +4Diffusion Transformer Diffusion Model Caching
Harbin Institute of Technology · KlingAI Research
Spatially-Grounded Text-to-Video Generation via Inference-Time Gradient-Free Optimization
Aug 13, 2026Guillaume Jeanneret, Mathis Koroglu, Hugo Caselles-Dupré +2Diffusion Transformer Text-to-Video Generation
ISIR - Sorbonne Université, France · Obvious Research, France · Valeo.ai, France
SCOPE: Subspace Clustering with Online Per-Head Top-K Estimation for Sparse Video Attention
Aug 13, 2026Qi Zhao, Qirui Li, Hanlin Tang +10Video Diffusion Models Diffusion Transformer
Zhejiang University · Alibaba Group
LoSA: Near-Lossless Sparse Attention for Training-Free Video Diffusion Acceleration
Aug 12, 2026Enhuai Liu, Yunke Wang, Yutong Wang +2Video Diffusion Models Diffusion Transformer
1The University of Sydney · 2CSIRO
LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time
Aug 12, 2026Yuxuan Zhang, Haozhong Xiong, Yubo Huang +6Diffusion Transformer Real-Time Interactive Video Generation
The Chinese University of Hong Kong · Qwen Applications Business Group of Alibaba · Liblib AI
Unveiling the Secret of AdaLN-Zero in Diffusion Transformer
Aug 10, 2026Jie Zhu, Mingyu Ding, Boqiang Duan +2Diffusion Transformer Neural Network Initialization
Key Lab of High Confidence Software Technologies (Peking University), Ministry of Education, China, and School of Computer Science, Peking University, China. · UC Berkeley · Baidu, Beijing, China
BAG: Budget-Aware Gating for Diffusion Caching
Aug 10, 2026Tong Zhao, Mingkun Lei, Yucheng Han +1Diffusion Transformer Diffusion Model Caching
Zhejiang University · AGI Lab, Westlake University · StepFun
When Latents Forget Pixels: Restoring Fidelity in Diffusion Transformer Super-Resolution
Aug 10, 2026Yu Shi, Yuyao Zhang, Yu-wing TaiDiffusion Model Guidance Diffusion Transformer
Dartmouth College
Representation-driven Endoscopic Visual Embedding Alignment for Latent Generation
Aug 7, 2026Francisco Caetano, Tim J. M. Jaspers, Haiko Middeljans +7Endoscopy Diffusion Transformer
Department of Electrical Engineering, ARIA Lab, Eindhoven University of Technology, Eindhoven, The Netherlands · Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands

Sep 28, 2026, cs.CVJ/K move · Enter open · S save

TSGate: Timestep-Aware Gated Attention for Diffusion Transformers

Boyu Zhang, Yifan Liu, Shuxia Lin, Qingjian Ni+2

Alibaba Token Hub, Alibaba Group · Southeast University

Diffusion Transformer Gated Attention T2I Generation Attention Control in Diffusion Models Attention Mechanisms T2I Diffusion Models

Open paper AskPDF arXiv

Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-fidelity image and video generation. Recent DiT systems increasingly use structured prompts for training, improving caption quality and prompt adherence. However, their generation quality can degrade severely under out-of-domain (OOD) prompts, including the free-form descriptions supplied by users at inference time. Although LLM-based rewriting can convert these prompts into structured formats, it does not guarantee that the rewritten prompts align with the training distribution. Our analysis links this degradation to attention sinks and reduced early-step image-to-text attention and shows that sink suppression alone is insufficient to restore generation quality. Despite effective sink suppression, models trained with standard gated attention exhibit reduced early-step image-to-text attention and suboptimal generation quality. Based on these insights, we propose Timestep-Aware Gated Attention (TSGate), which injects a timestep-conditioned bias into the gate signal so that gating behavior adapts across denoising steps. Extensive experiments show that TSGate consistently outperforms both the baseline and standard gated attention across multiple benchmarks, improving the raw-prompt DPG score by 9.5% over the baseline.

Momentum

Related topics

Latest papers 297