Diffusion Transformer

Also known as DiT

Follow this topic Ask about this topic

Momentum

35 papers in the last four weeks, up 169% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 297

All topics

ChunkFlow: Communication-Aware Chunked Prefetching for Layerwise Offloading in Distributed Diffusion Transformer Inference
May 11, 2026Han Meng, Danny Willow Liu, Dong LiDiffusion Transformer GPU Acceleration
University of California, Merced · University of Chicago · University of California, Merced and Yotta Labs +1
HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformer
May 11, 2026Qi Cai, Jingwen Chen, Chengmin Gao +22Diffusion Transformer Text-Guided Image Editing
What Concepts Lie Within? Detecting and Suppressing Risky Content in Diffusion Transformers
May 11, 2026Chenyu ZhangDiffusion Transformer T2I Generation
Tianjin University · Tianjin, China
Attention Sinks in Diffusion Transformers: A Causal Analysis
May 10, 2026Fangzheng Wu, Brian SummaTransformer Interpretability Diffusion Transformer
Department of Computer Science, Tulane University, New Orleans, LA, USA.
Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
May 10, 2026Leduo Chen, Junchuan Zhao, Shengchen LiDiffusion Transformer Controllable Music Generation
XJTLU
BRIDGE: Background Routing and Isolated Discrete Gating for Coarse-Mask Local Editing
May 8, 2026Peilin Xiong, Honghui Yuan, Junwen Chen +1Diffusion Transformer Positional Encoding
Department of Informatics, The University of Electro-Communications, Tokyo, Japan
TextLDM: Language Modeling with Continuous Latent Diffusion
May 8, 2026Jiaxiu Jiang, Jingjing Ren, Wenbo Li +10Diffusion Transformer Latent Diffusion Models
Joy Future Academy · HIT · HKUST(GZ)
EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing
May 8, 2026Lan Chen, Qi Mao, Yiren Song +2Diffusion Transformer Diffusion Model Fine-Tuning
School of Information and Communication Engineering and the State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China · ShowLab, National University of Singapore, 119077, Singapore · State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University, Beijing 100871, China
Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generation
May 7, 2026Ernie Chu, Vishal M. PatelVideo Diffusion Models Diffusion Transformer
Johns Hopkins University Baltimore, MD 21218
Continuous Latent Diffusion Language Model
May 7, 2026Hongcan Guo, Qinyu Zhao, Yian Zhao +8Non-Autoregressive Text Generation Diffusion Transformer
ByteDance Seed · The Australian National University · Peking University +2
Why Do DiT Editors Drift? Plug-and-Play Low Frequency Alignment in VAE Latent Space
May 7, 2026Xiaoce Wang, Sifan Zhou, Kaifei Wang +4Diffusion Transformer Diffusion-Based Image Editing
♠Tsinghua University · ♡Carnegie Mellon University · ♢Peking University +3
Mean Mode Screaming: Mean--Variance Split Residuals for 1000-Layer Diffusion Transformers
May 7, 2026Pengqi LuDeep Learning Optimization Representation Collapse
Beijing, China
Taming Outlier Tokens in Diffusion Transformers
May 6, 2026Xiaoyu Wu, Yifei Wang, Tsu-Jui Fu +3Diffusion Transformer Activation Outliers
Rice University · Apple
Concurrence of Symmetry Breaking and Nonlocality Phase Transitions in Diffusion Models
May 6, 2026Yifan F. Zhang, Fangjun Hu, Guangkuo Liu +2Diffusion Transformer Symmetry Breaking
Department of Electrical and Computer Engineering Princeton University Princeton, NJ 08544, USA · QuEra Computing Inc. 1284 Soldiers Field Road, Boston, MA 02135, USA · JILA and Department of Physics University of Colorado Boulder Boulder, CO 80309, USA +1
AHPA: Adaptive Hierarchical Prior Alignment for Diffusion Transformers
May 5, 2026Ruibin Min, Yexin Liu, Aimin Pan +5Diffusion Model Alignment Diffusion Transformer
Sun Yat-sen University · The Hong Kong University of Science and Technology · VNET Group +2
Ortho-Hydra: Orthogonalized Experts for DiT LoRA
May 5, 2026Seunghyun JiFine-Tuning Diffusion Transformer
Mamoda2.5: Enhancing Unified Multimodal Model with DiT-MoE
May 4, 2026Yangming Shi, Shixiang Zhu, Tao Shen +14Diffusion Transformer Unified Multimodal Models
Mamoda Team, ByteDance
AttnRouter: Per-Category Attention Routing for Training-Free Image Editing on MMDiT
May 2, 2026Guandong Li, Mengxia YeDiffusion Transformer Text-Guided Image Editing
iFLYTEK · Aegon THTF
Soft Graph Diffusion Transformer for MIMO Detection
May 1, 2026Nan Jiang, Jiadong Hong, Lei Liu +3Diffusion Transformer Wireless Communications
College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China · Theory Lab, Central Research Institute, 2012 Labs, Huawei Technologies Co., Ltd., Hong Kong, China
YOSE: You Only Select Essential Tokens for Efficient DiT-based Video Object Removal
Apr 30, 2026Chenyang Wu, Lina Lei, Fan Li +6Diffusion Transformer Video Editing
1VCIP, CS, Nankai University · 3NKIARI, Shenzhen Futian · 2Huawei Noah’s Ark Lab
Beyond Fixed Formulas: Data-Driven Linear Predictor for Efficient Diffusion Models
Apr 29, 2026Zhirong Shen, Rui Huang, Jiacheng Liu +6Diffusion Transformer Diffusion Model Caching
Shanghai Jiao Tong University · University of Electronic Science and Technology of China · Shandong University +2
The Thinking Pixel: Recursive Sparse Reasoning in Multimodal Diffusion Latents
Apr 28, 2026Yuwei Sun, Yuxuan Yao, Hui Li +1Diffusion Transformer Conditional Image Generation
Shanghai Academy of AI for Science · Fudan University
Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing
Apr 26, 2026Honghao Cai, Xiangyuan Wang, Yunhao Bai +8Diffusion Transformer Text-Guided Image Editing
The Chinese University of Hong Kong, Shenzhen · Xiaohongshu Inc. · Peking University +2
Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling
Apr 26, 2026Zhen Ye, Xu Tan, Aoxiong Yin +8Cross-Modal Learning Audio-Video Generation
Hong Kong University of Science and Technology · Independent Researcher · Zhejiang University +3
OccDirector: Language-Guided Behavior and Interaction Generation in 4D Occupancy Space
Apr 24, 2026Zhuding Liang, Tianyi Yan, Dubing Chen +6Diffusion Transformer Multi-Agent Systems
SKL-IOTSC, CIS, University of Macau, Macau, China · Li Auto Inc, Beijing, China
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions
Apr 24, 2026Chunyu Qiang, Xiaopeng Wang, Kang Yin +11Text-to-Music Generation Text-to-Audio Generation
1Tianjin University, Tianjin, China · 2Kling Team, Kuaishou Technology, Beijing, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China
Sculpt4D: Generating 4D Shapes via Sparse-Attention Diffusion Transformers
Apr 23, 2026Minghao Yin, Wenbo Hu, Jiale Xu +2Diffusion Transformer 3D Shape Generation
1The University of Hong Kong · 2ARC Lab, Tencent PCG
GeoRelight: Learning Joint Geometrical Relighting and Reconstruction with Flexible Multi-Modal Diffusion Transformers
Apr 22, 2026Yuxuan Xue, Ruofan Liang, Egor Zakharov +6Image-to-Image Translation Diffusion Transformer
Codec Avatars Lab, Meta · University of Tübingen · Max Planck Institute for Informatics, Saarland Informatics Campus
AdaCluster: Adaptive Query-Key Clustering for Sparse Attention in Video Generation
Apr 20, 2026Haoyue Tan, Shengnan Wang, Yulin Qiao +5Video Diffusion Models Diffusion Transformer
University of Science and Technology of China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center · 3Independent Researcher +2
LoRaQ: Optimized Low Rank Approximation for 4-bit Quantization
Apr 20, 2026Yann Bouquet, Alireza Khodamoradi, Sophie Yáng Shen +2Mixed-Precision Quantization Diffusion Transformer
Research and Advancement Development Team, Advanced Micro Devices, Inc, USA · Computer Vision Laboratory, Ecole Polytechnique F´ed´erale de Lausanne, Lausanne, Switzerland.

May 11, 2026, cs.DCJ/K move · Enter open · S save

ChunkFlow: Communication-Aware Chunked Prefetching for Layerwise Offloading in Distributed Diffusion Transformer Inference

Han Meng, Danny Willow Liu, Dong Li

University of California, Merced · University of Chicago · University of California, Merced and Yotta Labs+1

Diffusion Transformer GPU Acceleration Memory-Efficient Inference Distributed Inference Diffusion Model Inference Acceleration

Open paper AskPDF arXiv

Layerwise offloading reduces the GPU memory footprint of large diffusion transformer (DiT) inference by prefetching upcoming layers from host memory, but its effectiveness hinges on hiding prefetch latency behind per-layer computation. This assumption breaks down when the per-GPU compute workload is small. Moreover, on PCIe-only nodes, prefetch and inter-GPU collective communications such as all-reduce and all-to-all contend on the shared PCIe path, exposing prefetch latency even when compute would otherwise hide it. We revisit layerwise offloading as a co-scheduling problem between prefetch and communication, guided by a first-order analytical model that predicts when prefetch can be hidden by computation. Building on this model, we design ChunkFlow, a communication-aware, chunk-granular offloading runtime that adaptively yields to collective communication and smoothly trades GPU memory for prefetch volume. On three representative diffusion transformers running on two H100 GPUs over PCIe with Ulysses sequence parallelism, ChunkFlow delivers up to 1.28x step-time speedup over SGLang's existing layerwise offloading, reduces peak GPU memory by up to 49% over the no-offload baseline at near-identical step time once the workload is large enough, and exposes a tunable memory-latency tradeoff that recovers near-zero step-time overhead in the small-workload regime.

Momentum

Related topics

Latest papers 297