Diffusion Transformer

Also known as DiT

Follow this topic Ask about this topic

Momentum

35 papers in the last four weeks, up 169% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 297

All topics

Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers
Jul 23, 2026Sicheng Mo, Yuheng Li, Ziyang Leng +2Diffusion Transformer Memory-Augmented Video Generation
University of California, Los Angeles · Adobe Research
KroQuant: Kronecker-Structured Block Transforms for Efficient Post-Training Quantization of Diffusion Transformers
Jul 23, 2026Yann Bouquet, Alireza Khodamoradi, Kristof Denolf +1Diffusion Transformer Diffusion Model Quantization
EPFL, Lausanne, Switzerland. · Advanced Micro Devices, Inc., Longmont, CO, USA.
PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing
Jul 23, 2026Jian Zhang, Zhijun ZhangDiffusion Transformer Text-Guided Image Editing
School of Electronic and Information Engineering, South China University of Technology, Guangzhou, China
Transformer-based Diffusion models for Hydrological Time Series Probabilistic Imputation and Forecasting
Jul 23, 2026Ferdinand Bhavsar, Lionel Benoit, Maxime Savatier +1Multivariate Time Series Forecasting Time Series Imputation
INRAE · Biostatistics and Spatial Processes (BioSP), INRAE, Avignon 84914, France · ANDRA +1
MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer
Jul 23, 2026Ziyi Wang, Siming Zheng, Yang Yang +5Diffusion Transformer Image Style Transfer
State Key Lab of CAD&CG, Zhejiang University, China · vivo BlueImage Lab, vivo Mobile Communication Co., Ltd., China
STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching
Jul 22, 2026Hao Wang, Haoran Geng, Xiaotong Yang +7Flow Matching Diffusion Transformer
School of Computer Science and Engineering, Beihang University, Beijing 100191, China · Google · State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan 430074, China +3
Appearance Pointers -- Multimodal Region Control of Diffusion Transformers
Jul 21, 2026Rahul Sajnani, Yulia Gryaditskaya, Radomír Měch +2Diffusion Transformer Conditional Image Generation
1Brown University · 2Adobe Research
Text Template Tokens Are Implicit Semantic Registers in Diffusion Transformers
Jul 21, 2026Maohua Li, Qirui Li, Yanke Zhou +10Transformer Interpretability Diffusion Transformer
Nanjing University · Alibaba Group · Zhejiang University
Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing
Jul 21, 2026Xinjie Zhang, Peng Zhang, Shicheng Zheng +21Diffusion Transformer Flow-Based Generative Modeling
Microsoft Mage Team
DuSPiT: Dual-Branch Sub-Patch Pixel Diffusion Transformer
Jul 20, 2026Yunpeng Bai, Yossi Gandelsman, Michaël GharbiDiffusion Transformer Pixel-Space Diffusion Models
The University of Texas at Austin · Reve
Pixel-Space Diffusion Transformers
Jul 20, 2026Renye Yan, Jikang Cheng, You Wu +8Diffusion Transformer Pixel-Space Diffusion Models
Peking University, China · Nanjing University, China · Stanford University, USA +3
JAGG: Jacobian-Aggregated Group Gradient for Efficient GRPO Training of Diffusion Models
Jul 20, 2026Ruiyi Ding, Jie Li, He Kang +3Backpropagation Diffusion Transformer
1KlingAI Research · University of Science and Technology of China · 2Fudan University +2
FlowSonic: Stable Zero-Shot Music Editing via High-Order Trajectory Integration
Jul 20, 2026Ali Boudaghi, Hadi ZareDiffusion Model Inversion Diffusion Transformer
MegaSlide-DiT: Memory-Centric Adaptation and Deformable Local Attention for Efficient Video Diffusion
Jul 17, 2026Jiacheng Liu, Jason LiuVideo Diffusion Models Diffusion Transformer
Trendinsight Lab / UC San Diego
FVAttn: Adaptive Sparse Attention with Runtime Load Balancing for Video Generation
Jul 17, 2026Hao Liu, Chenghuan Huang, Ye Huang +7Video Diffusion Models Diffusion Transformer
Sun Yat-sen University · WeChat HPC, Tencent Inc. · Peking University +1
PE-Field 4D: Video Generation Models as Canvas
Jul 17, 2026Yunpeng Bai, Haoxiang Li, Qixing HuangCamera-Controlled Video Generation Diffusion Transformer
University of Texas at Austin, USA · Pixocial Technology, USA
DiTango: Cost-Effective Parallel Diffusion Generation with Selective Attention State Reuse
Jul 17, 2026Yuyang Chen, Runxin Zhong, Zan Zong +3Diffusion Transformer Efficient Attention
Shanghai Jiao Tong University, Shanghai AI Laboratory Shanghai, China · Tsinghua University Beijing, China · University of Science and Technology Beijing Beijing, China +1
Introspective Attention Modulation for Safe Text-to-Image Generation
Jul 16, 2026Basim Azam, Hossein Rahmani, Naveed AkhtarDiffusion Transformer T2I Generation
The University of Melbourne, Australia · Lancaster University, United Kingdom
Kaleido: Algorithm-Hardware Co-Design for Video Diffusion Transformers by Exploiting Latent Space Correlations
Jul 15, 2026Wenxuan Miao, Haosong Liu, Weiming Hu +9Video Diffusion Models Diffusion Transformer
Shanghai Jiao Tong University · Shanghai Jiao Tong University, Shanghai Qi Zhi Institute · Huawei Technologies +1
ReDiTT: Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series
Jul 14, 2026Saiyue Lyu, Zhitian Zhang, Ruizhi Deng +1Irregular Time-Series Modeling Event Time Prediction
Department of Computer Science, University of British Columbia · Work done during an internship at RBC Borealis. · RBC Borealis
Adaptive Routing for Efficient Diffusion Transformer-Based PNI Prediction
Jul 13, 2026Youngung Han, Dohyun Kweon, Kyeonghun Kim +15Diffusion Transformer Medical Image Classification
Seoul National University, Seoul, Republic of Korea · Kyung Hee University, Seoul, Republic of Korea · OUTTA, Seoul, Republic of Korea +5
Controlling Motion Transfer in Diffusion Transformers via Attention Heads
Jul 13, 2026Sunyoung Jung, Jiwoo Park, Yoonseok Choi +3Diffusion Model Guidance Diffusion Transformer
Yonsei University · LG Electronics · University of California, Merced
FreyaTTS Technical Report
Jul 10, 2026Ahmet Erdem Pamuk, Ömer Yentür, Ahmet Tunga Bayrak +2Non-Autoregressive Text Generation TTS Synthesis
Freya Team
Multimodal 3D LUT Generation via StatLUT with Statistical Features for Photorealistic Style Transfer
Jul 9, 2026Yifan Wang, Zhixiang Hao, Yu Wang +1Diffusion Transformer Text-Guided Image Editing
Honor Device Co., Ltd.
RadioDiff-v2: Generative Angular Radio Maps for Multi-Beam Selection and Localization
Jul 9, 2026Xiucheng Wang, Junxi Huang, Nan ChengDiffusion Transformer 6G Networks
State Key Laboratory of ISN and School of Telecommunications Engineering, Xidian University, Xi’an 710071, China
From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models
Jul 7, 2026Zanyi Wang, Xin Lin, Haodong Li +2Diffusion Transformer Dense Prediction
1UCSD · 2HKUST
When Geometry Aligns: Dihedral Hidden-State Transformations in UNet, ViT, and DiT Architectures
Jul 3, 2026Mojtaba Faramarzi, Alex Lamb, Irina RishDiffusion Transformer Vision Transformer
University of Montreal, Canada · Mila - Quebec AI Institute · Tsinghua University +1
FairFlow: Demystifying and Mitigating Stereotype Bias in Text-to-Image Diffusion Transformers
Jul 3, 2026Chen Chen, Yuanmin Huang, Zhenfei Zhang +5Diffusion Model Alignment Diffusion Transformer
Fudan University Shanghai, China · East China University of Science and Technology Shanghai, China
HyperVAttention: Efficient Sparse Attention with Spatio-Temporal Clustering for Video Diffusion
Jul 3, 2026Dongyeun Lee, Amir Zandieh, Vahab Mirrokni +2Video Diffusion Models Diffusion Transformer
KAIST · Google Research
Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation
Jul 3, 2026Chaofan Gan, Zicheng Zhao, Yuanpeng Tu +6Visual Representation Learning Diffusion Transformer
Shanghai Jiao Tong University, Shanghai, China · The University of Hong Kong, Hong Kong, China · Monash University, Melbourne, Australia +2

Jul 23, 2026, cs.CVJ/K move · Enter open · S save

Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers

Sicheng Mo, Yuheng Li, Ziyang Leng, Krishna Kumar Singh+1

University of California, Los Angeles · Adobe Research

Diffusion Transformer Memory-Augmented Video Generation Autoregressive Video Generation Video World Models

Open paper AskPDF arXiv

Multi-agent interactive world models should not only generate consistent observations, but also maintain world states that persist across agents and evolve across views. Existing autoregressive video diffusion pipelines carry forward observation history as conditioning context, which makes shared state difficult to maintain in multi-agent and multi-view settings. We present WorldWeaver (W^2), a streaming multi-agent video diffusion model that augments rollout with cross-agent world state registers: learnable tokens that store shared world information, track individual agent status, and are dynamically updated after each generated chunk. We ground these registers with supervision signals spanning individual agent status, global state views including bird's-eye views, and scene text. We further improve the architecture with a Mixture-of-Transformers design that uses separate weights for world state modeling and visual frame modeling. Extensive experiments in two-agent Minecraft video generation show that explicit world-state modeling improves logical consistency and generation quality.

Momentum

Related topics

Latest papers 297