Diffusion Transformer

Also known as DiT

Follow this topic Ask about this topic

Momentum

35 papers in the last four weeks, up 169% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 297

All topics

PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation
Jul 2, 2026Haofei Xu, Rundi Wu, Philipp Henzler +7Diffusion Transformer Monocular 3D Reconstruction
Google · ETH Zurich · University of Tübingen, Tübingen AI Center +3
From SRA to Self-Flow: Data Augmentation or Self-Supervision?
Jul 2, 2026Dengyang Jiang, Mengmeng Wang, Harry Yang +1Diffusion Model Alignment Data Augmentation
1The Hong Kong University of Science and Technology · 2Zhejiang University of Technology · 3Baidu Inc.
OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers
Jul 2, 2026Donghyun Lee, Jitesh Chavan, Duy Nguyen +5Video Diffusion Models Diffusion Transformer
Cantina Labs · University of Southern California · *Work done during an internship at Cantina Labs. +1
QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers
Jul 2, 2026Kyobin Choo, Youngmin Kim, Hyunkyung Han +4Diffusion Model Guidance Diffusion Transformer
Department of Computer Science, Yonsei University, Seoul, Republic of Korea · Department of Artificial Intelligence, Yonsei University, Seoul, Republic of Korea
InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation
Jul 2, 2026Qing Yu, Kent FujiwaraDiffusion Transformer Latent Diffusion Models
LY Corporation, Tokyo, Japan
Post-Training Pruning for Diffusion Transformers
Jul 1, 2026Chengzhi Hu, Xuewen Liu, Jing Zhang +3Diffusion Transformer Diffusion-Based Image Generation
Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences
Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers
Jul 1, 2026Jaeah Lee, Hyunjin Kim, Jaewoong Cho +1Model Compression Diffusion Transformer
KRAFTON AI, Republic of Korea · Amazon, Australia
SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE
Jun 30, 2026Or Hirschorn, Aaron Olender, Eli Alshan +3Video-Reference Video Generation Rotary Positional Embeddings
1Amazon Prime Video · 2Tel-Aviv University · 3Hebrew University of Jerusalem
Quality-Aware Modulation for Diffusion Transformers
Jun 29, 2026Luke Budny, Yuhong Guo, Kevin CheungDiffusion Transformer T2I Diffusion Models
Carleton University
SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animation
Jun 29, 2026Juncheng Ma, Yuxuan Du, Yanan Sun +8Diffusion Transformer Audio-Driven Facial Animation
Shenzhen Graduate School, Peking University, China · Shanghai AI Laboratory, China · Tencent Hunyuan, China +1
UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception
Jun 29, 2026Qin Guo, Hao Luo, Dongxu Yue +4Diffusion Transformer Dense Prediction
The Hong Kong University of Science and Technology · DAMO Academy, Alibaba Group, Zhejiang, China · Hupan Lab, Zhejiang Province +4
SAFE-DiT: Semantics-Aware Fast-path Execution for High-Resolution Diffusion Transformers
Jun 28, 2026Xuanhua Yin, Yuxuan Jia, Chuanzhi Xu +1Diffusion Transformer Diffusion Model Inference Acceleration
School of Computer Science, The University of Sydney, Australia
DTI: Dynamic Trajectory Initialization for Generative Face Video Super-Resolution
Jun 28, 2026Yingwei Tang, Chen Yan, Wendi Liu +2Diffusion Transformer Video Super-Resolution
Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China
PixelU: A U-Shaped Transformer for Efficient End-to-End Pixel Diffusion
Jun 26, 2026Zipeng Guo, Lichen Ma, Yu He +4Diffusion Transformer Pixel-Space Diffusion Models
Xi’an Jiaotong University
Scalable Behavior Cloning with Open Data, Training, and Evaluation
Jun 25, 2026Arthur Allshire, Himanshu Gaurav Singh, Ritvik Singh +15Robot Policy Learning Diffusion Transformer
UC Berkeley · MIT · XDOF +2
RayPE: Ray-Space Positional Encoding for 3D-Aware Video Generation
Jun 25, 2026Minghao Yin, Jiahao Lu, Wenbo Hu +3Camera-Controlled Video Generation Diffusion Transformer
1The University of Hong Kong · 2The Hong Kong University of Science and Technology · 3ARC Lab, Tencent
RoPEMover: Depth-Aware Object Relocation via Positional Embeddings
Jun 25, 2026Ipek Oztas, Duygu Ceylan, Aybars Bugra Aksoy +1Rotary Positional Embeddings Diffusion Transformer
Bilkent University · Brown University · Adobe Research
LearniBridge: Learnable Calibration of Feature Caching for Diffusion Models Acceleration
Jun 25, 2026Xuyue Huang, Zhe Chen, Wang Shen +1Video Diffusion Models Diffusion Transformer
Shenzhen Ubiquitous Data Enabling Key Laboratory, Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Central Media Technology Institute, Huawei Technologies Co., Ltd., Shenzhen, China
ResilPhase: Plug-and-Play Phase Mapping and Noise-Resilient Macro-Trajectory Extrapolation for Diffusion Acceleration
Jun 25, 2026Qicheng Zhao, Yu Li, Qi Sun +1Diffusion Transformer Diffusion Sampling
Zhejiang University, Hangzhou, China
DiffusionBench: On Holistic Evaluation of Diffusion Transformers
Jun 23, 2026Xingjian Leng, Jaskirat Singh, Zhanhao Liang +5Diffusion Transformer Image Generation Evaluation
Australian National University · Canva Research
DiT-Reward: Generative Representations for Text-to-Image Reward Modeling
Jun 22, 2026Yuanming Yang, Guoqing Ma, Bo Wang +5Representation Learning Diffusion Transformer
JD Explore Academy, JD.com, Beijing, China · Tsinghua University, Beijing, China · Beijing Institute of Technology, Beijing, China +1
Vera: A Layered Diffusion Model for Content-Preserving Video Editing
Jun 22, 2026Hongkai Zheng, Ta-Ying Cheng, Benjamin Klein +2Video Diffusion Models Diffusion Transformer
California Institute of Technology · Netflix, Inc.
MeshFlow: Mesh Generation with Equivariant Flow Matching
Jun 22, 2026Qi Sun, Kiyohiro Nakayama, Jing Nathan Yan +6Flow Matching 3D Mesh Generation
City University of Hong Kong, Hong Kong · Stanford University, USA · Cornell Tech, USA +1
ScalingAttention: Discovering Intrinsic Sparse Attention Topology for Video Diffusion Transformers
Jun 22, 2026Ruiliang Zhou, Xuecheng Wu, Kang He +6Video Diffusion Models Diffusion Transformer
KlingAI Research · Beijing Institute of Technology · NVIDIA +1
Controllable Texture Tiling with Transformed RoPE-Enhanced Diffusion Models
Jun 22, 2026Junrong Huang, Zhiyuan Zhang, Rui Tang +2Rotary Positional Embeddings Diffusion Transformer
City University of Hong Kong, China · Manycore Tech Inc., China · Hong Kong University of Science and Technology, China
Text Dictates, Music Decorates: Energy-based Attention for Editable Dance Motion Generation
Jun 22, 2026Seong Jong Yoo, Siyuan Peng, Felix Gu +2Diffusion Transformer Text-to-Motion Generation
University of Maryland, College Park, MD, 20742, USA · Perception and Robotics Group
On the Redundancy of Timestep Embeddings in Diffusion Models
Jun 18, 2026José A. ChávezDiffusion Transformer Diffusion Models
Independent Researcher, Lima, Peru
Pixel-Level Residual Diffusion Transformer: Scalable 3D CT Volume Generation
Jun 18, 2026Zhenkai Zhang, Markus Hiller, Krista A. Ehinger +1Diffusion Transformer 3D Medical Imaging
School of Computing and Information Systems, The University of Melbourne · School of Computing
RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers
Jun 18, 2026Liting Gao, Yonggang Zhu, Yaru Chen +5Diffusion Transformer Audio Editing
Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, Guildford GU2 7XH, U.K. · School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China · Fisheries College, Ocean University of China, Qingdao, China +1
DiffMath: Symbol- and Graph-Aware Latent Diffusion Transformer for Handwritten Mathematical Expression Generation
Jun 18, 2026Wei Pan, Xuhan Zheng, Yilin Shi +5Diffusion Transformer Latent Diffusion Models
South China University of Technology · Huawei Technologies Co., Ltd.

Jul 2, 2026, cs.CVJ/K move · Enter open · S save

PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation

Haofei Xu, Rundi Wu, Philipp Henzler, Nikolai Kalischek+6

Google · ETH Zurich · University of Tübingen, Tübingen AI Center+3

Diffusion Transformer Monocular 3D Reconstruction Pixel-Space Diffusion Models Single-View 3D Reconstruction 3D Diffusion Models Diffusion Models

Open paper AskPDF arXiv

State-of-the-art single-image 3D reconstruction methods often rely on complex hybrid architectures and loss functions, or compress geometry into latent spaces in order to leverage pre-trained latent diffusion models. In this work, we show that such architectural overhead and intricate loss formulations are unnecessary. We introduce a minimalist pixel-space Diffusion Transformer, built on a plain ViT, that operates directly on raw 3D point map patches and is conditioned on image tokens from a pre-trained DINOv3. Unlike existing latent diffusion approaches, we train our diffusion backbone entirely from scratch, eliminating the need for point map tokenizers. Despite its simplicity, our approach surpasses complex latent-based diffusion models while remaining significantly simpler than hybrid alternatives. Notably, it produces sharper geometric structure and is more robust in highly ambiguous regions, such as transparent objects.

Momentum

Related topics

Latest papers 297