Diffusion Transformer

Diffusion Transformers (DiTs) use transformer networks to turn noise into data, typically by repeatedly predicting denoising updates or following a learned flow. Work explores latent- and pixel-space models, conditioning through text, images, geometry, or other modalities, and representation-learning methods that improve generation and downstream perception. To lower the cost of training and inference, researchers use sparse attention, token reduction, caching, quantization, distillation, and hardware-aware designs. A central challenge is balancing speed, memory, and model size against fidelity, temporal or spatial consistency, and reliable performance across tasks and benchmarks.