T2I Diffusion Models

T2I: Text-to-Image

Overview

Text-to-image diffusion models turn prompts into images by iteratively denoising a latent or pixel representation, using latent-diffusion U-Nets, diffusion transformers, and rectified-flow models. Researchers improve prompt and spatial control with classifier-free guidance, cross-attention interventions, LoRA adapters, and reference or layout conditioning, while preference learning and reinforcement learning tune outputs to human or task rewards. Another major effort distills models into few-step generators and uses caching, quantization, and latent compression to reduce inference costs; benchmarks test composition, text rendering, image quality, and human preference. A central challenge is balancing prompt fidelity and diversity with speed, quality, and safeguards: realism or alignment gains do not guarantee robust composition, fair representation, or reliable concept removal.

Latest papers

CardsList

403 papers68 papers in the last four weeks, up 172% on the four weeks before. 0.4% of all new papers.

  1. AccelAes: Accelerating Diffusion Transformers for Training-Free Aesthetic-Enhanced Image Generation

    Mar 13, 2026Xuanhua Yin, Chuanzhi Xu, Haoxian Zhou +2Diffusion TransformerImage Generation

  2. Guiding Diffusion Models with Semantically Degraded Conditions

    Mar 11, 2026Shilong Han, Yuming Zhang, Hongxia WangDiffusion Model GuidanceT2I Diffusion Models

  3. Visually-Guided Controllable Medical Image Generation via Fine-Grained Semantic Disentanglement

    Mar 11, 2026Xin Huang, Junjie Liang, Qingshan Hou +4Medical Image SynthesisControllable Image Generation

  4. TIDE: Text-Informed Dynamic Extrapolation with Step-Aware Temperature Control for Diffusion Transformers

    Mar 9, 2026Yihua Liu, Fanjiang Ye, Bowen Lin +2T2I Diffusion ModelsDiffusion Transformer

  5. Prototype-Guided Concept Erasure in Diffusion Models

    Mar 9, 2026Yuze Cai, Jiahao Lu, Hongxiang Shi +2Concept ErasureSafe T2I Generation

  6. WaDi: Weight Direction-aware Distillation for One-step Image Synthesis

    Mar 9, 2026Lei Wang, Yang Cheng, Senmao Li +3Diffusion Model DistillationOne-Step Generative Modeling

  7. HybridStitch: Token-Adaptive Model Stitching for Efficient Diffusion Generation

    Mar 8, 2026Desen Sun, Jason Hon, Jintao Zhang +1Diffusion Model AccelerationT2I Diffusion Models

  8. TDM-R1: Reinforcing Few-Step Diffusion Models with Non-Differentiable Reward

    Mar 8, 2026Yihong Luo, Tianyang Hu, Weijian Luo +1RL for Diffusion ModelsReinforcement Learning

  9. FabricGen: Microstructure-Aware Woven Fabric Generation

    Mar 7, 2026Yingjie Tang, Di Luo, Zixiong Wang +3Procedural Content GenerationT2I Diffusion Models

  10. Making Training-Free Diffusion Segmentors Scale with the Generative Power

    Mar 6, 2026Benyuan Meng, Qianqian Xu, Zitai Wang +3Text-Guided Image SegmentationOpen-Vocabulary Semantic Segmentation

  11. Reflective Flow Sampling Enhancement

    Mar 6, 2026Zikai Zhou, Muyao Wang, Shitong Shao +4T2I Diffusion ModelsFlow-Based Generative Modeling

  12. BlackMirror: Black-Box Backdoor Detection for Text-to-Image Models via Instruction-Response Deviation

    Mar 6, 2026Feiran Li, Qianqian Xu, Shilong Bao +4Backdoor DetectionBackdoor Attacks on VLMs

  13. Tuning Just Enough: Lightweight Backdoor Attacks on Multi-Encoder Diffusion Models

    Mar 4, 2026Ziyuan Chen, Yujin Jeong, Tobias Braun +1Backdoor AttacksT2I Diffusion Models

  14. CFG-Ctrl: Control-Based Classifier-Free Diffusion Guidance

    Mar 3, 2026Hanyang Wang, Yiyang Liu, Jiawei Chi +3Diffusion Model GuidanceClassifier-Free Guidance

  15. Conditioned Activation Transport for T2I Safety Steering

    Mar 3, 2026Maciej Chrabąszcz, Aleksander Szymczyk, Jan Dubiński +3Safe T2I GenerationActivation Steering

  16. Toward Early Quality Assessment of Text-to-Image Diffusion Models

    Mar 3, 2026Huanlei Guo, Hongxin Wei, Bingyi JingT2I Generation EvaluationT2I Diffusion Models

  17. TerraDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesis

    Mar 2, 2026Srikumar Sastry, Dan Cher, Brian Wei +4Diffusion TransformerControllable Image Generation

  18. DreamReader: An Interpretability Toolkit for Text-to-Image Models

    Mar 2, 2026Nirmalendu Prakash, Narmeen Oozeer, Michael Lan +6Diffusion ModelsT2I Diffusion Models

  19. Compensation-free Machine Unlearning in Text-to-Image Diffusion Models by Eliminating the Mutual Information

    Mar 1, 2026Xinwen Cheng, Jingyuan Zhang, Zhehao Huang +2Diffusion Model UnlearningConcept Erasure

  20. EraseAnything++: Enabling Concept Erasure in Rectified Flow Transformers Leveraging Multi-Object Optimization

    Mar 1, 2026Zhaoxin Fan, Nanxiang Jiang, Daiheng Gao +2Concept ErasureDiffusion Model Unlearning

  21. Forgetting is Competition: Rethinking Unlearning as Representation Interference in Diffusion Models

    Mar 1, 2026Ashutosh Ranjan, Vivek Srivastava, Shirish Karande +1Diffusion Model UnlearningMachine Unlearning

  22. Analyzing and Improving Fast Sampling of Text-to-Image Diffusion Models

    Feb 28, 2026Zhenyu Zhou, Defang Chen, Siwei Lyu +2Diffusion Model Inference AccelerationT2I Diffusion Models

  23. Diffusion Probe: Generated Image Result Prediction Using CNN Probes

    Feb 27, 2026Benlei Cui, Bukun Huang, Zhizeng Ye +7T2I Diffusion ModelsDiffusion Models

  24. No Caption, No Problem: Caption-Free Membership Inference via Model-Fitted Embeddings

    Feb 26, 2026Joonsung Jeon, Woo Jae Kim, Suhyeon Ha +2Membership Inference AttacksT2I Diffusion Models

  25. When LoRA Betrays: Backdooring Text-to-Image Models by Masquerading as Benign Adapters

    Feb 25, 2026Liangwei Lyu, Jiaqi Xu, Jianwei Ding +1T2I Diffusion ModelsLow-Rank Adaptation

  26. Attention to Neural Plagiarism: Diffusion Models Can Plagiarize Your Copyrighted Images!

    Feb 25, 2026Zihang Zou, Boqing Gong, Liqiang WangAdversarial Attacks on Diffusion ModelsAdversarial Attacks

  27. When Safety Collides: Resolving Multi-Category Harmful Conflicts in Text-to-Image Diffusion via Adaptive Safety Guidance

    Feb 24, 2026Yongli Xiang, Ziming Hong, Zhaoqing Wang +3Safe T2I GenerationDiffusion Model Guidance

  28. Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion

    Feb 24, 2026Sathwik Karnik, Juyeop Kim, Sanmi Koyejo +2Memorization in Generative ModelsT2I Diffusion Models