Safe T2I Generation

T2I: Text-to-Image

Overview

It studies how to keep text-to-image systems from producing harmful images without blocking legitimate requests. Approaches include prompt moderation, safety alignment during training, concept erasure, and inference-time steering or localized repair during denoising. Researchers test these methods on safety benchmarks and red-team attacks, including jailbreaks, unsafe combinations of benign concepts, and image-editing settings, while measuring image quality and prompt fidelity. A central challenge is making defenses robust to changing attacks and context-dependent harms without suppressing benign content, with performance varying across model architectures and generation methods.

Latest papers

CardsList

53 papers9 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

  1. When Guidance Becomes a Guard: Early Interception of Unsafe Inputs in Text-to-Image Generation

    Oct 19, 2026Yanchun Li, Yujin Wu, Gangkai Shen +5Safe T2I GenerationT2I Diffusion Models

  2. Decoupled Safety Control: A Safety-Control Algorithm for Training-Free Safety Guidance

    Oct 15, 2026Huilin Zhou, Ruoxi Cheng, Yuhang Wang +4Safe T2I GenerationDiffusion Model Guidance

  3. SaTPO: Text-to-Image Safety Alignment via Transition Preference Optimization

    Oct 14, 2026Ziyi Fang, Jingzhi Li, Xiaojun Jia +3Preference Optimization for Diffusion ModelsSafe T2I Generation

  4. Pristine Models

    Oct 8, 2026Anirudh Sundara Rajan, Krishna Kumar Singh, Richard Zhang +1Safe T2I Generation

  5. False Claims, Credible Images: A Red-Teaming Benchmark for Commercial Image Generators

    Oct 8, 2026Zeyu Ye, Yanchun Li, Sibei He +8Safe T2I GenerationT2I Generation Evaluation

  6. Safe Image Generation via Reinforcement Learning

    Oct 5, 2026Eungyeol Han, Jong-Seok LeeT2I GenerationSafe T2I Generation

  7. Keep It CALM: Analyzing the Limits of Global Unsafety in Text-to-Image Generation

    Oct 1, 2026NaHyeon Park, Minhyun Lee, Hyunjung ShimSafe T2I GenerationT2I Diffusion Models

  8. Steering Fields: Adaptive Vector Fields for Safe Image Generation and Beyond

    Sep 30, 2026Simone Facchiano, Jan Eric Lenssen, Bernt Schiele +3T2I GenerationSafe T2I Generation

  9. HyperErase: Scale-Calibrated Hypernetwork for Multi-Concept Erasure in Text-to-Image Models

    Sep 25, 2026Yi Sun, Xinhao Zhong, Zhiqi Zhang +3Safe T2I GenerationDiffusion Model Unlearning

  10. Automatic Red Teaming for Implicit Vulnerabilities of Text-to-Image Models

    Sep 5, 2026Chang Ma, Junlin Han, Shuo Chen +3Safe T2I GenerationAdversarial Prompt Generation

  11. Not Safe for All: Auditing the Dialect Penalty in Text-to-Image Safety Pipelines

    Aug 30, 2026Minkyu Kim, Juhwan Choi, YoungBin KimSafe T2I GenerationDemographic Bias in T2I Models

  12. GuardPaint:SpeculativeSafetyDecodingforText-to-ImageGeneration

    Aug 22, 2026Shreyash Dhoot, Paras Dhiman, Arsh Abbas Naqvi +4Safe T2I GenerationAdversarial Attacks on Diffusion Models

  13. DiSCO: Defending text-to-image generation through distribution-guided contrastive prompt optimization

    Aug 17, 2026Tong Zhang, Motasem Alfarra, Carlos Hinojosa +2Safe T2I GenerationAdversarial Robustness

  14. TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models

    Aug 15, 2026Alireza Dehghanpour Farashah, Zhuan Shi, Negar Rostamzadeh +1Safe T2I GenerationAdversarial Robustness

  15. Test-Time Scaling for Safe Text-Guided Image Generation via Intermediate Clean Estimates

    Aug 4, 2026Jinya Sakurai, Shueicheng Yan, Xun XuTest-Time OptimizationT2I Generation

  16. Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed

    Jul 27, 2026Xinnuo Xu, Anja Thieme, Daniela Massiceti +6T2I GenerationSafe T2I Generation

  17. Introspective Attention Modulation for Safe Text-to-Image Generation

    Jul 16, 2026Basim Azam, Hossein Rahmani, Naveed AkhtarDiffusion TransformerT2I Generation

  18. AEGIS: A Mechanism-Guided Defense against Visual Synonym Jailbreaks in Text-to-Image Models

    Jul 7, 2026Yuanmin Huang, Zhenfei Zhang, Mi Zhang +5Safe T2I GenerationT2I Diffusion Models

  19. The Illusion of High Utility in Safety Alignment of Text-to-Image Diffusion Models

    Jul 1, 2026Adeel Yousaf, Soumik Ghosh, James Beetham +2Diffusion Model AlignmentRepresentation Learning

  20. ScaleErasure: Inference-Time Minimal Intervention for Precise Concept Erasure in Next-Scale Autoregressive Image Generation

    Jun 28, 2026Cong Wang, Haiyu Wu, Zhiwei Jiang +4Image GenerationSafe T2I Generation

  21. Obliviate: Erasing Concepts from Autoregressive Image Generation Models

    Jun 26, 2026Hossein Shakibania, Jonas Henry Grebe, Tobias Braun +4Image GenerationSafe T2I Generation

  22. Safe Autoregressive Image Generation with Iterative Self-Improving Codebooks

    Jun 25, 2026Yunqi Xue, Zhijiang Li, Philip Torr +1T2I GenerationImage Generation

  23. Safe Few-Step Generation via Velocity Editing

    Jun 22, 2026Yujin Choi, Jaehong YoonFlow MatchingT2I Generation

  24. ForceForget: Reinforcement Concept Removal for Enhancing Safety in Text-to-Image Models

    Jun 12, 2026Dong Han, Yong LiSafe T2I GenerationAI Safety

  25. Unified Safe In-context Image Generation in Multimodal Diffusion Transformers via Restricting Unsafe Information Flows

    Jun 5, 2026Xiang Yang, Feifei Li, Mi Zhang +4Diffusion TransformerImage Generation

  26. No Safe Dose: How Training Data Drives Unsafe Image Generation

    May 27, 2026Felix Friedrich, Lukas Helff, Niharika Hegde +2Safe T2I GenerationData Contamination

  27. FlowErase-RL: Rethinking Concept Erasure as Reward Optimization in Flow Matching Models

    May 19, 2026Yi Sun, Zhiqi Zhang, Xinhao Zhong +5Flow MatchingT2I Generation