T2I Generation Evaluation

T2I: Text-to-Image

Overview

Text-to-image generation evaluation asks whether an image follows a prompt and how well it satisfies other needs, such as visual quality, spatial relationships, text rendering, factual accuracy, diversity, and safety. Researchers use controlled benchmarks, human ratings, detector- or program-based checks, and vision-language models that score images with questions or rubrics. Evaluation is expanding from broad alignment and aesthetics scores toward fine-grained tests of composition, cultural representation, specialized knowledge, and real-world use. A central challenge is that automated scores can miss subtle errors or reflect their own biases, while optimizing one measure—such as fidelity or safety—can harm another.

Latest papers

CardsList

184 papers20 papers in the last four weeks, down 13% on the four weeks before. 0.2% of all new papers.

  1. Can AI Understand Indonesian Children's Book Illustrations? Compliance, Safety, and the Cultural Alignment Gap

    Nov 18, 2026Rian Adam Rajagede, Rochana Prih Hastuti, Fitri Hasanah AmharCultural Safety Evaluation of VLMsCultural Bias in VLMs

  2. CuRSE-Bench: A Benchmark for Probing Cultural Blind Spots in Text-to-Image Safety Evaluation

    Nov 16, 2026Minsuk Jang, Minseok Son, KiHyun Seol +2Cultural Safety Evaluation of VLMsT2I Generation Evaluation

  3. PixelBench: Evaluating Language Models for Pixel-Art Creation

    Nov 16, 2026Mutian Hong, Jianxuan Yao, Mingkun Yue +3Image GenerationT2I Generation Evaluation

  4. LEDGE: Separating Critic and Editor Failures in Text-to-Image Self-Correction

    Nov 16, 2026Vyom Agarwal, Mokshda Gangrade, Samet Ayhan +1Self-Correction in VLMsT2I Generation

  5. Trait Collapse in Text-to-Image Generation: Evaluating and Mitigating Personality Inconsistency in Visual Storytelling

    Nov 16, 2026Yuanbo Tong, Haoyuan Li, Jibiao Jiang +3T2I Generation EvaluationVisual Storytelling

  6. InfiHall-Bench: A Benchmark for Hallucination Evaluation in Autoregressive Text-to-Image Generation

    Nov 13, 2026Yuxia Qiao, Xinhao Zhong, Junhao Li +4T2I GenerationT2I Generation Evaluation

  7. Rethinking Visual Reasoning in Text-to-Image Reward Modeling

    Nov 12, 2026Shiye Su, Xiaohan Wang, Ludwig Schmidt +1Reward ModelingT2I Generation Evaluation

  8. When Chekhov's Gun Fires Anyway: Over-Realization in Text-to-Image Models

    Nov 12, 2026Jiahao Huang, Kon Woo Kim, Song-Duo Ma +12T2I GenerationT2I Generation Evaluation

  9. DesignTaste: Benchmarking AI-Generator Visual Design Against Award-Wining Works

    Nov 12, 2026Zhou Chen, JiaXiang Li, DanYing Pan +14Graphic Design GenerationT2I Generation Evaluation

  10. Measuring Preferred Representation in AI-generated Images with Community Scorers

    Nov 11, 2026Melanie F. Pradier, Camilla Longden, Anja Thieme +9Image Generation EvaluationT2I Generation Evaluation

  11. Verifier Choice is a Benchmark Design Variable: Auditing Structural Counting Evaluation in Text-to-Image Models

    Nov 11, 2026Shurun Li, Michael Hua Wang, Haibo Zeng +1Automated EvaluationT2I Generation Evaluation

  12. T2I Models Rarely Invert Negation but Often Fail to Suppress Negated Concepts: Benchmarking Negation Suppression in Text-to-Image Generation

    Nov 6, 2026Akansha Gautam, Aparna Bharati, Mayank Vatsa +1T2I GenerationT2I Diffusion Models

  13. Same Layout, Different Count: What Number Words Do Past Ten in Text-to-Image Models

    Nov 4, 2026Liang Yue, Eric A. VanceT2I GenerationT2I Diffusion Models

  14. SVGFaith: A Two-Layer Meta-Evaluation of Faithfulness Metrics for Text-to-SVG Generation

    Nov 4, 2026Guotao Liang, Haitao Zhou, Biao Liu +6Text-to-SVG GenerationT2I Generation Evaluation

  15. Whose Values Are Generated? Measuring Visual Value Leakage in Multilingual Text-to-Image Generation

    Nov 3, 2026Zucan Lyu, Binwei Yao, Rheeya Uppaal +3T2I GenerationT2I Generation Evaluation

  16. FVH-Bench: Evaluating Image Generator Safety Beyond Overtly Harmful Imagery

    Oct 27, 2026Zihao Zhu, Yuhan Liu, Siwei Lyu +1Safe T2I GenerationT2I Generation Evaluation

  17. ImageRSI: Verification-Driven Recursive Self-Improvement for Agentic Image Generation

    Oct 23, 2026Shuo Han, Zhilin Wang, Peng Ling +5Agentic Image GenerationImage Generation

  18. ACVA-Bench: Beyond Prompt Following in Abstract Concept Visualization Ability for Text-to-Image Models

    Oct 23, 2026Mengyan Wang, Jiyuan An, Yining Liu +2T2I Generation EvaluationT2I Diffusion Models

  19. Attractive Faces Skew Text-to-Image Reward Models and Leaderboards

    Oct 20, 2026Harvey Mannering, Zhiwu Huang, Adam Prügel-BennettT2I Generation EvaluationHuman Preference Evaluation

  20. HealBench: A Fine-Grained Benchmark for Evaluating Psychological Comfort in Text-to-Image Generation

    Oct 20, 2026Junjie Xu, Yuzhe Yang, Rui Yang +4T2I Generation Evaluation

  21. LogicVal:A Logic-Formalized Benchmark for Constraint Satisfaction in Text-to-Image Generation

    Oct 16, 2026Savitha Sam Abraham, Marjan Alirezaie, Hossein RahnamaImage Generation EvaluationT2I Generation Evaluation

  22. MOSS-Image Technical Report

    Oct 16, 2026MOSI. AILayout-Guided T2I GenerationText Rendering in T2I Generation

  23. TextVerifier: Seeing Beyond Recognition to Verify Chinese Text Rendering

    Oct 14, 2026Yiyang Chen, Guo-Hua Wang, Yaoli Liu +4Text Rendering in T2I GenerationT2I Generation Evaluation

  24. Making Language the Low-Rate Code of Vision: Successive Refinement from Words to Pixels

    Oct 12, 2026Ruilin Gong, Hao GongT2I GenerationImage Tokenization