T2I Generation Evaluation

T2I: Text-to-Image

Follow this topic Ask about this topic

Momentum

9 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 98

All topics

DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation
May 25, 2026Jiaying Qian, Ziheng Jia, Qian Zhang +5Reward Modeling T2I Generation
Shanghai Jiao Tong University
ERNIE-Image Technical Report
May 25, 2026Jiaxiang Liu, Zhida Feng, Pengyu Zou +46Personalized Image Aesthetics Assessment Diffusion Model Distillation
HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing
May 23, 2026Ruyi Chen, Lu Zhou, Xiaogang Xu +3T2I Generation Algorithmic Fairness
Nanjing University of Aeronautics and Astronautics · Collaborative Innovation Center of Novel Software Technology and Industrialization · School of Software Technology, Zhejiang University, Ningbo, China +1
AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompters
May 21, 2026Hanjun Luo, Zhimu Huang, Sylvia Chung +6T2I Generation Agent Evaluation
New York University Abu Dhabi · Zhejiang University · University of Electronic Science and Technology of China +2
MaSC: A Masked Similarity Metric for Evaluating Concept-Driven Generation
May 21, 2026Patryk Bartkowiak, Lennart Petersen, Bartosz Kotrys +3Subject-Driven Image Generation Image Generation Evaluation
Adam Mickiewicz University · Kiel University · ArtCollect +1
TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design
May 20, 2026Haonan Zhu, Elad Hirsch, Alexandria Minetti +3VLM Evaluation T2I Generation Evaluation
Lica World, San Francisco, USA. · Contra.Work Inc., Brooklyn, NY, USA.
PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Dataset
May 19, 2026Haojun Chen, Haoyang He, Chengming Xu +11T2I Generation Image Generation
Zhejiang University · Fudan University · Nanjing University +3
Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation
May 19, 2026Junjie Wang, Xinghua Lou, Jason Li +8Image Generation Compositional T2I Generation
Harbin Institute of Technology, Shenzhen · University of Science and Technology of China · Shenzhen Loop Area Institute +5
Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South
May 18, 2026Charvi Rastogi, Mukul Bhutani, Minsuk Kahng +13Demographic Bias in T2I Models AI Safety
Google DeepMind, USA · Yonsei University, Republic of Korea · Imperial College, UK +4
FAGER: Factually Grounded Evaluation and Refinement of Text-to-Image Models
May 18, 2026Youngsun Lim, Cusuh Ham, Pin-Yu Chen +1Factual Consistency Evaluation Automated Evaluation
Boston University · Adobe · IBM Research
AutoRubric-T2I: Robust Rule-Based Reward Model for Text-to-Image Alignment
May 17, 2026Kuei-Chun Kao, Daixuan Huo, Yuanhao Ban +1VLM Evaluation Rubric-Based Evaluation
University of California, Los Angeles · Arena
The Silent Brush: Evaluating Artistic Style Leakage in AI Art Generation
May 17, 2026Ninad Joshi, Ashutosh Ranjan, Vivek Srivastava +1T2I Generation T2I Generation Evaluation
TCS Research, India
Skill-Aligned Annotation for Reliable Evaluation in Text-to-Image Generation
May 13, 2026Abdelrahman Eldesokey, Merey Ramazanova, Ahmad Sait +4Human-in-the-Loop Evaluation Automated Evaluation
King Abdullah University of Science and Technology (KAUST) · Thuwal, Saudi Arabia
Context Matters: Auditing Gender Bias in T2I Generation through Risk-Tiered Use-Case Profiles
May 13, 2026Jose Luna, Yankun Wu, Xiaofei Xie +1T2I Generation Demographic Bias in T2I Models
Singapore Management University, Singapore · The University of Osaka, Japan
When Style Similarity Scores Fail: Diagnosing Raw CSD Cosine in Artist-Style Evaluation
May 9, 2026Jörg FrochtePairwise Comparison Image Generation Evaluation
Bochum University of Applied Sciences
SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generation
May 8, 2026Tianfei Ren, Zhipeng Yan, Yiming Zhao +13Conditional Image Generation Compositional T2I Generation
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China · The Hong Kong Polytechnic University · Nanyang Technological University
DynT2I-Eval: A Dynamic Evaluation Framework for Text-to-Image Models
May 7, 2026Juntong Wang, Jiarui Wang, Huiyu Duan +3Learning to Rank Benchmark Design
Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University, Shanghai, China
Assessing the Geographic Diversity of AI's Platial Representations in Image Generation
Apr 28, 2026Zilong Liu, Krzysztof Janowicz, Mina KarimiImage Generation Evaluation T2I Generation Evaluation
Department of Geography and Regional Research, University of Vienna, Austria
Benchmarking Layout-Guided Diffusion Models through Unified Semantic-Spatial Evaluation in Closed and Open Settings
Apr 28, 2026Luca Parolari, Nicla Faccioli, Lamberto BallanT2I Generation Compositional T2I Generation
Department of Mathematics, University of Padova, Padova, Italy
Beyond Categories of Caste: Examining Caste Bias and Morality in Text-to-Image AI Models
Apr 28, 2026Divyanshu Kumar Singh, Dipto Das, Deepika Rama Subramanian +3Algorithmic Fairness Algorithmic Bias
University of Colorado Boulder Boulder, Colorado, USA · University of Toronto Toronto, Ontario, Canada · University of Illinois Urbana-Champaign Urbana-Champaign, Illinois, USA
TextGround4M: A Prompt-Aligned Dataset for Layout-Aware Text Rendering
Apr 27, 2026Dongxing Mao, Yilin Wang, Linjie Li +2T2I Generation Compositional T2I Generation
Central South University · Zhejiang University · Microsoft Research
Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation
Apr 24, 2026Ran Zhao, Sheng Jin, Size Wu +5T2I Generation Image Generation
Huazhong University of Science and Technology · The University of Hong Kong · S-Lab, Nanyang Technological University
Seeing Isn't Believing: Uncovering Blind Spots in Evaluator Vision-Language Models
Apr 23, 2026Mohammed Safi Ur Rahman Khan, Sanjay Suryanarayanan, Tushar Anand +1VLM Evaluation VLM Robustness
♠Nilekani Centre at AI4Bharat ♢Indian Institute of Technology Madras · ♠Nilekani Centre at AI4Bharat · ♣BITS Pilani, Hyderabad
Who Defines Fairness? Target-Based Prompting for Demographic Representation in Generative Models
Apr 22, 2026Marzia Binta Nizam, James DavisSocial Bias in Language Models Algorithmic Fairness
University of California, Santa Cruz, USA
Hallucination Early Detection in Diffusion Models
Apr 22, 2026Federico Betti, Lorenzo Baraldi, Lorenzo Baraldi +2Compositional T2I Generation T2I Generation Evaluation
University of Trento, Italy. · Universit`a di Pisa, Italy. · University of Modena and Reggio Emilia, Italy.
Embedding Arithmetic: A Lightweight, Tuning-Free Framework for Post-hoc Bias Mitigation in Text-to-Image Models
Apr 20, 2026Venkatesh Thirugnana Sambandham, Torsten SchönT2I Generation Algorithmic Bias
AIMotion Bavaria, Technische Hochschule Ingolstadt, Esplanade 10, 85049 Ingolstadt, Germany
When Safe Concepts Become Unsafe: Multi-Concept Compositional Vulnerabilities in Text-to-Image Models
Apr 17, 2026Chaoshuo Zhang, Yibo Liang, Mengke Tian +7Safe T2I Generation Compositional T2I Generation
School of Cyber Science and Engineering, Xi’an Jiaotong University, Xi’an, China · CISPA Helmholtz Center for Information Security, Saarbrücken, Germany · School of Cyber Science and Engineering, Wuhan University, Wuhan, China
Naïve PAINE: Lightweight Text-to-Image Generation Improvement with Prompt Evaluation
Mar 12, 2026Joong Ho Kim, Nicholas Thai, Souhardya Saha Dip +2T2I Generation T2I Generation Evaluation
LSU ATHENA Lab, Baton Rouge, LA, U.S.A. · LSU Vision Lab, Baton Rouge, LA, U.S.A.
DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation
Mar 9, 2026Zhenyu Hu, Qing Wang, Te Cao +11Subject-Driven Image Generation Identity-Preserving Image Generation
Tencent, China
TIQA: Human-Aligned Perceptual Text Quality Assessment in Generated Images
Mar 7, 2026Kirill Koltsov, Aleksandr Gushchin, Anastasia Antsiferova +1Image Quality Assessment T2I Generation Evaluation
Lomonosov Moscow State University Moscow, Russia · ISP RAS Research Center for Trusted Artificial Intelligence Lomonosov Moscow State University Moscow, Russia · ISP RAS Research Center for Trusted Artificial Intelligence MSU Institute for Artificial Intelligence Moscow, Russia +1

May 25, 2026, cs.CVJ/K move · Enter open · S save

DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation

Jiaying Qian, Ziheng Jia, Qian Zhang, Zicheng Zhang+4

Shanghai Jiao Tong University

Reward Modeling T2I Generation Multimodal Reward Modeling T2I Generation Evaluation

Open paper AskPDF arXiv

With the continued advancement of text-to-image (T2I) generation, producing high-quality images is becoming increasingly attainable; consequently, user demands are shifting toward images that better satisfy their specific requirements. As reward models play an increasingly important role in assessing whether generated images align with user preference, this trend introduces an important challenge for reward modeling: rather than relying solely on static and general evaluation dimensions, reward models should account for the task-relevant and fine-grained criteria through which users assess whether generated images meet their specific requirements. To address this challenge, we propose DyCoRM, a dynamic, criterion-aware reward model that grounds task-relevant criteria and performs criterion-aware preference comparison. To support this setting, we construct DyCoDataset-20K, which provides dynamic criteria together with criterion-level annotations, and further derive DyCoBench-1K, a benchmark for systematically evaluating reward models under dynamic criteria. We further introduce DyCoPick, which applies criterion-aware reward modeling to selecting T2I images. Our contributions establish the first reward modeling framework for dynamic and fine-grained evaluation and practical application in T2I generation.

Momentum

Related topics

Latest papers 98