Image Generation Evaluation

Overview

Image generation evaluation asks whether generated images look realistic, match prompts and references, preserve identities, and satisfy constraints such as spatial layout or readable text. Common approaches combine distributional metrics such as Fréchet Inception Distance and precision–recall, vision-language and feature-based scores, human judgments, and benchmarks designed for specific tasks. Recent work expands evaluation to fine-grained capabilities—including multi-subject identity and attribute binding, editing consistency, world plausibility, artistic style, and medical-image utility—and uses multimodal models to provide scalable judgments or explanations. A central challenge is making automated scores reliable across datasets and domains: a single metric can miss important failures or favor one quality dimension, while human and expert assessments are costly and difficult to standardize.

Latest papers

CardsList

127 papers19 papers in the last four weeks, up 27% on the four weeks before. 0.1% of all new papers.

  1. Do Diffusion Models Learn to Generalize Basic Visual Skills?

    Nov 17, 2026Amish Sethi, Boya Zeng, Wenhao Chai +1Diffusion ModelsImage Generation Evaluation

  2. Rethinking Perceptual Similarity for Remote Sensing: Multi-Layer Attention Scoring and Human Preference Benchmarking

    Nov 16, 2026Eli Underwood, Marc Bosch, Neil Joshi +2Image Quality AssessmentImage Generation Evaluation

  3. SAR-TopoGuard: Training-Free, Speckle-Aware Topological Verification for Structure-Preserving SAR-to-Optical Translation

    Nov 14, 2026Satabarto Sarkar, Debojyoti Ghosh, Subhranil Biswas +2Image-to-Image TranslationHallucination Mitigation

  4. Measuring Preferred Representation in AI-generated Images with Community Scorers

    Nov 11, 2026Melanie F. Pradier, Camilla Longden, Anja Thieme +9Image Generation EvaluationT2I Generation Evaluation

  5. LongBanana: An Expert-Verified Benchmark for Long-Context Multi-Reference Image Synthesis

    Nov 4, 2026Haoxiang Cao, Yuxuan Zhang, Penghui Du +16Image Generation EvaluationAgentic Image Generation

  6. PixelBench: Can LLMs Understand and Generate Images Pixel by Pixel?

    Nov 2, 2026Haoquan Zhang, Feiyang Liu, Juanxi Tian +3Image GenerationT2I Generation

  7. Biological Congruence: Evaluating Microscopy Generation Across Representations

    Nov 1, 2026Duway Nicolas Lesmes-Leon, Shumpei Takezaki, Fabian Schmeisser +5Image Generation EvaluationImage Generation

  8. From Evaluation to Evolution: Benchmarking Image Editing and Evolving Image Models

    Oct 30, 2026Jun He, Canmiao Fu, Ying Zhang +7Image Editing EvaluationImage Generation Evaluation

  9. Can Image Agents Complete Visual Commissions? A Benchmark and Modular Framework

    Oct 29, 2026Tong Li, Lishuai Gao, Qi Zeng +4AI Agent BenchmarksLLM Agent Orchestration

  10. The Search for Statistical Indistinguishability Between Real and Fake Images

    Oct 28, 2026Mohaimin Rafi, Otavio Moraes Rosa, Anshuman Chhabra +1Image Generation EvaluationAI-Generated Image Detection

  11. Beauty Is Human: When People Love AI-Generated Art, They Think a Human Made It

    Oct 28, 2026Zihan Chen, Di Zhu, Lei Nico ZhengAuthorship AttributionHuman Preference Evaluation

  12. MoI-Bench: A Benchmark for Image Generation and Editing on Mobile Devices

    Oct 27, 2026Kailai Feng, Haoxiang Rao, Yuxiang Wei +5Image Editing EvaluationImage Generation Evaluation

  13. DiffAuction: An Auction-Driven Framework for Generative Image Advertising

    Oct 26, 2026Yijie Su, Ruiyang Si, Tonghan WangImage GenerationControllable Image Generation

  14. MDMR-Bench: A Multi-Dimensional Benchmark for Multi-Reference Image Generation

    Oct 23, 2026Bowen Zheng, Jintao Lin, Changheng Yi +5Image GenerationImage Generation Evaluation

  15. SciDiagBench: A Type-Specific Benchmark for Human-Aligned Evaluation of Scientific Diagrams

    Oct 20, 2026Hao Wang, Zixuan Li, Long Bai +4VLM EvaluationImage Generation Evaluation

  16. LogicVal:A Logic-Formalized Benchmark for Constraint Satisfaction in Text-to-Image Generation

    Oct 16, 2026Savitha Sam Abraham, Marjan Alirezaie, Hossein RahnamaImage Generation EvaluationT2I Generation Evaluation

  17. Can We Use Saliency Maps for the Evaluation of Generative Image Models?

    Oct 16, 2026Eleonora Ristori, Luca Bindini, Marco Lippi +1Image Generation EvaluationSaliency Map Evaluation

  18. TRIG: Toward Measuring Texture Realism in Image Generation

    Oct 10, 2026Zhiwei Xu, Jiali Cui, Zhiqiang Lao +2Image Generation EvaluationImage Quality Assessment

  19. UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation

    Oct 7, 2026Deyuan Liu, Yihao Hu, Jingxuan Zhang +13Text Rendering in T2I GenerationT2I Generation Evaluation

  20. Visual Jev Rewards: Reference-Bound Verification for Multi-Subject Image Generation

    Oct 7, 2026Baoteng Li, Wenzhuo Wu, Kongming Liang +1Multi-Subject Image GenerationReward Modeling

  21. What Does Fréchet Distance Measure? A Directional Decomposition

    Oct 4, 2026Yunghee Lee, Jaeyeon KimImage Generation EvaluationOptimal Transport

  22. TerraVis: Towards Evaluation of World-Grounded Visual Consistency in Text-to-Image Generation via MLLM Workflows

    Oct 2, 2026Shuai Fu, Jing Gu, Jian Zhou +3Image Generation EvaluationT2I Generation Evaluation

  23. VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations

    Oct 1, 2026Xianda Du, Max Ku, Weiming Ren +5VLM EvaluationImage Editing Evaluation