Image Generation Evaluation

Overview

Image generation evaluation asks whether generated images look realistic, match prompts and references, preserve identities, and satisfy constraints such as spatial layout or readable text. Common approaches combine distributional metrics such as Fréchet Inception Distance and precision–recall, vision-language and feature-based scores, human judgments, and benchmarks designed for specific tasks. Recent work expands evaluation to fine-grained capabilities—including multi-subject identity and attribute binding, editing consistency, world plausibility, artistic style, and medical-image utility—and uses multimodal models to provide scalable judgments or explanations. A central challenge is making automated scores reliable across datasets and domains: a single metric can miss important failures or favor one quality dimension, while human and expert assessments are costly and difficult to standardize.

Latest papers

CardsList

113 papers18 papers in the last four weeks, up 80% on the four weeks before. 0.1% of all new papers.

  1. Gen-Searcher: Reinforcing Agentic Search for Image Generation

    Mar 30, 2026Kaituo Feng, Manyuan Zhang, Shuang Chen +7Image GenerationAgentic Image Generation

  2. AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generation

    Mar 30, 2026Zhaohe Liao, Kaixun Jiang, Zhihang Liu +11Image Generation EvaluationImage Generation

  3. When Identities Collapse: A Stress-Test Benchmark for Multi-Subject Personalization

    Mar 27, 2026Zhihan Chen, Yuhuan Zhao, Yijie Zhu +1Multi-Subject Image GenerationSubject-Driven Image Generation

  4. BizGenEval: A Systematic Benchmark for Commercial Visual Content Generation

    Mar 26, 2026Yan Li, Zezi Zeng, Ziwei Zhou +13Image Generation EvaluationImage Generation

  5. MultiBind: A Benchmark for Attribute Misbinding in Multi-Subject Generation

    Mar 23, 2026Wenqing Tian, Hanyi Mao, Zhaocheng Liu +4Multi-Subject Image GenerationImage Generation

  6. Trust Your Critic: Robust Reward Modeling and Reinforcement Learning for Faithful Image Editing and Generation

    Mar 12, 2026Xiangyu Zhao, Peiyuan Zhang, Junming Lin +7Reward ModelingRL for Image Editing

  7. Too Vivid to Be Real? Benchmarking and Calibrating Generative Color Fidelity

    Mar 11, 2026Zhengyao Fang, Zexi Jia, Yijia Zhong +5Image GenerationImage Generation Evaluation

  8. HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation

    Mar 11, 2026Hongji Yang, Yucheng Zhou, Wencheng Han +3Vision-Language Model-as-a-JudgeVLM Evaluation

  9. Evaluating Generative Models via One-Dimensional Code Distributions

    Mar 9, 2026Zexi Jia, Pengcheng Luo, Yijia Zhong +2Image Quality AssessmentImage Generation Evaluation

  10. Virtual Try-On for Cultural Clothing: A Benchmarking Study

    Mar 7, 2026Muhammad Tausif Ul Islam, Shahir Awlad, Sameen Yeaser Adib +3Virtual Try-OnImage Generation Evaluation

  11. The Art That Poses Back: Assessing AI Pastiches after Contemporary Artworks

    Mar 6, 2026Anca Dinu, Andreiana Mihail, Andra-Maria Florescu +1Image GenerationImage Generation Evaluation

  12. Exploring the AI Obedience: Why is Generating a Pure Color Image Harder than CyberPunk?

    Feb 26, 2026Hongyu Li, Kuan Liu, Yuan Chen +6Image GenerationImage Generation Evaluation

  13. MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Models

    Feb 23, 2026Mingrui Wu, Hang Liu, Jiayi Ji +2Image GenerationUnified Multimodal Models

  14. PlanViz: Evaluating Planning-Oriented Image Generation and Editing for Computer-Use Tasks

    Feb 6, 2026Junxian Li, Kai Liu, Leyang Chen +7Image Generation EvaluationImage Editing Evaluation

  15. OpenVTON-Bench: A Large-Scale High-Resolution Benchmark for Controllable Virtual Try-On Evaluation

    Jan 30, 2026Jin Li, Tao Chen, Kai Wen +5Virtual Try-OnImage Generation Evaluation

  16. MedGEN-Bench: A Contextually Entangled Benchmark for Open-ended Multimodal Medical Generation

    Nov 17, 2025Junjie Yang, Yuhao Yan, Gang Wu +12HealthcareMultimodal Generation