Image Generation Evaluation

Ask about this topic

Momentum

12 papers in the last four weeks, up 140% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 71

All topics
CardsList

  1. UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation

    Oct 7, 2026Deyuan Liu, Yihao Hu, Jingxuan Zhang +13T2I Generation EvaluationT2I Generation

    Westlake University · Ant Group · Zhejiang University +7

  2. Visual Jev Rewards: Reference-Bound Verification for Multi-Subject Image Generation

    Oct 7, 2026Baoteng Li, Wenzhuo Wu, Kongming Liang +1Reward ModelingImage Generation Evaluation

    School of Artificial Intelligence, Beijing University of Posts and Telecommunications1 · Beijing Key Laboratory of Multimodal Data Intelligent Perception and Governance2

  3. What Does Fréchet Distance Measure? A Directional Decomposition

    Oct 4, 2026Yunghee Lee, Jaeyeon KimImage Generation EvaluationOptimal Transport

    Agency for Defense Development, South Korea · Harvard University

  4. VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations

    Oct 1, 2026Xianda Du, Max Ku, Weiming Ren +5VLM EvaluationImage Editing Evaluation

    University of Waterloo · National Taiwan University · Nanyang Technological University +1

  5. Personalized Image Generation with Reasoning and Reflection

    Sep 30, 2026Bo Ni, Ngoc N. Tran, Qinwen Ge +10Image GenerationAgentic Image Generation

    Vanderbilt University · Adobe Systems · University of Maryland, College Park +1

  6. VIF-Bench: Evaluating Visual Instruction Following in Multi-Reference Image Generation

    Sep 29, 2026Yuta Oshima, Masakazu Yoshimura, Masahiro Suzuki +2Image GenerationCompositional Image Generation

    The University of Tokyo

  7. Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment

    Sep 29, 2026Yu Zhao, Jiarui Wang, Huiyu Duan +5LLM-as-a-JudgeImage Generation Evaluation

    Shanghai Jiao Tong University · Dalian University of Technology

  8. MaLiang-Harness: A Programmable Path to Image and Video Generation

    Sep 28, 2026Haoyu Zhao, Zihao Zhang, Xudong Wang +4Image GenerationLarge Vision-Language Models

    National University of Singapore · Fudan University · Tencent

  9. M3-Score: Fidelity, Memorization and Coverage as Separate Axes for Evaluating Generative Radiology Image Models

    Sep 27, 2026Sathiyamohan Nishankar, Pubudu Sanjeewani, Asanka PereraMaximum Mean DiscrepancyMedical Image Synthesis

    Faculty of Engineering, University of Peradeniya, Sri Lanka · School of Computing Technologies, RMIT University, Melbourne, Australia · School of Engineering & Digital Technologies, University of Southern Queensland, Brisbane, Australia +1

  10. SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation

    Sep 27, 2026Jiali Chen, Zhengteng Lin, Zuqi Wang +6Image Generation EvaluationScientific Reasoning in Language Models

    South China University of Technology, The Hong Kong Polytechnic University · South China University of Technology · The Hong Kong Polytechnic University

  11. What Makes a Good Medical Image Tokenizer? Rethinking Reconstruction and Generation in Medical Image Tokenization

    Sep 21, 2026Niklas Bubeck, Yundi Zhang, Vasiliki Sideri-Lampretsa +4Image TokenizationMedical Image Synthesis

    School of Computation, Information and Technology, Technical University of Munich, Germany · Munich Center for Machine Learning, Technical University of Munich, Germany · School of Medicine, Klinikum rechts der Isar, Technical University of Munich, Germany +3

  12. Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models

    Sep 11, 2026Justine Giroux, Jack Oliver Hilliard, Yannick Hold-Geoffroy +2Image Generation Evaluation

    Université Laval, Canada · Adobe Research, USA · Computer Vision Center & Universitat Autònoma de Barcelona, Spain

  13. UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation

    Sep 11, 2026Danning Zhang, Yijing Lin, Shuhan Zhuang +4Subject-Driven Image GenerationMultimodal Generation

    University of Science and Technology of China · Independent Rsesearcher · Shenzhen University +1

  14. Are Image Generators Zero-Shot Perceivers? A Rigorous Evaluation

    Sep 7, 2026Shangzhe Di, Zhaokai Wang, Weidi XieDistribution Shift RobustnessZero-Shot Learning

    Shanghai Jiao Tong University, China

  15. Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation

    Sep 2, 2026Yutong Liu, Nan Huang, Xu Cao +1Image GenerationImage Generation Evaluation

    University of Illinois Urbana-Champaign · New York University

  16. GenScale: A Benchmark for Relative Object Scale in Image Generation and Editing

    Sep 1, 2026Lingxiao Li, Max Whitton, Ledell Wu +1Image Editing EvaluationImage Generation

    Boston University · Creatify AI

  17. Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spaces

    Aug 13, 2026Zuzanna A. Wakefield-Skórniewska, Bartłomiej W. PapieżSynthetic-to-Real Domain AdaptationMedical Imaging Foundation Models

    Big Data Institute, Nuffield Department of Population Health, University of Oxford, United Kingdom

  18. RA-ClipScore: Making Generative Model Evaluation More Interpretable

    Aug 12, 2026Yifan Lu, Taras Kucherenko, Hedvig Kjellström +1Image GenerationImage Generation Evaluation

    KTH Royal Institute of Technology · National Library of Sweden · Most of the work was performed while Taras was at Electronic Arts (EA). +3

  19. Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Models

    Aug 10, 2026Shulin Tian, Ziqi Huang, Fan Zhang +3Tool-Augmented Language Model AgentsAI Agent Evaluation

    Shanghai Artificial Intelligence Laboratory

  20. GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers

    Aug 5, 2026Takuro Kawada, Shunsuke Kitada, Hitoshi IyatomiScientific CommunicationImage Generation Evaluation

    Hosei University · Tokyo, Japan

  21. Innocent Panels, Hateful Stories: Evaluating and Detecting Hateful Intent in Multi-Turn Visual Story Generation

    Aug 5, 2026Ye Leng, Junjie Chu, Yiting Qu +3Hate Speech DetectionImage Generation Evaluation

    1CISPA Helmholtz Center for Information Security · 2Hewlett Packard Enterprise

  22. Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation

    Aug 4, 2026Seyed Kahaki, Shijie Li, Weijie Chen +1Medical Image SynthesisImage Generation Evaluation

    Division of Imaging, Diagnostics, and Software Reliability, U.S. Food and Drug Administration (FDA)

  23. WaiT for the Signal: Simple Frequency-Aware Flow-Matching

    Jul 30, 2026Krunoslav Lehman Pavasovic, Théophane Vallaeys, Stéphane Mallat +4Flow MatchingImage Generation

    1FAIR, Meta · 2École Normale Supérieure, Paris · 3Sorbonne University, Paris

  24. Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text

    Jul 23, 2026Xu Wang, Kaixiang Yao, Miao Pan +4Spatial Reasoning BenchmarksVisual Spatial Reasoning

    OmniAI Group of ZJU ACES Lab

  25. Back to Back with a Copy: A Computational Analysis of AI-Generated Visual Contemporary Art Pastiches

    Jul 22, 2026Anca Dinu, Andreiana Mihail, Andra-Maria Florescu +2StylometryImage Generation Evaluation

    University of Bucharest, Bucharest, Romania

  26. ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis

    Jul 21, 2026Yuan Wang, Yongchao Du, Mengting Chen +4Image GenerationRL for Image Generation

    1Alibaba Group · 2Tsinghua University · 3Johns Hopkins University‌

  27. Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models

    Jul 17, 2026Junhao Liu, Jian-Wei Zhang, Tao Huang +3Unified Multimodal ModelsImage Generation

    Hunyuan, Tencent · School of Computer Science, Peking University

  28. ArtChart: Faithful Artistic Chart Generation with Integrated Text Rendering

    Jul 17, 2026Meijia Huang, Yingjie Yin, Shihao Wang +1Data VisualizationT2I Generation

    Ant Group

  29. Exploring Agentic Workflows for Generating High Quality Math Visual Aids

    Jul 10, 2026Rizwaan Malik, Ashna Khetan, Isabel Sieh +1Agentic WorkflowsLLM Agent Self-Improvement

    Stanford Graduate School of Education · Department of Computer Science

  30. PIPBench: A Profile-Inclusive Framework for Personalized Image Generation Evaluation

    Jul 7, 2026Yuhang Wu, Shuxiang Zhang, Wee Hian Ching +2Image GenerationSynthetic Benchmark Generation

    College of AI, Tsinghua University · Sun Yat-sen University · Shanghai Qi Zhi Institute