Image Generation Evaluation

Ask about this topic

Momentum

12 papers in the last four weeks, up 140% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 71

All topics
CardsList

  1. UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation

    Oct 7, 2026Deyuan Liu, Yihao Hu, Jingxuan Zhang +13T2I Generation EvaluationT2I Generation

    Westlake University · Ant Group · Zhejiang University +7

  2. Visual Jev Rewards: Reference-Bound Verification for Multi-Subject Image Generation

    Oct 7, 2026Baoteng Li, Wenzhuo Wu, Kongming Liang +1Reward ModelingImage Generation Evaluation

    School of Artificial Intelligence, Beijing University of Posts and Telecommunications1 · Beijing Key Laboratory of Multimodal Data Intelligent Perception and Governance2

  3. What Does Fréchet Distance Measure? A Directional Decomposition

    Oct 4, 2026Yunghee Lee, Jaeyeon KimImage Generation EvaluationOptimal Transport

    Agency for Defense Development, South Korea · Harvard University

  4. VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations

    Oct 1, 2026Xianda Du, Max Ku, Weiming Ren +5VLM EvaluationImage Editing Evaluation

    University of Waterloo · National Taiwan University · Nanyang Technological University +1

  5. Personalized Image Generation with Reasoning and Reflection

    Sep 30, 2026Bo Ni, Ngoc N. Tran, Qinwen Ge +10Image GenerationAgentic Image Generation

    Vanderbilt University · Adobe Systems · University of Maryland, College Park +1

  6. VIF-Bench: Evaluating Visual Instruction Following in Multi-Reference Image Generation

    Sep 29, 2026Yuta Oshima, Masakazu Yoshimura, Masahiro Suzuki +2Image GenerationCompositional Image Generation

    The University of Tokyo

  7. Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment

    Sep 29, 2026Yu Zhao, Jiarui Wang, Huiyu Duan +5LLM-as-a-JudgeImage Generation Evaluation

    Shanghai Jiao Tong University · Dalian University of Technology

  8. MaLiang-Harness: A Programmable Path to Image and Video Generation

    Sep 28, 2026Haoyu Zhao, Zihao Zhang, Xudong Wang +4Image GenerationLarge Vision-Language Models

    National University of Singapore · Fudan University · Tencent

  9. M3-Score: Fidelity, Memorization and Coverage as Separate Axes for Evaluating Generative Radiology Image Models

    Sep 27, 2026Sathiyamohan Nishankar, Pubudu Sanjeewani, Asanka PereraMaximum Mean DiscrepancyMedical Image Synthesis

    Faculty of Engineering, University of Peradeniya, Sri Lanka · School of Computing Technologies, RMIT University, Melbourne, Australia · School of Engineering & Digital Technologies, University of Southern Queensland, Brisbane, Australia +1

  10. SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation

    Sep 27, 2026Jiali Chen, Zhengteng Lin, Zuqi Wang +6Image Generation EvaluationScientific Reasoning in Language Models

    South China University of Technology, The Hong Kong Polytechnic University · South China University of Technology · The Hong Kong Polytechnic University

  11. What Makes a Good Medical Image Tokenizer? Rethinking Reconstruction and Generation in Medical Image Tokenization

    Sep 21, 2026Niklas Bubeck, Yundi Zhang, Vasiliki Sideri-Lampretsa +4Image TokenizationMedical Image Synthesis

    School of Computation, Information and Technology, Technical University of Munich, Germany · Munich Center for Machine Learning, Technical University of Munich, Germany · School of Medicine, Klinikum rechts der Isar, Technical University of Munich, Germany +3

  12. Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models

    Sep 11, 2026Justine Giroux, Jack Oliver Hilliard, Yannick Hold-Geoffroy +2Image Generation Evaluation

    Université Laval, Canada · Adobe Research, USA · Computer Vision Center & Universitat Autònoma de Barcelona, Spain

  13. UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation

    Sep 11, 2026Danning Zhang, Yijing Lin, Shuhan Zhuang +4Subject-Driven Image GenerationMultimodal Generation

    University of Science and Technology of China · Independent Rsesearcher · Shenzhen University +1

  14. Are Image Generators Zero-Shot Perceivers? A Rigorous Evaluation

    Sep 7, 2026Shangzhe Di, Zhaokai Wang, Weidi XieDistribution Shift RobustnessZero-Shot Learning

    Shanghai Jiao Tong University, China

  15. Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation

    Sep 2, 2026Yutong Liu, Nan Huang, Xu Cao +1Image GenerationImage Generation Evaluation

    University of Illinois Urbana-Champaign · New York University

  16. GenScale: A Benchmark for Relative Object Scale in Image Generation and Editing

    Sep 1, 2026Lingxiao Li, Max Whitton, Ledell Wu +1Image Editing EvaluationImage Generation

    Boston University · Creatify AI

  17. Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spaces

    Aug 13, 2026Zuzanna A. Wakefield-Skórniewska, Bartłomiej W. PapieżSynthetic-to-Real Domain AdaptationMedical Imaging Foundation Models

    Big Data Institute, Nuffield Department of Population Health, University of Oxford, United Kingdom

  18. RA-ClipScore: Making Generative Model Evaluation More Interpretable

    Aug 12, 2026Yifan Lu, Taras Kucherenko, Hedvig Kjellström +1Image GenerationImage Generation Evaluation

    KTH Royal Institute of Technology · National Library of Sweden · Most of the work was performed while Taras was at Electronic Arts (EA). +3

  19. Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Models

    Aug 10, 2026Shulin Tian, Ziqi Huang, Fan Zhang +3Tool-Augmented Language Model AgentsAI Agent Evaluation

    Shanghai Artificial Intelligence Laboratory

  20. GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers

    Aug 5, 2026Takuro Kawada, Shunsuke Kitada, Hitoshi IyatomiScientific CommunicationImage Generation Evaluation

    Hosei University · Tokyo, Japan

  21. Innocent Panels, Hateful Stories: Evaluating and Detecting Hateful Intent in Multi-Turn Visual Story Generation

    Aug 5, 2026Ye Leng, Junjie Chu, Yiting Qu +3Hate Speech DetectionImage Generation Evaluation

    1CISPA Helmholtz Center for Information Security · 2Hewlett Packard Enterprise

  22. Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation

    Aug 4, 2026Seyed Kahaki, Shijie Li, Weijie Chen +1Medical Image SynthesisImage Generation Evaluation

    Division of Imaging, Diagnostics, and Software Reliability, U.S. Food and Drug Administration (FDA)

  23. WaiT for the Signal: Simple Frequency-Aware Flow-Matching

    Jul 30, 2026Krunoslav Lehman Pavasovic, Théophane Vallaeys, Stéphane Mallat +4Flow MatchingImage Generation

    1FAIR, Meta · 2École Normale Supérieure, Paris · 3Sorbonne University, Paris

  24. Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text

    Jul 23, 2026Xu Wang, Kaixiang Yao, Miao Pan +4Spatial Reasoning BenchmarksVisual Spatial Reasoning

    OmniAI Group of ZJU ACES Lab

  25. Back to Back with a Copy: A Computational Analysis of AI-Generated Visual Contemporary Art Pastiches

    Jul 22, 2026Anca Dinu, Andreiana Mihail, Andra-Maria Florescu +2StylometryImage Generation Evaluation

    University of Bucharest, Bucharest, Romania

  26. ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis

    Jul 21, 2026Yuan Wang, Yongchao Du, Mengting Chen +4Image GenerationRL for Image Generation

    1Alibaba Group · 2Tsinghua University · 3Johns Hopkins University‌

  27. Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models

    Jul 17, 2026Junhao Liu, Jian-Wei Zhang, Tao Huang +3Unified Multimodal ModelsImage Generation

    Hunyuan, Tencent · School of Computer Science, Peking University

  28. ArtChart: Faithful Artistic Chart Generation with Integrated Text Rendering

    Jul 17, 2026Meijia Huang, Yingjie Yin, Shihao Wang +1Data VisualizationT2I Generation

    Ant Group

  29. Exploring Agentic Workflows for Generating High Quality Math Visual Aids

    Jul 10, 2026Rizwaan Malik, Ashna Khetan, Isabel Sieh +1Agentic WorkflowsLLM Agent Self-Improvement

    Stanford Graduate School of Education · Department of Computer Science

  30. PIPBench: A Profile-Inclusive Framework for Personalized Image Generation Evaluation

    Jul 7, 2026Yuhang Wu, Shuxiang Zhang, Wee Hian Ching +2Image GenerationSynthetic Benchmark Generation

    College of AI, Tsinghua University · Sun Yat-sen University · Shanghai Qi Zhi Institute

  31. Patch Knowledge Transfer for Efficient AI-Generated Image Quality Assessment

    Jul 6, 2026Jiquan YuanImage Quality AssessmentImage Generation Evaluation

    School of Software and Microelectronics, Peking University, Beijing, China

  32. Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

    Jul 6, 2026Haozhe Wang, Weijia Feng, Jinpeng Yu +8Image GenerationAgentic Image Generation

    1Hong Kong University of Science and Technology · 3Qwen Applications · 4Imperial College London +1

  33. PosterHarness: Turning Scientific Poster Generation into an Auditable Instruction-Following Benchmark

    Jul 3, 2026Tianyi Yang, Dawei Fu, Youpeng Wu +5AI-Assisted Scientific ResearchImage Generation

    School of Physics, Peking University

  34. Representation Distribution Matching for One-Step Visual Generation

    Jul 2, 2026Lan Feng, Wuyang Li, Eloi Zablocki +2Maximum Mean DiscrepancyOne-Step Generative Modeling

    1EPFL, Switzerland · 2Valeo.ai, France · 3Sorbonne Universit´e, France

  35. MIBE: Multi-subject Interaction Benchmark and Evaluator for Personalized Image Generation

    Jul 1, 2026Zhihan Chen, Yuhuan Zhao, Yijie Zhu +7Subject-Driven Image GenerationIdentity-Preserving Image Generation

    University of California, Los Angeles · University of Southern California · DeerLab LLC +5

  36. Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards

    Jun 25, 2026Ritesh Thawkar, Shravan Venkatraman, Omkar Thawakar +5Unified Multimodal ModelsMultimodal Generation

    1Mohamed bin Zayed University of Artificial Intelligence · 4Linköping University · 3Australian National University +1

  37. Scaling Multi-Reference Image Generation with Dynamic Reward Optimization

    Jun 25, 2026Wenwang Huang, Yusen Fu, Junjie Wang +6Image GenerationRL for Generative Models

    Harbin Institute of Technology, Shenzhen · Independent Researcher · Shenzhen Loop Area Institute

  38. DiffusionBench: On Holistic Evaluation of Diffusion Transformers

    Jun 23, 2026Xingjian Leng, Jaskirat Singh, Zhanhao Liang +5Diffusion TransformerImage Generation Evaluation

    Australian National University · Canva Research

  39. The FID Lottery: Quantifying Hidden Randomness in Generative-Model Evaluation

    Jun 18, 2026Nicolas Dufour, Alexei A. Efros, Patrick PérezML ReproducibilityImage Generation Evaluation

    Kyutai · UC Berkeley

  40. BAFIS: Dataset + Framework to assess occupational Bias and Human Preference in modern Text-to-image Models

    Jun 18, 2026Thomas Klassert, Adrian Ulges, Biying FuImage Generation EvaluationDemographic Bias in T2I Models

    RheinMain University of Applied Sciences, Wiesbaden, Germany

  41. Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment

    Jun 15, 2026Zijie MengVLM EvaluationImage Quality Assessment

    Peking University

  42. CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation

    Jun 14, 2026Long-Bao Nguyen, Quang-Khai Le, Tam V. Nguyen +2Compositional Image GenerationIdentity-Preserving Image Generation

    University of Science, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam · University of Dayton, Ohio, United States

  43. Vision-Encoder Behavioral Fingerprints of Image-to-Image Generative Models: A Training-Paradigm-Driven Taxonomy of Six Commercial APIs

    Jun 10, 2026Hunter HillImage-to-Image TranslationImage Generation Evaluation

  44. The 1st PortraitCraft Challenge: A CVPR 2026 Workshop Competition on Portrait Composition Understanding and Generation

    Jun 9, 2026Zijie Lou, Youyun Tang, Xiaochao Qu +40Compositional Image GenerationImage Generation Evaluation

  45. Can Image Models Imagine Time? ImageTime: A Novel Benchmark for Probing Visual World Modeling Through Spatiotemporal Consistency

    Jun 9, 2026Xinrui Wu, Lichen HuangWorld Model LearningConditional Image Generation

    University of Electronic Science and Technology of China

  46. Diffusing in the Right Space: A Systematic Study of Latent Diffusability

    Jun 2, 2026Tianxiong Zhong, Xingye Tian, Xuebo Wang +2Latent Diffusion ModelsImage Tokenization

    Kling Team, Kuaishou Technology

  47. Inverting the Generation Process of Denoising Diffusion Implicit Models: Empirical Evaluation and a Novel Method

    Jun 2, 2026Yan Zeng, Masanori Suganuma, Takayuki OkataniDiffusion Model InversionDiffusion Sampling

    Graduate School of Information Sciences, Tohoku University · RIKEN Center for AIP

  48. No Free Lunch for Synthetic Images under Data Scarcity Conditions

    Jun 1, 2026Borja Arroyo Galende, Alejandro Almodóvar, Patricia A. Apellániz +3Synthetic Data GenerationGenerative Modeling

    Information Processing and Telecommunications Center, Escuela Técnica Superior de Ingeniería de Telecomunicación, Universidad Politécnica de Madrid, Madrid, 28030, Spain · Escuela Técnica Superior de Ingeniería de Sistemas Informáticos, Universidad Politécnica de Madrid, Madrid, 28030, Spain

  49. The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue

    Jun 1, 2026Sherzod Hakimov, Mattia D'Agostini, Ivan Samodelkin +1VLM EvaluationMultimodal Grounding

    Computational Linguistics, Department of Linguistics University of Potsdam, Germany · German Research Center for Artificial Intelligence (DFKI), Berlin, Germany

  50. Score-Control for Hallucination Reduction in Diffusion Models

    May 29, 2026Mahesh Bhosale, Naresh Kumar Devulapally, Abdul Wasi +3Score MatchingDiffusion-Based Image Generation

    University at Buffalo Buffalo, NY, USA

  51. GPIC: A Giant Permissive Image Corpus for Visual Generation

    May 28, 2026Keshigeyan Chandrasegaran, Kyle Sargent, Suchir Agarwal +6Image GenerationImage Generation Evaluation

    Stanford University · Radical Numerics · Salesforce Research +1

  52. Rethinking FID Through the Geometry of the Reference Dataset

    May 28, 2026Yunghee Lee, Byeonghyun PakImage Generation Evaluation

  53. MaSC: A Masked Similarity Metric for Evaluating Concept-Driven Generation

    May 21, 2026Patryk Bartkowiak, Lennart Petersen, Bartosz Kotrys +3Subject-Driven Image GenerationImage Generation Evaluation

    Adam Mickiewicz University · Kiel University · ArtCollect +1

  54. QQJ: Quantifying Qualitative Judgment for Scalable and Human-Aligned Evaluation of Generative AI

    May 17, 2026Marjan Veysi, Pirooz Shamsinejadbabaki, Mohammad Zare +1LLM-as-a-JudgeHuman-in-the-Loop Evaluation

    AI Lab, Arioobarzan Engineering Team, Shiraz, Iran · Department of Computer Engineering and Information Technology, Shiraz University of Technology, Shiraz, Iran · Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy

  55. One Pass Is Not Enough: Recursive Latent Refinement for Generative Models

    May 14, 2026Mehdi Esmaeilzadeh, Alexia Jolicoeur-Martineau, Chirag Vashist +1Generative ModelingImage Generation Evaluation

    1Simon Fraser University · 2Independent

  56. Generative AI for Visualizing Highway Construction Hazards Through Synthetic Images and Temporal Sequences

    May 11, 2026Trevor Neece, Mason Smetana, Lev KhazanovichImage GenerationAutoregressive Image Generation

    University of Pittsburgh, Pittsburgh, PA, USA

  57. When Style Similarity Scores Fail: Diagnosing Raw CSD Cosine in Artist-Style Evaluation

    May 9, 2026Jörg FrochtePairwise ComparisonImage Generation Evaluation

    Bochum University of Applied Sciences

  58. RewardHarness: Self-Evolving Agentic Post-Training

    May 9, 2026Yuxuan Zhang, Penghui Du, Bo Li +11Reward ModelingImage Editing Evaluation

    University of British Columbia · Kolors Team, Kuaishou Technology · University of Waterloo +4

  59. APEX: Assumption-free Projection-based Embedding eXamination Metric for Image Quality Assessment

    May 8, 2026Caterina Gallegati, Monica Bianchini, Franco Scarselli +2Image Quality AssessmentImage Generation Evaluation

    University of Siena, Italy · AI for Good (AIGO), Istituto Italiano di Tecnologia, Italy · University of Verona, Italy

  60. MIND: Monge Inception Distance for Generative Models Evaluation

    May 7, 2026Quentin Berthet, Yu-Han Wu, Clement Crepy +3Image Generation EvaluationSliced Wasserstein Distance

    Google DeepMind · LPSM, Sorbonne Université