Overview

Image editing evaluation asks whether an image makes the requested change, preserves everything else, and remains visually coherent across tasks from local retouching to multi-turn and structured-content edits. Benchmarks use human ratings, paired references, controlled edits with pixel- or region-level ground truth, and specialized tests for text, geometry, identity, reasoning, and physical plausibility. Automatic methods range from image-similarity and OCR measures to vision-language model judges, interpretable rubrics, reward models, and localized defect scoring, often checked against human judgments. A central challenge is that holistic or automated scores can miss subtle unintended changes and task-specific errors, while exact metrics do not transfer across settings; evaluation must balance fine-grained diagnosis with scalable human alignment.

Latest papers

CardsList

92 papers16 papers in the last four weeks, up 300% on the four weeks before. 0.1% of all new papers.

  1. ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services

    Apr 27, 2026Fengxian Ji, Jingpu Yang, Zirui Song +5Image Editing EvaluationImage Generation Evaluation

  2. HP-Edit: A Human-Preference Post-Training Framework for Image Editing

    Apr 21, 2026Fan Li, Chonghuinan Wang, Lina Lei +9Diffusion Model AlignmentImage Editing Evaluation

  3. Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing

    Apr 16, 2026Yixuan Ding, Wei Huang, Ruijie Quan +2Image Editing EvaluationText-Guided Image Editing

  4. Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment

    Apr 14, 2026Xinjie Zhang, Qiang Li, Xiaowen Ma +3Image Editing EvaluationImage Quality Assessment

  5. AIM-Bench: Benchmarking and Improving Affective Image Manipulation via Fine-Grained Hierarchical Control

    Apr 12, 2026Shi Chen, Xuecheng Wu, Heli Sun +8Image Editing EvaluationAffective Computing

  6. MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing

    Apr 6, 2026Ziqian Liu, Stephan AlanizImage EditingText-Guided Image Editing

  7. SpatialEdit: Benchmarking Fine-Grained Image Spatial Editing

    Apr 6, 2026Yicheng Xiao, Wenhu Zhang, Lin Song +10Image EditingImage Editing Evaluation

  8. Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro

    Apr 3, 2026Kenan Tang, Praveen Arunshankar, Andong Hua +2Image EditingImage Editing Evaluation

  9. FED-Bench: A Cross-Granular Benchmark for Disentangled Evaluation of Facial Expression Editing

    Mar 31, 2026Fengjian Xue, Xuecheng Wu, Heli Sun +8Image EditingImage Editing Evaluation

  10. GEditBench v2: A Human-Aligned Benchmark for General Image Editing

    Mar 30, 2026Zhangqi Jiang, Zheng Sun, Xianfang Zeng +7Image Editing EvaluationText-Guided Image Editing

  11. CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructions

    Mar 27, 2026Chonghuinan Wang, Zihan Chen, Yuxiang Wei +5Image Editing EvaluationAutomated Evaluation

  12. PixelSmile: Toward Fine-Grained Facial Expression Editing

    Mar 26, 2026Jiabin Hua, Hengyuan Xu, Aojie Li +4Image EditingDiffusion-Based Image Editing

  13. Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approach

    Mar 20, 2026Shiqi Gao, Zitong Xu, Kang Fu +3Image Editing EvaluationText-Guided Image Editing

  14. Omni IIE Bench: Benchmarking the Practical Capabilities of Image Editing Models

    Mar 16, 2026Yujia Yang, Yuanxiang Wang, Zhenyu Guan +11Image EditingImage Editing Evaluation

  15. EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editing

    Mar 16, 2026Zitong Xu, Huiyu Duan, Zhongpeng Ji +9Image Editing EvaluationText-Guided Image Editing

  16. GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing

    Mar 12, 2026Mingxin Liu, Ziqian Fan, Zhaokai Wang +13Image Editing EvaluationText-Guided Image Editing

  17. VTEdit-Bench: A Comprehensive Benchmark for Multi-Reference Image Editing Models in Virtual Try-On

    Mar 12, 2026Xiaoye Liang, Zhiyuan Qu, Mingye Zou +4Virtual Try-OnImage Editing Evaluation

  18. WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editing

    Mar 12, 2026Hui Zhang, Juntao Liu, Zongkai Liu +4Image EditingText-Guided Image Editing

  19. Scalable Evaluation of the Realism of Synthetic Environmental Augmentations in Images

    Mar 4, 2026Damian J. Ruck, Paul Vautravers, Oliver Chalkley +1Synthetic Data EvaluationImage Editing Evaluation

  20. InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models

    Mar 4, 2026Zhiqiang Sheng, Xumeng Han, Zhiwei Zhang +6Image Editing EvaluationImage Editing

  21. Generative Visual Chain-of-Thought for Image Editing

    Mar 2, 2026Zijin Yin, Tiankai Hang, Yiji Cheng +9Text-Guided Image EditingVisual CoT

  22. DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model

    Feb 27, 2026Shibo Hong, Boxian Ai, Jun Kuang +5Image Editing EvaluationImage Editing

  23. RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward

    Feb 19, 2026Qiucheng Wu, Jing Shi, Simon Jenni +4Text-Guided Image EditingRL for Image Editing

  24. Toward Trustworthy Portrait Editing: Evaluation of Demographic Misrepresentation in I2I Models

    Feb 18, 2026Huichan Seo, Minki Hong, Sieun Choi +2Algorithmic BiasImage Editing Evaluation