Overview

Image editing evaluation asks whether an image makes the requested change, preserves everything else, and remains visually coherent across tasks from local retouching to multi-turn and structured-content edits. Benchmarks use human ratings, paired references, controlled edits with pixel- or region-level ground truth, and specialized tests for text, geometry, identity, reasoning, and physical plausibility. Automatic methods range from image-similarity and OCR measures to vision-language model judges, interpretable rubrics, reward models, and localized defect scoring, often checked against human judgments. A central challenge is that holistic or automated scores can miss subtle unintended changes and task-specific errors, while exact metrics do not transfer across settings; evaluation must balance fine-grained diagnosis with scalable human alignment.

Latest papers

CardsList

99 papers9 papers in the last four weeks, down 47% on the four weeks before. 0.1% of all new papers.

  1. EditJudge-Bench: Auditing VLM Image-Edit Judges with Synthetic Ground Truth

    Nov 9, 2026Jens Parslov, Marco Schouten, Dim P. PapadopoulosVLM EvaluationVision-Language Model-as-a-Judge

  2. Same Pixels, Different Documents: Measuring Part-Level Editability in Image Vectorization

    Nov 6, 2026Boheng Zhu, Zehua Wang, Wei Chen +1Image VectorizationImage Editing Evaluation

  3. From Evaluation to Evolution: Benchmarking Image Editing and Evolving Image Models

    Oct 30, 2026Jun He, Canmiao Fu, Ying Zhang +7Image Editing EvaluationImage Generation Evaluation

  4. EditAgent: Rethinking Agentic Image Editing

    Oct 29, 2026Haiyang Xu, Tianyu Wang, Jialu Li +5Image EditingTool-Using Vision-Language Agents

  5. V-CAPE: Visual Consistency Assessment for Product Image Editing

    Oct 28, 2026Iaroslav Melekhov, Roberto Alcover Couso, Francesco Taioli +4Image Editing EvaluationImage Editing

  6. MoI-Bench: A Benchmark for Image Generation and Editing on Mobile Devices

    Oct 27, 2026Kailai Feng, Haoxiang Rao, Yuxiang Wei +5Image Editing EvaluationImage Generation Evaluation

  7. CropReward: A Human-Preference Benchmark and Reward Model for Aesthetic Image Cropping

    Oct 25, 2026Xiangfei Sheng, Xiaofeng Pan, Leida Li +4Reward ModelingHuman Preference Modeling

  8. ABACUS: A Benchmark for Image Editing Models to Assess Object Category and Counting Under Scene Conservation

    Oct 20, 2026Aymen Lassoued, Angelique Loesch, Romaric AudigierImage Editing EvaluationImage Editing

  9. Only Means Only: what a harmonization benchmark score averages over

    Oct 18, 2026Imad Buljić, Delaida MuminovićImage Editing EvaluationData Leakage

  10. MTEdit: Packed Trajectories Beat Rollouts for Multi-Turn Image Editing

    Oct 16, 2026Houyuan Chen, Fanzhou Wang, Xiangyu Fan +8Multi-Turn Image EditingImage Editing

  11. DuplexBridge: Coordinating Understanding and Generation for Unified Image Editing

    Oct 13, 2026Yidi Liu, Jie Xiao, Chaojie Mao +2Image EditingText-Guided Image Editing

  12. Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation

    Oct 12, 2026Shun Guo, Shuizhou Shi, Boao Wang +4Image Editing EvaluationText-Guided Image Editing

  13. SliderEdit++: Improved Slider Trajectories in Instruction-Based Image Editing

    Oct 9, 2026Arman Zarei, Sayan Nag, Bryan Wang +5Image EditingText-Guided Image Editing

  14. Reasoning-Informed Visual Editing

    Oct 8, 2026Xue Yang, Peiyuan Zhang, Yilun Zhu +12Image EditingImage Editing Evaluation

  15. ScribbleEdit: A Benchmark for Scribble-Only Image Editing

    Oct 7, 2026Jie Ren, Hao Kang, Kai Guo +9Image EditingImage Editing Evaluation

  16. UniSlider: Perceptually Uniform Sliders for Continuous Image Editing

    Oct 5, 2026David Serrano-Lozano, Duygu Ceylan, Yannick Hold-Geoffroy +3Image Editing EvaluationDiffusion-Based Image Editing

  17. Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assets

    Oct 3, 2026Muyao Wang, Chen Zhu, Shiqi Yang +2Image EditingImage Editing Evaluation

  18. Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservation

    Oct 1, 2026Yuan Huang, Zirui Song, Xiuying ChenVLM RobustnessLLM-as-a-Judge

  19. VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations

    Oct 1, 2026Xianda Du, Max Ku, Weiming Ren +5VLM EvaluationImage Editing Evaluation

  20. When the Editing Intent Is Split: A Cross-Modal Jailbreak Attack for Large Image Editing Models

    Sep 30, 2026Xianmin Ye, Zhiyuan Fan, Tianju Liu +3Multimodal Jailbreak AttacksImage Editing Evaluation

  21. SolveEdit: Benchmarking Visual Problem Solving in Generative Models

    Sep 28, 2026Wenjie Shu, Yexin Liu, Harold Haodong Chen +9Image Editing EvaluationVisual Reasoning

  22. InfoEdit: Probing Global Layout Reasoning in Infographic Editing

    Sep 27, 2026Cheng Yang, Chufan Shi, Huijuan Wang +6Image Editing EvaluationText-Guided Image Editing

  23. KwaiMind Technical Report

    Sep 22, 2026Boheng Zhang, Fan Yang, Jia Sun +14Image Editing EvaluationDiffusion-Based Image Editing

  24. GenScale: A Benchmark for Relative Object Scale in Image Generation and Editing

    Sep 1, 2026Lingxiao Li, Max Whitton, Ledell Wu +1Image Editing EvaluationImage Generation

  25. A Large-scale Evaluation of Text-guided Models for Facial Editing

    Aug 28, 2026Rahul Nair, Saurav Pandit, Hannah KernerText-Guided Image EditingImage Editing

  26. RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing

    Aug 27, 2026Zijian Kan, Wei Wang, Long Luo +6Reward ModelingMultimodal Reward Modeling