Image Editing Evaluation

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 49

All topics

ScribbleEdit: A Benchmark for Scribble-Only Image Editing
Oct 7, 2026Jie Ren, Hao Kang, Kai Guo +9Image Editing Image Editing Evaluation
MIT · ByteDance · Michigan State University
Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Audit
Oct 7, 2026Zhihan Chen, Yuhuan Zhao, Yijie Zhu +4Image Editing Image Editing Evaluation
UniSlider: Perceptually Uniform Sliders for Continuous Image Editing
Oct 5, 2026David Serrano-Lozano, Duygu Ceylan, Yannick Hold-Geoffroy +3Image Editing Evaluation Diffusion-Based Image Editing
Computer Vision Center · Universitat Autònoma de Barcelona · Adobe Research
Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservation
Oct 1, 2026Yuan Huang, Zirui Song, Xiuying ChenVLM Robustness LLM-as-a-Judge
Northeastern University · Mohamed bin Zayed University of Artificial Intelligence
VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations
Oct 1, 2026Xianda Du, Max Ku, Weiming Ren +5VLM Evaluation Image Editing Evaluation
University of Waterloo · National Taiwan University · Nanyang Technological University +1
SolveEdit: Benchmarking Visual Problem Solving in Generative Models
Sep 28, 2026Wenjie Shu, Yexin Liu, Harold Haodong Chen +9Image Editing Evaluation Visual Reasoning
ZODA · HKUST · UCAS +2
InfoEdit: Probing Global Layout Reasoning in Infographic Editing
Sep 27, 2026Cheng Yang, Chufan Shi, Huijuan Wang +6Image Editing Evaluation Text-Guided Image Editing
University of California San Diego · University of Southern California · University of Illinois Urbana-Champaign +1
KwaiMind Technical Report
Sep 22, 2026Boheng Zhang, Fan Yang, Jia Sun +14Image Editing Evaluation Diffusion-Based Image Editing
KwaiMind Team, Kuaishou Group
GenScale: A Benchmark for Relative Object Scale in Image Generation and Editing
Sep 1, 2026Lingxiao Li, Max Whitton, Ledell Wu +1Image Editing Evaluation Image Generation
Boston University · Creatify AI
SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision
Aug 10, 2026Weixin Ye, Wei Wang, Hongguang Zhu +1Image Editing Evaluation Text-Guided Image Editing
Institute of Information Science, Beijing Jiaotong University Visual Intelligence + X International Joint Laboratory Beijing, China · City University of Macau Macau, Macau · Meitu Inc Beijing, China
Localize, Don't Beautify: Client-Side Control of Image-Editing APIs for Cosmetic Surgery Previews
Aug 3, 2026Sukhrobbek IlyosbekovImage Editing Evaluation Text-Guided Image Editing
Northeastern University
MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing
Aug 3, 2026Zitong Xu, Huiyu Duan, Xinyun Zhang +7Image Editing Evaluation Text-Guided Image Editing
Shanghai Jiao Tong University · Vivo Mobile Communication Co., Ltd · University of Electronic and Science Technology of China
MDTD-ArtIR: Benchmarking Image Editing and Restoration Models for Art Image Restoration under Texture-Overlay Degradations
Aug 1, 2026Mridula Vijendran, Shuang Chen, Hubert P. H. ShumImage Editing Evaluation Image Restoration
Department of Computer Science, Durham University, Durham, United Kingdom
Image-Space Rule Discovery
Aug 1, 2026Misora Sugiyama, Toya Oyama, Hirokatsu KataokaImage Editing Evaluation Text-Guided Image Editing
The University of Tokyo · National Institute of Advanced Industrial Science and Technology (AIST) · Visual Geometry Group, University of Oxford
Evaluation-Verification Reward for Consistent Multi-Reference Image Editing
Jul 31, 2026Yingmao Miao, Pengfei Zhang, Xiaochen Lv +5Image Editing Evaluation Multimodal Reward Modeling
Xi’an Jiaotong University · DreamX Team, Alibaba Group · Shanghai Jiaotong University
MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing
Jul 30, 2026Jiajia Lin, Mingxuan Du, Tuowen Zhou +2Image Editing Evaluation
University of Science and Technology of China, 2Metastone Technology, Beijing, China · Work done during the internship at Metastone.
VETO: Towards Protecting Images From Frontier AI Editing
Jul 29, 2026Jonas Grebe, Hossein Shakibania, Tobias Braun +2Image Editing Evaluation Adversarial Examples
TU Darmstadt & hessian.AI, Germany · Zuse School ELIZA
Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications
Jul 28, 2026Xianghao Zang, Zijian Jiang, Jiarong Cheng +8Image Editing Evaluation Text-Guided Image Editing
Institute of Artificial Intelligence (TeleAI), China Telecom, Beijing, China.
RS-RIE-Bench: Benchmarking Reasoning-Guided Remote Sensing Image Editing
Jul 22, 2026Zihan Qin, Boao Xu, Zhao Dong +4Image Editing Evaluation Remote Sensing Benchmarks
School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University, Xi’an 710072, China. · Xi’an Modern Control Technology Research Institute, Xi’an 710065, China. · Lanzhou Institute of Physics, Lanzhou 730000, China. +2
Vector-Bench: Can Models Surgically Edit SVG Code?
Jul 21, 2026Yug Aditi Gupta, Prannay HebbarImage Editing Evaluation Image Editing
Theta Labs · Warping
ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing
Jul 11, 2026Jiakang Yu, Yixuan Chai, Tianci Wang +7Data Visualization Image Editing Evaluation
1Jianghan University · †Work done during an internship at HiThink Research. · 2HiThink Research +3
Making Implicit Preservation Intent Explicit in Conversational Image Editing
Jul 8, 2026Soomin Han, Jihyung Ahn, Bumsoo Kim +1Image Editing Evaluation Image Editing
Sogang University · Korea University · Chung-Ang University
GMO-E $^2$ DIT: Grounded Multi-Operation Editing for E-Commerce Images
Jul 1, 2026Zipeng Guo, Xiaoan Liu, Lichen Ma +9Image Editing Evaluation Text-Guided Image Editing
Wuhan University · Xi’an Jiaotong University · Sun Yat-sen University
Envisage: Diffusion-Based Rhinoplasty Goal Visualization with Mask-Decomposed Evaluation
Jun 26, 2026Mudit Agarwal, Amit D. BhranyImage Editing Evaluation Image Inpainting
University of Washington · Seattle, WA, USA · Department of Otolaryngology–Head and Neck Surgery +1
Do Image Editing Models Understand Lighting?
Jun 25, 2026Tim Küchler, Johann-Friedrich Feiden, Matthias Nießner +1Image Editing Evaluation Image Relighting
Heidelberg University · Zuse School ELIZA · Technical University of Munich
PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing
Jun 25, 2026Shengbin Guo, Shaokang He, Chaoyue Meng +4Image Editing Evaluation Image Editing
Nanjing University · SDU · HRBEU +2
ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL
Jun 17, 2026Mukund Khanna, Raj Singh Yadav, Kunal SinghImage Editing Evaluation Text-Guided Image Editing
Fractal Analytics
Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework
Jun 17, 2026Jiayi Gao, Qingchao Chen, Yuxin Peng +1Image-to-Video Generation Image Editing Evaluation
Wangxuan Institute of Computer Technology, Peking University, Beijing, China · National Institute of Health Data Science, Peking University, Beijing, China.
An Extensive Benchmark for Single-round and Multi-round Instruction-based Image Editing
Jun 14, 2026Yiwei Ma, Ke Ye, Weihuang Lin +4Image Editing Evaluation Text-Guided Image Editing
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, Fujian, P.R. China. · National University of Singapore, 119077, Singapore.
On the Controllability-Fidelity Frontier in Diffusion Editing
Jun 5, 2026Yi Hu, Leying Yi, Emily Davis +1Diffusion Model Inversion Diffusion Model Guidance
Xidian University
When Recovery Matters: The Blind Spot of Surrogate Privacy in MLLM Editing
Jun 5, 2026Siyuan Xu, Yibing Liu, Peilin Chen +3Image Editing Evaluation Text-Guided Image Editing
1City University of Hong Kong, Hong Kong. · 2Hon Hai Research Institute, Taipei. · 3Lingnan University, Hong Kong.
Edit-R2: Context-Aware Reinforcement Learning for Multi-Turn Image Editing
Jun 4, 2026Yuxiao Ye, Haoran He, Fangyuan Kong +4Reinforcement Learning Image Editing Evaluation
Hong Kong University of Science and Technology · Kuaishou Technology
TECCI: Tricky Edits of Collected and Curated Images
May 31, 2026Aishwarya Agrawal, Roy Hirsch, Yasumasa Onoe +2VLM Evaluation Image Editing Evaluation
Google Research · Google DeepMind
CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences
May 30, 2026Fangzhou Lin, Peiran Li, Lingyu Xu +12Image Editing Evaluation Text-Guided Image Editing
Texas A&M University · Worcester Polytechnic Institute · Tohoku University +4
PaintBench: Deterministic Evaluation of Precise Visual Editing
May 29, 2026Kai Xu, Ellis Brown, Shrikar Madhu +3Image Editing Evaluation Text-Guided Image Editing
New York University
VINS-120K: Ultra High-Resolution Image Editing with A Large-Scale Dataset
May 22, 2026Zhizhou Chen, Shanyan Guan, Zhanxin Gao +6Image Editing Evaluation Text-Guided Image Editing
Nanjing University, China · vivo, China
Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysis
May 14, 2026Mor Ventura, Roy Hirsch, Yonatan Bitton +2Image Editing Evaluation Text-Guided Image Editing
1Technion – Israel Institute of Technology · 2Google Research · *Work done during an internship at Google Research.
PROVE: A Perceptual RemOVal cohErence Benchmark for Visual Media
May 14, 2026Fuhao Li, Shaofeng You, Jiagao Hu +6Image Editing Evaluation Video Editing
MiLM Plus, Xiaomi Inc.
PhysEditBench: A Protocol-Conditioned Benchmark for Dense Physical-Map Prediction with Image Editors
May 13, 2026Jiaxin Yang, Yu Hou, Muxin Liu +5Image Editing Evaluation Depth Estimation
Southern University of Science and Technology, Shenzhen, China · The University of Hong Kong, Hong Kong, China · East China Normal University, Shanghai, China
Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling
May 13, 2026Xuehai Bai, Yang Shi, Yi-Fan Zhang +7Reward Modeling Image Editing Evaluation
HDU · PKU · Kling Team +1
RewardHarness: Self-Evolving Agentic Post-Training
May 9, 2026Yuxuan Zhang, Penghui Du, Bo Li +11Reward Modeling Image Editing Evaluation
University of British Columbia · Kolors Team, Kuaishou Technology · University of Waterloo +4
ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning
May 8, 2026Honghua Chen, Zitong Xu, Huiyu Duan +3Image Editing Evaluation Text-Guided Image Editing
University of Electronic Science and Technology of China · 2Shanghai Jiao Tong University
StableI2I: Spotting Unintended Changes in Image-to-Image Transition
May 6, 2026Jiayang Li, Shuo Cao, Xiaohui Li +6VLM Evaluation Image Editing Evaluation
Peking University · Shanghai Artificial Intelligence Laboratory · University of Science and Technology of China +1
MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editing
May 4, 2026Liwei Cheng, Shibo Feng, Lunjie Zhou +2Image Editing Evaluation Text-Guided Image Editing
1Harbin Institute of Technology
When the Forger Is the Judge: GPT-Image-2 Cannot Recognize Its Own Faked Documents
Apr 28, 2026Jiaqi Wu, Yuchen Zhou, Dennis Tsang Ng +5Image Editing Evaluation Image Forgery Detection
arXiv:2604.25213v1
ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services
Apr 27, 2026Fengxian Ji, Jingpu Yang, Zirui Song +5Image Editing Evaluation Image Generation Evaluation
MBZUAI, United Arab Emirates · Institute of Automation, Chinese Academy of Sciences, China
HP-Edit: A Human-Preference Post-Training Framework for Image Editing
Apr 21, 2026Fan Li, Chonghuinan Wang, Lina Lei +9Diffusion Model Alignment Image Editing Evaluation
Huawei Noah’s Ark Lab · Nankai University · Harbin Institute of Technology
UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
Apr 17, 2026Lifan Jiang, Tianrun Wu, Yuhang Pei +3Video Editing Benchmarks Image Editing Evaluation
Zhejiang University Hangzhou, China
Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
Apr 16, 2026Yixuan Ding, Wei Huang, Ruijie Quan +2Image Editing Evaluation Text-Guided Image Editing
Zhejiang University · The University of Hong Kong
GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing
Mar 12, 2026Mingxin Liu, Ziqian Fan, Zhaokai Wang +13Image Editing Evaluation Text-Guided Image Editing
Shanghai Jiao Tong University · South China University of Technology · Fudan University +2
VTEdit-Bench: A Comprehensive Benchmark for Multi-Reference Image Editing Models in Virtual Try-On
Mar 12, 2026Xiaoye Liang, Zhiyuan Qu, Mingye Zou +4Virtual Try-On Image Editing Evaluation
School of Electronic Information Engineering, Beihang University, Beijing, China · Zhongguancun Academy, Beijing, China · Faculty of Computing, Harbin Institute of Technology, Harbin, China +2

Oct 7, 2026, cs.GRJ/K move · Enter open · S save

ScribbleEdit: A Benchmark for Scribble-Only Image Editing

Jie Ren, Hao Kang, Kai Guo, Yiding Yang+8

MIT · ByteDance · Michigan State University

Image Editing Image Editing Evaluation VLM Evaluation

Open paper AskPDF arXiv

Scribble-based interaction provides a lightweight and intuitive way for users to specify image editing intents in interactive editing tools. However, current image editing models based on VLMs or LLMs struggle to understand and execute edits based solely on scribble inputs. To systematically study this problem, we construct a new benchmark, ScribbleEdit, that evaluates the ability of image editing models to perform image editing conditioned on scribbles. This task requires both a deep understanding of the intention of the scribble and an accurate interpretation of its spatial information. In ScribbleEdit, we design an automated data construction pipeline and introduce a dedicated evaluation protocol that explicitly measures intention alignment. Our analysis reveals that existing VLM/LLM-based editing models fail to accurately capture scribble intentions. To guide future progress on scribble-only image editing, we propose a simple yet effective soft-token baseline, which enhances the model's understanding of scribble semantics and outperforms standard image editing models on our benchmark. Our evaluation and baseline together provide a concrete foundation for assessing and improving the scribble-driven image editing.

Momentum

Related topics

Latest papers 49