cs.CVApr 12, 2026

AIM-Bench: Benchmarking and Improving Affective Image Manipulation via Fine-Grained Hierarchical Control

Authors: Shi Chen, Xuecheng Wu, Heli Sun, Yunyun Shi, Xinyi Yin, Fengjian Xue, Jinheng Xie, Dingkang Yang, +3 more

Organizations: Xi’an Jiaotong University · Zhengzhou University · National University of Singapore · Fudan University · Zhejiang Lab

Abstract

Affective Image Manipulation (AIM) aims to evoke specific emotions through targeted editing. Current image editing benchmarks primarily focus on object-level modifications in general scenarios, lacking the fine-grained granularity to capture affective dimensions. To bridge this gap, we introduce the first benchmark designed for AIM termed AIM-Bench. This benchmark is built upon a dual-path affective modeling scheme that integrates the Mikels emotion taxonomy with the Valence-Arousal-Dominance framework, enabling high-level semantic and fine-grained continuous manipulation. Through a hierarchical human-in-the-loop workflow, we finally curate 800 high-quality samples covering 8 emotional categories and 5 editing types. To effectively assess performance, we also design a composite evaluation suite combining rule-based and model-based metrics to holistically assess instruction consistency, aesthetics, and emotional expressiveness. Extensive evaluations reveal that current editing models face significant challenges, most notably a prevalent positivity bias, which stemming from inherent imbalances in training data distribution. To tackle this, we propose a scalable data engine utilizing an inverse repainting strategy to construct AIM-40k, a balanced instruction-tuning dataset comprising 40k samples. Concretely, we enhance raw affective images via generative redrawing to establish high-fidelity ground truths, and synthesize input images with divergent emotions and paired precise instructions. Fine-tuning a baseline model on AIM-40k yields a 9.15% relative improvement in overall performance, demonstrating the effectiveness of our AIM-40k. Our data and related code will be made open soon.

Figures & tables

Explore similar work

CardsList
  1. MooD: Perception-Enhanced Efficient Affective Image Editing via Continuous Valence-Arousal Modeling

    May 4, 2026Xinyi Yin, Yiduo Wang, Tingqi Hu +6Valence-Arousal ModelingImage Editing

  2. What Can I Edit? Open-Ended Strategy Discovery and the Emotion Editability Landscape

    Jul 27, 2026Qing Li, Zeyu Dong, Yin Cui +2Text-Guided Image EditingVisual Reasoning

  3. AICA-Bench: Holistically Examining the Capabilities of VLMs in Affective Image Content Analysis

    Apr 7, 2026Dong She, Xianrong Yao, Liqun Chen +3VLM EvaluationVLM Calibration