cs.MMAug 23, 2026

ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generation

Authors: Qianqian Tang, Jiayi Gao, Ting Lei, Yang Liu

Organizations: Wangxuan Institute of Computer Technology, Peking University Beijing, China · School of Computer Science, Wuhan University Wuhan, China

Abstract

Emotion-aware artistic image generation requires a model to satisfy semantic content, artistic style, and target emotion simultaneously. The key challenge is that artistic captions conflate these axes into underspecified free-form text, making fine-grained visual attributes such as brushwork, composition, and tonal atmosphere difficult to ground concretely. We present ReART, a reference-guided retrieval and refinement framework. Our method decomposes test captions and each image annotation in the EmoArt database into structured visual fields, and performs field-wise retrieval over subject, layout, brush-line, and tone-mood dimensions to retrieve role-specific visual references that supply the perceptual detail text alone cannot convey; these references are used alongside a structured prompt for initial synthesis. For samples where any Attribute Alignment Score (AAS) axis falls below threshold, an AAS-driven refinement loop diagnoses failures, constructs constrained repair plans specifying elements to keep, errors to fix, and operations to avoid, routes references by correction purpose, and performs controlled editing under structural preservation constraints. Our system ranks 2nd in Track 1 of the AffectiveArt 2026 Grand Challenge, achieving a perfect AAS of 1.00 and an overall score of 0.78. Code is available at https://github.com/oceanflowlab/ReART.git.

Figures & tables

Explore similar work

CardsList
  1. EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generation

    Jul 11, 2026Dexiang Hong, Yijie Guo, Weidong Chen +4Conditional Image GenerationT2I Generation

  2. Beyond Emotion Prompts: Fine-Grained Text-to-Image Generation Driven by Valence-Arousal-Dominance

    Sep 21, 2026Minglang Li, Yueyue Fang, Xieping GaoConditional Image GenerationControllable Image Generation