cs.CVNov 19, 2026

RegionAgent: Two-Stage Preference Optimization for Regional Image Restoration

Authors: Weiyu Zhou, Jiacong Tang, Tao Hu, Axi Niu, Jinqiu Sun, Peng Wu, Wei Dong, Qingsen Yan

Organizations: Northwestern Polytechnical University · Xi’an University of Architecture and Technology

Abstract

Images under non-uniform coupled degradations require diverse restoration capabilities for different degraded regions. Existing methods employ globally uniform operations, potentially overlooking regional differences and causing incomplete restoration or even damage to image content. Moreover, a degraded region may require successive restoration actions, and earlier actions may alter residual degradation characteristics or introduce artifacts, potentially hindering subsequent restoration. To address these challenges, we propose RegionAgent, an adaptive restoration framework that trains a Vision-Language Model (VLM) through two-stage preference learning to generate a region-specific restoration action at each iteration. Specifically, we first train the VLM to select an action suited to the current region through step-level Direct Preference Optimization (DPO), using preferences derived from immediate restoration feedback to supervise only the differing component in each action pair. To account for the effects of current actions on subsequent restoration, we then apply trajectory-level DPO, using preferences derived from complete trajectory scores to supervise the sole differing action in each trajectory pair. Furthermore, as conventional image-pair datasets do not directly provide preferences over regional restoration decisions, we construct a regional restoration preference dataset comprising 10K action pairs and 20K trajectory pairs for two-stage VLM training. Experiments across multiple datasets demonstrate strong restoration performance under both mixed and single degradations. Ablation studies further validate the effectiveness of two-stage preference learning in improving restoration quality.

Figures & tables

Explore similar work

CardsList
  1. OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimization

    May 21, 2026Feng Zhu, Shuyang Xie, Yihan Zeng +2Agent-Based Image RestorationImage Restoration

  2. TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration

    Mar 29, 2026Guoli Jia, Yisheng Zhang, Haote Hu +11Tool-Using Vision-Language AgentsImage Restoration

  3. TaskIR: Task-Driven Image Restoration via Degradation Adaptation and Task Feedback

    Sep 25, 2026Yanjie Tu, Qingsen Yan, Axi Niu +4All-in-One Image RestorationImage Restoration