Organizations: Northwestern Polytechnical University · Shenzhen Research Institute of Northwestern Polytechnical University · Xi’an University of Architecture and Technology
Task-driven image restoration aims to improve both image quality and downstream task performance. However, existing methods predominantly focus on single degradation type and struggle to handle the diverse degradations encountered in real-world scenarios. Different degradations impose distinct restoration demands, and insufficient restoration may leave residual degradations and artifacts that impair object boundaries and semantic cues, thereby compromising downstream task performance. To address these challenges, we propose TaskIR, a two-stage task-driven unified image restoration framework that integrates degradation-adaptive restoration with task feedback refinement. In Stage I, a Degradation Representation Module (DRM) extracts degradation representations, enabling a Degradation-Guided Transformer Block (DGTB) to dynamically modulate feature transformations for adaptive restoration. In Stage II, a Task-to-Restoration Feedback Generation module (TRFG) transforms heterogeneous task features into restoration feedback by modeling task-representation discrepancies associated with the current restoration. Subsequently, a Selective Task Feedback Refinement module (STFR) assesses feedback relevance and selectively refines intermediate restoration features to mitigate interference with well-restored content. Extensive experiments demonstrate that TaskIR achieves competitive restoration quality and downstream task performance across diverse degradations and tasks.
Figures & tables
Figure 1: Overview of the proposed TaskIR framework and its key components: (a) Overall architecture of TaskIR; (b) Task-to-restoration feedback generation (TRFG); (c) Degradation-guided transformer block (DGTB); (d) Degradation representation module (DRM); and (e) Degradation-conditioned parameter generator (DPG).
Table 1: Overall restoration performance across eight degradation types. The best and second-best results are shown in bold and underlined, respectively.
Methods
Venue
ImageNet-1K
Cityscapes
VOC2012
Top-1 ↑
Top-5 ↑
mIoU ↑
Dice ↑
mAP 50 ↑
mAP 50:95 ↑
AirNet ( Li et al., 2022 )
CVPR’22
68.31
87.30
70.95
82.08
76.90
58.35
PromptIR ( Potlapalli et al., 2023 )
NeurIPS’23
72.26
89.78
74.12
84.36
81.92
63.32
NDR-Restore ( Yao et al., 2024 )
TIP’24
72.15
90.06
74.08
84.33
81.65
63.13
AdaIR ( Cui et al., 2025 )
ICLR’25
72.10
90.36
74.12
84.35
82.05
63.44
DFPIR ( Tian et al., 2025 )
CVPR’25
72.13
90.41
74.05
84.30
82.44
63.14
Table 2: Overall downstream task performance (%). The best and second-best results are shown in bold and underlined, respectively.
Figure 3: Qualitative comparison of image restoration results under diverse degradations on ImageNet-1K ( Deng et al., 2009 ) , Cityscapes ( Cordts et al., 2016 ) , and PASCAL VOC2012 ( Everingham et al., 2010 ) . Zoom in for a better view.
Figure 4: Qualitative comparison of downstream task results under diverse degradations, including classification (Cls.), segmentation (Seg.), and detection (Det.). Zoom in for a better view.
TRFG
STFR
ImageNet-1K
Cityscapes
VOC2012
TRF
CRR
Restoration
Classification
Restoration
Segmentation
Restoration
Detection
✓
✗
✗
28.29/0.8489
72.95/90.59
35.28/0.9479
74.52/84.64
28.26/0.8481
82.24/63.83
✓
✓
✗
28.28/0.8489
72.98/90.58
35.28/0.9480
74.65/84.74
28.25/0.8482
82.29/63.87
✓
✗
✓
28.30/0.8487
72.98/90.64
35.30/0.9480
74.67/84.75
28.27/0.8484
82.37/63.92
✗
✓
✓
28.31/0.8490
72.99/90.62
35.29/0.9481
74.64/84.73
28.28/0.8483
82.44/63.91
✓
✓
✓
28.31 / 0.8491
73.00 / 90.65
35.31 / 0.9481
74.69 / 84.77
28.28 / 0.8484
82.46 / 63.98
Table 3: Ablation study on the feedback modules. We report both restoration quality and downstream task performance across three datasets.
Figure 5: Ablation study on the two-stage design. Qualitative segmentation results on Cityscapes are shown for further comparison.
Hong Kong JC Lab of Smart City and the Department of Computer Science, City University of Hong Kong · School of Computing and Information Systems, Singapore Management University · Computer Science and Information Engineering, National Taiwan University