Dual-Path Learning based on Frequency Structural Decoupling and Regional-Aware Fusion for Low-Light Image Super-Resolution
Organizations: Hefei University of Technology, Hefei, China · University of Science and Technology of China, Hefei, China · Zhejiang University, Hangzhou, China · The University of Electro-Communications, Tokyo, Japan
Abstract
Low-light image super-resolution (LLISR) is essential for restoring fine visual details and perceptual quality under insufficient illumination conditions with ubiquitous low-resolution devices. Although pioneer methods achieve high performance on single tasks, they solve both tasks in a serial manner, which inevitably leads to artifact amplification, texture suppression, and structural degradation. To address this, we propose Decoupling then Perceive (DTP), a novel frequency-aware framework that explicitly separates luminance and texture into semantically independent components, enabling specialized modeling and coherent reconstruction. Specifically, to adaptively separate the input into low-frequency luminance and high-frequency texture subspaces, we propose a Frequency-aware Structural Decoupling (FSD) mechanism, which lays a solid foundation for targeted representation learning and reconstruction. Based on the decoupled representation, a Semantics-specific Dual-path Representation (SDR) learning strategy that performs targeted enhancement and reconstruction for each frequency component is further designed, facilitating robust luminance adjustment and fine-grained texture recovery. To promote structural consistency and perceptual alignment in the reconstructed output, building upon this dual-path modeling, we further introduce a Cross-frequency Semantic Recomposition (CSR) module that selectively integrates the decoupled representations. Extensive experiments on the most widely used LLISR benchmarks demonstrate the superiority of our DTP framework, improving 1.6% PSNR, 9.6% SSIM, and 48% LPIPS compared to the most state-of-the-art (SOTA) algorithm. Codes are released at https://github.com/JXVision/DTP.
Figures & tables
| Method | Years | RELLISUR 2 | RELLISUR 4 | ||||
|---|---|---|---|---|---|---|---|
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | ||
| SwinIR [ 10 ] | ICCV’21 | 18.38 ↑4.77 | 0.640 ↑0.176 | 0.577 ↓0.453 | 17.53 ↑4.33 | 0.663 ↑0.151 | 0.688 ↓0.435 |
| Restormer [ 15 ] | CVPR’22 | 21.21 ↑1.94 | 0.727 ↑0.089 | 0.385 ↓0.261 | 20.29 ↑1.57 | 0.720 ↑0.094 | 0.492 ↓0.239 |
| OmniSR [ 12 ] | CVPR’23 | 20.87 ↑2.28 | 0.740 ↑0.076 | 0.470 ↓0.346 | 19.89 ↑1.97 | 0.723 ↑0.091 | 0.461 ↓0.208 |
| HAT [ 2 ] | CVPR’23 | 20.21 ↑2.94 | 0.719 ↑0.097 | 0.454 ↓0.330 | 19.75 ↑2.11 | 0.715 ↑0.099 | 0.561 ↓0.308 |
| PDHAT+ [ 9 ] | T-MM’24 | - | - | - | 21.00 ↑0.86 | 0.753 ↑0.061 | 0.452 ↓0.159 |
| Scale | Modules | Metric | ||||
| FSD | SDR | CSR | PSNR | SSIM | LPIPS | |
| 18.51 | 0.765 | 0.387 | ||||
| ✓ | 22.36 ↑3.85 | 0.803 ↑0.038 | 0.291 ↓0.096 | |||
| ✓ | 20.27 ↑1.76 | 0.782 ↑0.017 | 0.362 ↓0.025 | |||
| ✓ | 21.79 ↑3.28 | 0.791 ↑0.026 | 0.313 ↓0.074 | |||
| ✓ | ✓ | 22.75 ↑4.24 | 0.811 ↑0.046 | 0.203 ↓0.184 | ||