To accelerate single image super-resolution (SISR) networks on large images (2K-8K), many recent approaches decompose an image into small patches and dynamically determine an execution path according to its difficulty (referred to as a dynamic network). To quantify the hardness of a patch, they mainly rely on a handcrafted assessment score, e.g., edge, which weakly associates a patch's texture with the computational complexity of a SISR model. To address the problem, we introduce ENAF - a dynamic network for SISR with an adaptive patch fusion. Built on top of a backbone, ENAF incorporates multiple early exits (EEs) to tackle the over-parameterized SISR model. More importantly, ENAF plugs a tiny network that estimates PSNR to associate data texture with a computation cost at an EE. Based on the scores, ENAF effectively assigns image patches to an exit, enhancing the quality-complexity trade-off. Extensive experiments on common datasets with popular SISR backbones demonstrate the effectiveness of ENAF in various settings. The source code is provided in https://github.com/nmduonggg/ENAF
Figures & tables
Figure 1: A visual comparison in patch assignment by ARM [ 2 ] and our ENAF. Both reduce the computation cost by approximately 46%. The portions of ”Easy”, ”Medium”, and ”Hard” by ARM are 45%, 3%, and 52%, respectively, and that of our ENAF are 38%, 25%, and 37%. With a hand-crafted PSNR-edge-score matching, ARM may fail to classify two patches with little details, i.e., patches 1 and 2. It also inflexibly assigns a patch, i.e., patch 3 to a complex network, thus influencing the performance.
Figure 2: The Proposed ENAF Architecture.
Figure 3: A visual example in which the Bicubic operation performs better than all exits of the SR backbone.
Figure 4: Quantitative comparison of main backbones of ENAF and SOTA patch-based dynamic SISR approaches [ 10 , 2 ] in ×4 super-resolution settings. These two examples are image ”1228” (above) from Test2K and image ”1321” (below) from Test4K, respectively. ENAF’s main backbone produces an equivalent or higher PSNR compared to original and SOTA methods.
Model
F2K
FLOPs
Test2K
FLOPs
Test4K
FLOPs
Test8K
FLOPs
FSRCNN
27.91 (+0.00)
468M (100%)
25.61 (+0.00)
468M (100%)
26.90 (+0.00)
468M (100%)
32.66 (+0.00)
468M (100%)
ClassSR
27.93 (+0.02)
297M (63%)
25.61 (+0.00)
311M (66%)
26.91 (+0.01)
286M (61%)
32.73 (+0.07)
238M (51%)
ARM-L
27.98 (+0.07)
380M (82%)
25.64 (+0.03)
366M (78%)
26.93 (+0.03)
341M (73%)
32.75 (+0.09)
290M (62%)
ARM-M
27.91 (+0.00)
276M (59%)
25.61 (+0.00)
289M (62%)
26.90 (+0.00)
282M (64%)
32.73 (+0.07)
249M (53%)
ARM-S
27.65 (-0.26)
184M (39%)
25.59 (-0.02
245M (52%)
26.87 (-0.03)
230M (50%)
32.66 (+0.00)
187M (40%)
ENAF-L
27.98 (+0.07)
362M (77%)
25.64 (+0.03)
316M (68%)
26.93 (+0.03)
301M (64%)
32.75 (+0.09)
207M (44%)
Table 1: The comparison of various methods and our ENAF on different datasets F2K, Test2K, Test4K and Test8K
Model
F2K
FLOPs
Test2K
FLOPs
Test4K
FLOPs
ENAF-L-NB
27.98 (+0.07)
379M (81%)
25.64 (+0.03)
368M (79%)
26.93 (+0.03)
375M (80%)
ENAF-M-NB
27.91 (+0.00)
262M (56%)
25.61 (+0.00)
271M (58%)
26.90 (+0.00)
284M (61%)
ENAF-S-NB
27.65 (-0.26)
105M (23%)
25.59 (-0.02)
247M (53%)
26.87 (-0.03)
256M (54%)
ENAF-L
27.98 (+0.07)
362M (77%)
25.64 (+0.03)
316M (68%)
26.93 (+0.03)
301M (64%)
ENAF-M
27.91 (+0.00)
231M (49%)
25.61 (+0.00)
229M (49%)
26.90 (+0.00)
222M (47%)
ENAF-S
27.65 (-0.26)
112M (24%)
25.59 (-0.02)
201M (43%)
26.87 (-0.03)
201M (43%)
Table 2: Ablation study on effect of blank vector generator
Figure 5: ENAF networks offer less computational requirement than the backbones and ARM to achieve comparable performance, thus better FLOPS-PSNR tradeoffs.
Method
Level 0
Level 1
Level 2
Level 3
ARM LUT
2.50
3.41
3.47
3,48
ENAF Estimator
2.93
2.90
2.94
2.93
Table 3: MAE between the predicted and actual PSNR values at different execution depth levels.
Figure 6: Relation of η and FLOPS of three different backbones. Conducted on Test8K dataset
This paper introduces a lightweight image super-resolution (SR) network, termed the Multi-scale Spatial Adaptive Attention Network (MSAAN), to address the common dilemma between high reconstruction fidelity and low model complexity in existing SR methods. The core of our approach is a novel Multi-scale Spatial Adaptive Attention Module (MSAA), designed to jointly model fine-grained local details and long-range contextual dependencies. The MSAA comprises two synergistic components: a Global Feature Modulation Module (GFM) that learns coherent texture structures through differential feature extraction, and a Multi-scale Feature Aggregation Module (MFA) that adaptively fuses features from local to global scales using pyramidal processing. To further enhance the network's capability, we propose a Local Enhancement Block (LEB) to strengthen local geometric perception and a Feature Interactive Gated Feed-Forward Module (FIGFF) to improve nonlinear representation while reducing channel redundancy. Extensive experiments on standard benchmarks (Set5, Set14, B100, Urban100, Manga109) across ×2, ×3, and ×4 scaling factors demonstrate that both our lightweight (MSAAN-light) and standard (MSAAN) versions achieve superior or competitive performance in terms of PSNR and SSIM, while maintaining significantly lower parameters and computational costs than state-of-the-art methods. Ablation studies validate the contribution of each component, and visual results show that MSAAN reconstructs sharper edges and more realistic textures.
Single image super-resolution aims to reconstruct high-resolution images from low-resolution inputs. This paper proposes FreeTransformSR, a novel lightweight super-resolution network based on a channel-wise free low-rank learnable transform. The transform learns task-adaptive basis functions in a data-driven manner, enabling adaptive feature modulation with minimal parameter overhead. To further enhance high-frequency detail recovery, we introduce a local feature modulation branch that complements transform-domain processing with depthwise convolution. In addition, a soft complexity adaptive module dynamically fuses the outputs of local convolution and window self-attention branches through a lightweight gating network, adaptively adjusting the fusion ratio based on regional texture characteristics. An adaptive intensity modulation strategy is also incorporated to adjust transform-domain response strength at the sample level, enabling the network to dynamically adjust processing intensity according to input features. Extensive experiments on five benchmark datasets demonstrate that FreeTransformSR achieves competitive PSNR/SSIM performance with significantly fewer parameters and FLOPs. Specifically, FreeTransformSR achieves 32.41 dB on BSD100 x2 and 27.00 dB on Urban100 x4 with only 595K parameters, while delivering faster inference speed than competing methods, making it well-suited for deployment in resource-constrained scenarios. Source code is available at: https://github.com/HJiLi/FreeTransformSR.
Hongji Li, Yunhui Li
Chinese Academy of Sciences Changchun Institute of Optics Fine Mechanics and Physics, Changchun, Jilin 130033, China · University of the Chinese Academy of Sciences, Beijing 100049, China
Single-image super-resolution has progressed from deep convolutional baselines to stronger Transformer and state-space architectures, yet the corresponding performance gains typically come with higher training cost, longer engineering iteration, and heavier deployment burden. In many practical settings, multiple pretrained models with partially complementary behaviors are already available, and the binding constraint is no longer architectural capacity but how effectively their outputs can be combined without additional training. Rather than pursuing further architectural redesign, this paper proposes a training-free output-level ensemble framework. A dual-branch pipeline is constructed in which a Hybrid attention network with TLC inference provides stable main reconstruction, while a MambaIRv2 branch with geometric self-ensemble supplies strong compensation for high-frequency detail recovery. The two branches process the same low-resolution input independently and are fused in the image space via a lightweight weighted combination, without updating any model parameters or introducing an additional trainable module. As our solution to the NTIRE 2026 Image Super-Resolution (×4) Challenge, the proposed design consistently improves over the base branch and slightly exceeds the pure strong branch in PSNR at the best operating point under a unified DIV2K bicubic ×4 evaluation protocol. Ablation studies confirm that output-level compensation provides a low-overhead and practically accessible upgrade path for existing super-resolution systems.
Gengjia Chang, Xining Ge, Weijun Yuan +4
Hefei University of Technology · Hangzhou Dianzi University · Jinan University +2