Directional Total Variation-Regularized Implicit Neural Representations (DTV-INR) for Continuous Super-Resolution in Degraded Imaging Domains
Organizations: Department of Mathematics, Institute of Biosocial and Quantum Science and Technologies, Rasht Branch, Islamic Azad University, Rasht, Iran
Abstract
In this paper, we introduce the Directional Total Variation-Regularized Implicit Neural Representation (DTV-INR), an advanced variational paradigm that synergistically integrates coordinate-driven implicit neural networks with an anisotropic, structure-tensor-informed total variation regularizer tailored for resolution-agnostic image super-resolution. Casting the continuous-to-discrete acquisition process into an ill-posed inverse problem framework, our formulation equips a SIREN-architected coordinate network with a dynamic Riemannian metric tensor field D(x). By leveraging its spectral decomposition, the proposed regularizer preferentially directs diffusion parallel to dominant structural contours while penalizing cross-edge dissipation, successfully circumventing the classical staircasing artifacts inherent to scalar total variation schemes. We rigorously prove the well-posedness of this formulation in H^1(Omega) by establishing the existence, uniqueness, and metric stability of the variational minimizer, and realize this via an alternating projected optimization algorithm that decouples network parameter tuning from adaptive tensor field updates. Comprehensive experiments conducted on clinical brain magnetic resonance imaging (MRI) and biomedical transmission electron microscopy confirm substantial quantitative and qualitative improvements, yielding PSNR enhancements reaching +5.05 dB over baseline unregularized INRs and +1.71-2.85 dB over isotropic TV-INR across continuous (non-integer) upsampling factors, alongside remarkable noise robustness up to sigma_eta = 0.10 and monotonic preconditioned convergence behavior.
Figures & tables
| Method | Type | |||||
|---|---|---|---|---|---|---|
| Bicubic Interpolation | Continuous | 31.84 / 0.884 | 28.52 / 0.812 | 26.21 / 0.745 | 23.12 / 0.638 | 21.20 / 0.542 |
| Discrete TV (CP) | Discrete | 33.40 / 0.902 | 29.80 / 0.835 | 27.42 / 0.778 | 24.15 / 0.672 | 22.08 / 0.579 |
| EDSR | Discrete | 35.42 / 0.931 | 31.80 / 0.875 | 29.20 / 0.821 | 25.24 / 0.710 † | 22.80 / 0.612 † |
| LIIF (Continuous SR) | Implicit | 36.21 / 0.942 | 32.74 / 0.891 | 30.52 / 0.852 | 27.40 / 0.781 | 25.12 / 0.715 |
| Vanilla SIREN INR | Implicit | 33.95 / 0.910 | 30.12 / 0.846 | 27.65 / 0.784 | 24.38 / 0.680 | 22.25 / 0.584 |
| Isotropic TV-INR | Implicit | 35.80 / 0.935 | 32.15 / 0.880 | 30.70 / 0.856 | 26.85 / 0.765 | 24.45 / 0.692 |
| Method | |||||
|---|---|---|---|---|---|
| Bicubic | 27.40/0.781/0.384 | 24.80/0.695/0.452 | 22.10/0.584/0.540 | 20.20/0.490/0.621 | 17.80/0.385/0.710 |
| LIIF | 31.85/0.882/0.220 | 28.60/0.804/0.295 | 25.40/0.712/0.385 | 22.90/0.605/0.480 | 19.80/0.485/0.602 |
| Vanilla SIREN | 30.50/0.865/0.252 | 27.00/0.762/0.334 | 23.40/0.640/0.442 | 20.90/0.528/0.560 | 18.20/0.412/0.685 |
| Isotropic TV-INR | 32.20/0.895/0.205 | 29.30/0.825/0.278 | 26.50/0.742/0.360 | 24.10/0.650/0.445 | 21.50/0.535/0.565 |
| Proposed DTV-INR | 34.60 / 0.938 / 0.142 | 32.10 / 0.886 / 0.198 | 29.40 / 0.820 / 0.270 | 27.20 / 0.755 / 0.345 | 24.80 / 0.670 / 0.440 |
| Configuration | SIREN | Tikhonov | Isotropic | Anisotropic | Dynamic | PSNR [dB] |
|---|---|---|---|---|---|---|
| Backbone | ( ) | TV | Tensor | / SSIM | ||
| (1) Vanilla INR | ✓ | – | – | – | – | 27.00 / 0.762 |
| (2) Tikhonov Only | ✓ | ✓ | – | – | – | 28.15 / 0.795 |
| (3) Isotropic TV | ✓ | ✓ | ✓ | – | – | 29.30 / 0.825 |
| (4) Static Anisotropic | ✓ | ✓ | – | ✓ | – | 31.42 / 0.856 |
| (5) Complete DTV-INR | ✓ | ✓ | – | ✓ | ✓ | 32.10 / 0.886 |
Image Super-Resolution
Image super-resolution reconstructs high-resolution images from lower-resolution observations, balancing detail, fidelity, and computational cost.
See all 248 papers