Reparameterized Tensor Ring Functional Decomposition for Multi-Dimensional Data Recovery
Organizations: Key Laboratory of Computing and Stochastic Mathematics (Ministry of Education), School of Mathematics and Statistics, Hunan Normal University · Department of Statistics and Data Science, Southern University of Science and Technology
Abstract
Tensor Ring (TR) decomposition is a powerful tool for high-order data modeling, but is inherently restricted to discrete forms defined on fixed meshgrids. In this work, we propose a TR functional decomposition for both meshgrid and non-meshgrid data, where factors are parameterized by Implicit Neural Representations (INRs). However, optimizing this continuous framework to capture fine-scale details is intrinsically difficult. Through a frequency-domain analysis, we demonstrate that the spectral structure of TR factors determines the frequency composition of the reconstructed tensor and limits the high-frequency modeling capacity. To mitigate this, we propose a reparameterized TR functional decomposition, in which each TR factor is a structured combination of a learnable latent tensor and a fixed basis. This reparameterization is theoretically shown to improve the training dynamics of TR factor learning. We further derive a principled initialization scheme for the fixed basis and prove the Lipschitz continuity of our proposed model. Extensive experiments on image inpainting, denoising, super-resolution, and point cloud recovery demonstrate that our method achieves consistently superior performance over existing approaches. Code is available at https://github.com/YangyangXu2002/RepTRFD.
Figures & tables
| Data | Method | Time (s) | ||||||
| PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | |||
| Airplane House Pepper Sailboat | TRLRF | 17.52 | 0.326 | 21.57 | 0.546 | 24.85 | 0.698 | 5.12 |
| FCTN | 17.38 | 0.359 | 21.23 | 0.566 | 24.67 | 0.710 | 5.44 | |
| HLRTF | 20.89 | 0.544 | 25.27 | 0.754 | 28.02 | 0.841 | 3.43 | |
| LRTFR | 21.38 | 0.587 | 25.86 | 0.770 | 28.74 | 0.856 | 6.03 | |
| DRO-TFF | 23.22 | 0.734 | 27.52 | 0.848 | 30.04 | 0.899 | 13.25 | |
| Data | Method | Time (s) | ||||||
| PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | |||
| Toys Face | LRTDTV | 35.85 | 0.895 | 31.27 | 0.718 | 28.45 | 0.554 | 5.97 |
| DeepTensor | 36.23 | 0.914 | 32.48 | 0.833 | 30.25 | 0.702 | 47.93 | |
| HLRTF | 37.09 | 0.917 | 33.28 | 0.828 | 30.88 | 0.726 | 4.55 | |
| LRTFR | 37.55 | 0.935 | 33.75 | 0.864 | 31.80 | 0.819 | 5.86 | |
| DRO-TFF | 38.67 | 0.959 | 34.74 | 0.911 | 32.91 | 0.881 | 7.61 | |
| Method | Time (s) | ||||||
| PSNR | SSIM | PSNR | SSIM | PSNR | SSIM | ||
| PEMLP | 29.26 | 0.740 | 27.84 | 0.676 | 24.28 | 0.439 | 90.15 |
| SIREN | 31.69 | 0.866 | 29.48 | 0.779 | 27.16 | 0.634 | 125.38 |
| Gauss | 30.27 | 0.790 | 28.23 | 0.683 | 26.73 | 0.605 | 186.92 |
| WIRE | 32.43 | 0.869 | 30.21 | 0.788 | 27.88 | 0.683 | 423.27 |
| FINER | 32.09 | 0.858 | 29.84 | 0.778 | 27.61 | 0.666 | 165.08 |
| Method | Doll | Duck | Frog | Mario | PeterRabbit | Squirrel |
| PEMLP | 0.112 | 0.064 | 0.058 | 0.091 | 0.081 | 0.084 |
| SIREN | 0.111 | 0.062 | 0.057 | 0.089 | 0.074 | 0.085 |
| Gauss | 0.123 | 0.064 | 0.060 | 0.092 | 0.078 | 0.085 |
| WIRE | 0.106 | 0.060 | 0.053 | 0.086 | 0.068 | 0.083 |
| FINER | 0.110 | 0.059 | 0.054 | 0.088 | 0.073 | 0.083 |
| LRTFR | 0.114 | 0.061 | 0.061 | 0.095 | 0.082 | 0.094 |
| Metric | Airplane | Toy | Botswana | News | ||||
| w/o Rep. | w/ Rep. | w/o Rep. | w/ Rep. | w/o Rep. | w/ Rep. | w/o Rep. | w/ Rep. | |
| PSNR | 27.41 | 30.45 | 29.41 | 48.67 | 29.21 | 45.27 | 26.48 | 34.90 |
| Time (s) | 12.10 | 13.11 | 13.23 | 14.49 | 40.81 | 42.26 | 14.15 | 15.59 |
| Data | Initialization Scale | |||||
| 0.01 | 0.05 | 0.165 (ours) | 0.3 | 0.5 | 1 | |
| Botswana | 33.86 | 43.74 | 45.27 | 44.81 | 43.15 | 38.37 |
| Washington DC | 33.14 | 46.08 | 47.96 | 47.44 | 45.90 | 38.20 |
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
| Data | LRTFR (Baseline) | RepTRFD (w/o TV) | RepTRFD (w/ TV) |
| Airplane | 27.21 | 29.37 | 30.45 |
| Flowers | 44.27 | 48.53 | 50.13 |
| Botswana | 41.86 | 44.94 | 45.27 |
| Carphone | 30.18 | 31.86 | 32.58 |
| Data | LRTFR (Baseline) | RepTRFD (w/o TV) | RepTRFD (w/ TV) |
| Lion | 28.10 | 30.37 | 31.01 |
| Parrot | 27.81 | 29.79 | 30.39 |
| Scheme | Airplane | Toy | Botswana | News |
| Kaiming | 30.23 | 48.59 | 45.30 | 34.75 |
| Xavier | 30.45 | 48.67 | 45.27 | 34.90 |
| Data | Method | ||||||||||||||||||
| PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | ||
| Airplane | TRLRF | 15.08 | 0.172 | 0.218 | 17.98 | 0.347 | 0.156 | 19.90 | 0.444 | 0.125 | 21.50 | 0.529 | 0.104 | 23.35 | 0.623 | 0.084 | 25.58 | 0.712 | 0.065 |
| FCTN | 14.64 | 0.219 | 0.229 | 17.79 | 0.370 | 0.159 | 20.05 | 0.504 | 0.123 | 22.08 | 0.600 | 0.097 | 24.11 | 0.689 | 0.077 | 25.70 | 0.747 | 0.064 | |
| HLRTF | 18.46 | 0.396 | 0.148 | 21.89 | 0.598 | 0.099 | 24.82 | 0.746 | 0.071 | 26.77 | 0.811 | 0.057 | 27.61 | 0.795 | 0.051 | 29.40 | 0.852 | 0.042 | |
| LRTFR | 19.66 | 0.499 | 0.129 | 22.09 | 0.655 | 0.097 | 25.57 | 0.765 | 0.065 | 27.21 | 0.822 | 0.054 | 28.60 | 0.858 | 0.046 | 29.38 | 0.878 | 0.042 | |
| DRO-TFF | 21.08 | 0.741 | 0.109 | 22.71 | 0.763 | 0.090 | 26.28 | 0.843 | 0.060 | 27.64 | 0.853 | 0.051 | 29.17 | 0.888 | 0.043 | 30.37 | 0.906 | 0.037 | |
| Data | Method | |||||||||||||||
| PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | ||
| Toys | TRLRF | 25.13 | 0.625 | 0.189 | 29.32 | 0.791 | 0.117 | 33.67 | 0.901 | 0.071 | 36.56 | 0.943 | 0.051 | 38.67 | 0.964 | 0.040 |
| FCTN | 28.22 | 0.788 | 0.132 | 32.24 | 0.882 | 0.083 | 37.46 | 0.955 | 0.046 | 40.04 | 0.972 | 0.034 | 42.04 | 0.982 | 0.027 | |
| HLRTF | 30.73 | 0.880 | 0.099 | 33.85 | 0.929 | 0.069 | 40.15 | 0.982 | 0.033 | 42.64 | 0.988 | 0.025 | 45.56 | 0.993 | 0.018 | |
| LRTFR | 32.95 | 0.924 | 0.077 | 34.92 | 0.948 | 0.061 | 39.95 | 0.982 | 0.034 | 41.87 | 0.987 | 0.027 | 43.64 | 0.988 | 0.022 | |
| DRO-TFF | 33.88 | 0.966 | 0.069 | 37.19 | 0.982 | 0.047 | 40.62 | 0.992 | 0.032 | 43.73 | 0.994 | 0.022 | 45.75 | 0.995 | 0.017 | |
| Data | Method | |||||||||||||||
| PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | PSNR | SSIM | NRMSE | ||
| Toys | LRTDTV | 34.85 | 0.906 | 0.062 | 32.17 | 0.824 | 0.084 | 30.29 | 0.734 | 0.104 | 28.79 | 0.653 | 0.124 | 27.65 | 0.581 | 0.141 |
| DeepTensor | 35.11 | 0.902 | 0.060 | 32.50 | 0.875 | 0.081 | 30.91 | 0.807 | 0.097 | 29.50 | 0.760 | 0.114 | 28.62 | 0.672 | 0.126 | |
| HLRTF | 35.70 | 0.912 | 0.056 | 33.30 | 0.883 | 0.074 | 31.89 | 0.821 | 0.087 | 30.78 | 0.768 | 0.098 | 29.46 | 0.698 | 0.115 | |
| LRTFR | 36.01 | 0.936 | 0.054 | 34.01 | 0.918 | 0.068 | 32.36 | 0.870 | 0.082 | 31.36 | 0.869 | 0.092 | 30.60 | 0.829 | 0.101 | |
| DRO-TFF | 37.34 | 0.954 | 0.046 | 35.07 | 0.933 | 0.060 | 33.11 | 0.902 | 0.075 | 32.24 | 0.887 | 0.083 | 31.10 | 0.875 | 0.095 | |
Tensor Decomposition
Tensor decomposition represents multidimensional data with compact factors, supporting efficient analysis, recovery, and compression.
See all 70 papers