eess.IVFeb 13, 2026

FUTON: Fourier Tensor Networks for Implicit Neural Representations

Authors: Pooya Ashtari, Pourya Behmandpoor, Nikos Deligiannis, Aleksandra Pizurica

Organizations: Ghent University · Vrije Universiteit Brussel (VUB)

Abstract

Implicit neural representations (INRs) have emerged as powerful tools for encoding signals, yet dominant MLP-based designs often suffer from slow convergence, and how their accuracy depends on their size is known only empirically. We introduce FUTON (Fourier Tensor Network), which models signals as generalized Fourier series whose coefficients are parameterized by a low-rank tensor decomposition, read out by a linear or MLP head. FUTON combines complementary inductive biases: Fourier bases capture smoothness and periodicity, while the low-rank parameterization enforces low-dimensional spectral structure. Beyond universal approximation, we show that with a linear head, the best FUTON's error splits exactly into the truncation of the signal's series and the best low-rank error of its coefficients, which we bracket from the samples before training, with a FUTON that attains the upper bound. On image fitting, occupancy volumes, and novel view synthesis, against twelve INRs of matched size, FUTON achieves the best average quality, reaches the final quality of each task's strongest baseline 4-34x sooner than that baseline, infers fastest, and trains in the least memory.

Figures & tables

Appendix figures & tables19 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Surprising Effectiveness of Noise Pretraining for Implicit Neural Representations

    Mar 30, 2026Kushal Vyas, Alper Kayabasi, Daniel Kim +3Implicit Neural RepresentationsNeural Network Initialization

  2. FiRe: Frequency Reparameterization as a Preconditioner for Periodic Implicit Neural Representations

    Jun 28, 2026Harinandan Shukla, Rajarshi Verma, Jitin SinglaImplicit Neural RepresentationsNeural Network Optimization