Overview

Tensor decomposition studies how to represent multidimensional data using simpler factors, making patterns easier to analyze and large data or models cheaper to store and process. Common approaches include CP and Tucker factorization, tensor trains and matrix product states, and t-SVD, used for tasks such as missing-data recovery, anomaly detection, scientific modeling, and neural-network compression. Current work combines these methods with Bayesian rank selection, adaptive optimization, pretrained or neural priors, and theoretical analyses of recovery and identifiability. A central tension is choosing a factorization and rank that capture useful structure without imposing unrealistic shared-subspace or ordering assumptions, while balancing accuracy, robustness, and computational cost.

Latest papers

CardsList

70 papers10 papers in the last four weeks, up 11% on the four weeks before. 0.1% of all new papers.

  1. A JoLT for the KV cache: Near-Lossless KV Cache Compression via Joint Rank-bit Allocation

    Jul 14, 2026Rahul Krishnan, Volker SchulzTucker DecompositionKV Caching

  2. Online TT-ALS for Streaming Tensor Decomposition with Incremental Orthogonalization

    Jun 30, 2026Hiroki Takeda, Yuto Miyatake, Daisuke FurihataTensor DecompositionTT Decomposition

  3. Low-Cost High-Order Singular Value Decomposition for Tensor-Based Reconstruction from Sparse Sensor Measurements: Urban Flow and Air-Quality Applications

    Jun 23, 2026Arindam Sengupta, Paul Jeanney, Ricardo Vinuesa +2Sparse RecoveryTensor Decomposition

  4. Privacy-preserving federated tensor decomposition of single-cell immune data: recovering multicellular programs across institutions

    Jun 22, 2026Axel Faes, Stephanie M. van den Berg, Maryam Amir HaeriFederated Learning AggregationPrivacy-Preserving Federated Learning

  5. Dual-Attention Convolution Experts for Sparse Tensor Completion

    Jun 19, 2026Yanlei Liu, Zhenyu LiaoTensor CompletionTensor Decomposition

  6. Robust Neural Tucker Factorization with Bias Correction and Adaptive Initialization

    Jun 15, 2026Yuchao Su, Yixin RanTensor CompletionNeural Network Initialization

  7. Rethinking the Role of Tensor Decompositions in Post-Training LLM Compression

    Jun 2, 2026Artur Zagitov, Alexander Miasnikov, Maxim Krutikov +5LLM CompressionTensor Decomposition

  8. Bayesian Tensor Decomposition with Diffusion Model Prior

    Jun 2, 2026Zerui Tao, Qibin ZhaoBayesian Inverse ProblemsTensor Decomposition

  9. Spectra-Guided Neural Tucker Factorization

    May 30, 2026Fusheng Wang, Yikai HouTensor CompletionTensor Decomposition

  10. Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters

    May 29, 2026Xinjue Wang, Xiuheng Wang, Yejun Zhang +3Tensor DecompositionAdapter Tuning

  11. Transfer learning RGB models to hyperspectral images with trainable tensor decompositions

    May 27, 2026Mariette Schönfeld, Laurens Devos, Wannes Meert +1Tensor DecompositionHyperspectral Imaging

  12. Exact Symmetry as Algebra: Group-Structured Tensors that Enforce Physical Selection Rules

    May 19, 2026Paulina Hoyos, Shashanka Ubaru, Dongsung Huh +5Scientific DiscoverySymmetry Discovery

  13. Fast Tensorization of Neural Networks via Slice-wise Feature Distillation

    May 19, 2026Safa Hamreras, Sukhbinder Singh, Román OrúsTensor NetworksTensor Decomposition

  14. Dual-Channel Tensor Neural Networks: Finite-Sample Theory and Conformal Structure Selection

    May 18, 2026Elynn Chen, Jiayu Li, Zheshi Zheng +1Tensor NetworksUncertainty Quantification

  15. Robust Basis Spline Decoupling for the Compression of Transformer Models

    May 11, 2026Joppe De Jonghe, Van Tien Pham, Mariya IshtevaModel CompressionTensor Decomposition

  16. DiffATS: Diffusion in Aligned Tensor Space

    May 10, 2026Jinhua Lyu, Tianmin Yu, Brian Kim +3Orthogonal Procrustes AlignmentTensor Decomposition

  17. A Biased Nonnegative Block Term Tensor Decomposition Model for Dynamic QoS Prediction

    May 6, 2026Wenjing Liu, Yujia Lei, Qu WangTensor Decomposition

  18. Quaternion Nonlinear Transform-Induced Nuclear Norm for Low-Rank Tensor Completion

    May 2, 2026Biswarup Karmakar, Ratikanta BeheraTensor CompletionTensor Decomposition

  19. Inductive Convolution Nuclear Norm Minimization for Tensor Completion with Arbitrary Sampling

    Apr 18, 2026Wei Li, Yuyang Li, Kaile Du +2Tensor CompletionTensor Decomposition

  20. Structured 3D-SVD: A Practical Framework for the Compression and Reconstruction of Biological Volumetric Images

    Apr 18, 2026Mario Aragonés Lozano, Oscar Romero, Antonio LeónImage ReconstructionTensor Decomposition

  21. Unsupervised feature selection using Bayesian Tucker decomposition

    Apr 16, 2026Y-h. Taguchi, Yoh-ichi MototakeTensor DecompositionFeature Selection

  22. Mild Over-Parameterization Benefits Asymmetric Tensor PCA

    Apr 11, 2026Shihong Ding, Weicheng Lin, Cong FangOverparameterizationTensor Decomposition

  23. A Muon-Accelerated Algorithm for Low Separation Rank Tensor Generalized Linear Models

    Apr 6, 2026Xiao Liang, Shuang LiGeneralized Linear ModelsTensor Decomposition

  24. Tucker Attention: A generalization of approximate attention mechanisms

    Mar 31, 2026Timon Klein, Jonas Kusch, Sebastian Sager +2Tucker DecompositionAttention Mechanisms

  25. Compressing Transformer Language Models via Matrix Product Operator Decomposition: A Case Study on PicoGPT

    Mar 30, 2026Younes Javanmard, Tanmoy Pandit, Masoud MardaniModel CompressionTensor Decomposition

  26. Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression

    Mar 27, 2026Haoming Shi, Eric C. Chi, Hengrui LuoModel SelectionTensor Decomposition

  27. Efficient Generative Modeling with Unitary Matrix Product States Using Riemannian Optimization

    Mar 12, 2026Haotong Duan, Zhongming Chen, Ngai WongTensor NetworksRiemannian Optimization

  28. A New Tensor Network: Tubal Tensor Train and Its Applications

    Mar 11, 2026Salman Ahmadi-Asl, Valentin Leplat, Anh-Huy Phan +1Tensor DecompositionTT Decomposition