Overview

Low-rank approximation studies how to represent data or computations using a small number of latent components, making tasks such as compression, matrix completion, recommendation, and scientific modeling more efficient. Common approaches include truncated or randomized singular value decomposition, tensor factorization, nuclear-norm regularization, and adaptive rank selection. In neural networks and language models, researchers use activation- or loss-aware decompositions to compress weights and attention caches, and low-rank parameterizations to reduce training costs. A central tension is that reconstruction error may not reflect downstream task quality: choosing ranks that preserve useful behavior while reducing memory and computation remains difficult, especially when structure varies across layers, inputs, or training steps.

Latest papers

CardsList

102 papers6 papers in the last four weeks, down 25% on the four weeks before. 0.0% of all new papers.

  1. Variance Restoration over Covariance Rank: Memory-Budgeted Analytic Continual Learning

    Nov 17, 2026Elena Voss, Pixel Nomand, Marcus Hale +1Continual LearningClass-Incremental Learning

  2. SinkState: On-the-Fly SVD of Recurrent States for Efficient Hybrid LLM Serving

    Nov 10, 2026Haolin Jiang, Weihang Li, Zhongzhu Zhou +3LLM Inference AccelerationMemory-Efficient Inference

  3. Low-rank Low Precision Training of Gaussian Processes

    Nov 9, 2026Moritz Poguntke, Eda Oktay, Yuanzhe Xi +2Gaussian ProcessesGaussian Process Regression

  4. Blind Noise Equalization for Large Data Matrices under General Variance Profiles

    Nov 5, 2026Boris Landa, Francesco Strino, Fabio Parisi +2Spectral MethodsLow-Rank Approximation

  5. Unbiased Low-Rank Approximation for Repeated Matrix-Vector Multiplication: Stability and Optimal Sampling

    Oct 31, 2026Kang LiuLow-Rank Approximation

  6. Learnable Low-Rank Polynomial Sketch for Effective Linear Attention

    Oct 9, 2026Zongyue Qin, Haoran Deng, Jason Cong +1Transformer AttentionLinear Attention

  7. Low-rank tensor structure of precipitation and its application to satellite-reference merging

    Oct 7, 2026Ryan Solgi, Rohan Shankar, Hugo A. LoaicigaLow-Rank ApproximationRemote Sensing

  8. D-SLR: The Disjoint Row-Sparse plus Low-Rank Decomposition

    Oct 7, 2026Vincent SzolnokyLow-Rank Matrix DecompositionLow-Rank Compression

  9. Information Limits of Low-Rank Approximation Certification

    Oct 2, 2026Kang Liu, Bohao QuLow-Rank ApproximationInformation-Theoretic Lower Bounds

  10. DyRA: Dynamic Residual Approximation for Efficient Matrix Multiplication in DNNs

    Oct 2, 2026Daewon Chae, Hyunwon Chung, Changwoo Lee +1Efficient Neural Network InferenceLow-Rank Approximation

  11. Learning Conditional Expectation Operators via Functional Newton Updates

    Sep 28, 2026Thiago Ramos, Alek Fröhlich, Daniel Perazzo +1Density Ratio EstimationLow-Rank Approximation

  12. Stabilizing the Dynamic Low-Rank Training

    Sep 26, 2026Zhonghan Xu, Ling Wang, Junhao Chen +2Low-Rank ApproximationNeural Network Training Dynamics

  13. Dynamical low-rank equilibrium computation for stochastic games between advanced persistent threats and moving target defense

    Sep 20, 2026Tian Zijian, Zhang He, Chen Xinjie +2Nash Equilibrium ComputationZero-Sum Games

  14. On the Regularization Landscape for the Linear Recommendation Models

    Sep 10, 2026Dong Li, Zhenming Liu, Ruoming Jin +4Nuclear Norm MinimizationLow-Rank Approximation

  15. Semi-Tensor Product-Based Multi-Term Randomized T-SVD and Its Visual Applications

    Sep 10, 2026Xingchen Xiao, Feng Zhang, Wenjin Qin +1Tensor CompletionTensor Decomposition

  16. A Block Tensor Train Burer-Monteiro Framework for Low-Rank Quantum State Tomography

    Sep 8, 2026Shakir Showkat Sofi, Charlotte Vermeylen, Fatemeh Mohammadi +1Quantum State TomographyTT Decomposition

  17. Two-Scale Localized PCA-Net: Coarse-Global and Local-Residual Representations for Artifact-Reduced PDE Operator Learning

    Sep 7, 2026Mrigank Dhingra, Jordan Stout, Omer SanPrincipal Component AnalysisReduced-Order Modeling

  18. Intrinsic Interaction Geometry Controls the Low-Rank Complexity of Softmax Attention

    Aug 28, 2026Yuhe Sui, Jianing Zhang, Yingzhi TangSoftmax AttentionLow-Rank Attention

  19. Group-Shared Low-Rank Approximation for Mobile-Efficient Pointwise Convolutions in Large-Kernel CNNs

    Aug 26, 2026Hao Luo, Yiting Yang, Wenyi Zhao +10Convolutional Neural NetworksNeural Network Compression

  20. MaLViL: Multi-axis Low-rank Vision-LSTM for Medical Image Segmentation

    Aug 18, 2026Afshin Bozorgpour, Sina Ghorbani Kolahi, Moein Heidari +2Medical Image SegmentationUltrasound Image Segmentation

  21. DynaCalKV: Key-Value Cache Compression via Head Grouping and Adaptive Rank Allocation

    Jul 27, 2026Tan T. Nguyen, Quan V. DangKV CachingLow-Rank Approximation

  22. Leakage and Multiway Interaction Loss: What Matricization and Single-Mode Truncation Discard from Multiway Signals

    Jul 27, 2026Hiroki HasegawaTensor DecompositionLow-Rank Approximation