Singular Value Decomposition

Ask about this topic

Momentum

14 papers in the last four weeks, up 367% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 94

All topics
CardsList

  1. Hybrid Methods for Robust Tabular Data Imputation

    Sep 30, 2026Jinwei Li, Michelle Bruch, Daniel TenbrinckImputationRandom Forest

    Department of Data Science Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen, Germany

  2. Retrieve, Reproduce, Reveal: Dissecting Retrieval-Augmented Software Vulnerability Detection

    Sep 29, 2026Sabrina Kaniewski, Tim Krämer, Julius Bächle +3Model VulnerabilitiesSoftware

    Institute for Secure Networked Systems, Esslingen University, Germany · Esslingen University, Germany · Institute for Intelligent Systems, Esslingen University, Germany +1

  3. Rethinking Contextualization by Reinterpreting Attention Head Channels

    Sep 27, 2026Hakaze Cho, Haolin Yang, Zhun Sun +3Efficient Long-Context InferenceChannel

    RIKEN · Tohoku University · New York University +2

  4. JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization

    Sep 27, 2026Kaicheng Yang, Kaisen Yang, Chunyu Liu +8Quantization-Aware TrainingInference Cost

    Shanghai Jiao Tong University · Tsinghua University · The Hong Kong Polytechnic University

  5. Randomized SVD Approximations for Spectral Co-Clustering of Word-Document Matrices

    Sep 16, 2026Fateme Mazdarani, Carlos ToxtliSingular Value DecompositionClustering

    School of Computing Clemson University Clemson, SC, USA

  6. Principled Koopman Representations with Kalman Inference for Efficient Time-Series Prediction

    Sep 15, 2026Ruiquan Li, Yuheng BuKoopman OperatorState Space Models

    Department of Computer Science, UC Santa Barbara

  7. A unified framework for global and local interpretability using adaptive derivative-ordered random explanation

    Sep 15, 2026Lemen Chao, Ming Lei, Anran FangInterpretabilityFeature Importance

    School of Information Resource Management, Renmin University of China, Beijing, 100872, People’s Republic of China. · Key Laboratory of Data Engineering and Knowledge Engineering, Beijing, 100872, People’s Republic of China.

  8. Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression

    Sep 14, 2026Huicheng Zhang, Xiyao Feng, Ze-Tong Li +6Large Language Model CompressionSingular Value Decomposition

    Hong Kong University of Science and Technology (Guangzhou), Guangdong 511453, China · QudeLeap Research, Shanghai 200030, China

  9. A Functional SVD Framework for Regularized Multivariate Functional PCA with Dual Penalization

    Sep 13, 2026Yue Zhao, Hossein Haghbin, Rebecca Sanders +1Principal Component AnalysisSingular Value Decomposition

    Division of Biostatistics and Health Data Science, University of Minnesota, USA · Faculty of Intelligent Systems Engineering and Data Science, Persian Gulf University, Iran · Department of Mathematical and Statistical Sciences, Marquette University, USA

  10. Semi-Tensor Product-Based Multi-Term Randomized T-SVD and Its Visual Applications

    Sep 11, 2026Xingchen Xiao (School of Mathematics and Statistics, Southwest University, Chongqing +13Tensor DecompositionSingular Value Decomposition

    School of Mathematics and Statistics, Southwest University, Chongqing, 400715, China

  11. A Quantum-Inspired Dequantization Method for Diagonally Weighted Matrix Functions: Application to Learning with Optimized Random Features

    Sep 9, 2026Natsuto Isogai, Mio Murao, Hayata YamasakiQuantum Computational AdvantageAtom-Averaged Features

    Department of Physics, Graduate School of Science, The University of Tokyo, Tokyo, Japan · Department of Computer Science, Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan

  12. CAST: Canonical Approximate Schur Tree for Approximate Cholesky on Graphs

    Sep 8, 2026Meher Chaitanya, Cameron Musco, Aristides GionisSpectral PreconditioningSingular Value Decomposition

    KTH Royal Institute of Technology Stockholm, Sweden · University of Massachusetts Amherst Amherst, Massachusetts, USA

  13. Interpretable Hyperspectral Unmixing Framework with Fixed Endmember Prior and Structured Residual Refinement

    Sep 8, 2026Ziyi Guan, Jianping Zhang, Qian LiuHyperspectral ImageTwo-Level Spatial-Frequency Fusion Strategy

    School of Mathematics and Computational Science, Xiangtan University, Xiangtan 411105, China

  14. Mind the Approximation: Fisher-Weighted SVD Compression for ViTs

    Sep 7, 2026Moritz Thoma, Maximilian Groezinger, Maximilian Forstenhäusler +7Vision TransformerSingular Value Decomposition

    Technical University of Munich, DE · BMW Group, DE · University of Glasgow, GB +1

  15. Spectral Convergence of Random Feature Method in Multiple Dimensions

    Sep 3, 2026Pingbing Ming, Hao YuAtom-Averaged FeaturesSpectral Representation Method

  16. Overfitting Mitigation via Singular Value Decomposition in Minimum Bayes Risk Decoding

    Sep 1, 2026Riza Setiawan Soetedjo, Yusuke Sakai, Hidetaka Kamigaito +2Singular Value DecompositionLow-Rank Structure

    Nara Institute of Science and Technology (NAIST) · The University of Tokyo

  17. Compact and Infinite-Order Error Analysis for Null-Space SVD Estimation

    Aug 31, 2026Xin Li, Jonathan Cohen, Rami PuzisSingular Value DecompositionSubspace

  18. Finding Usable Weight Mechanisms with Tiled SVD

    Aug 7, 2026Ash Manvi, Samreena TajreenSingular Value DecompositionMechanistic Interpretability

    Aquin Labs

  19. SRAP: SVD-Refined Adversarial Perturbations for Imperceptible Face-Swap Defense

    Aug 4, 2026Sungwon Cho, Kwanghyun Ko, Myungjoo KangSingular Value DecompositionLLM Defense Mechanisms

    Interdisciplinary Program in Artificial Intelligence Seoul National University · Interdisciplinary Program in Computational Science and Technology Seoul National University · Department of Mathematical Sciences Seoul National University

  20. Not the Dimension, the Norm: What Matters in Gradient-Free Weight Perturbation of Language Models

    Aug 3, 2026Taeyeong Kim, Ahhyun Kim, TaeHyeon Kim +1Model WeightsNorm

    Chosun University · Korea University Sejong Campus

  21. QR-Erase: Efficient Subspace-Based Machine Unlearning with Layer Localization

    Aug 2, 2026Tyler Lizzo, Larry HeckMachine UnlearningSubspace

    Georgia Institute of Technology

  22. Learning to Understand Body Language from Flight through Robust 3D Avatar Placing

    Jul 30, 2026Dragos Costea, Alina Marcu, Cristina Lazar +1Human MotionAerial Robots

    National University of Science and Technology “Politehnica” Bucharest, Romania · “Simion Stoilow” Institute of Mathematics of the Romanian Academy · NORCE Norwegian Research Centre AS

  23. Quasi-SVD: Learning a Lie-constrained matrix factorisation for real-time imaging

    Jul 28, 2026Christopher HahneSingular Value DecompositionRestricted Bernoulli Matrix Factorization

    University of Bern 3008 Bern, Switzerland

  24. Hybrid Semantic and Spectral Ensemble for Robust Synthetic Image Source Attribution

    Jul 24, 2026Md. Ajwad HossainSynthetic Image DetectionDeep Semantic Representations

    Chittagong University of Engineering and Technology Chittagong, Bangladesh

  25. Singular value soft-thresholding via the polar decomposition

    Jul 24, 2026Stephen BeckerSingular Value DecompositionSign

    University of Colorado Boulder, USA

  26. Deep Convolutional Large-Margin ℓp\ell_p-SVDD for Visual Anomaly Detection

    Jul 24, 2026Alireza Dastmalchi Saei, Shervin Rahimzadeh ArashlooUnsupervised DetectionSingular Value Decomposition

    Department of Computer Engineering, Bilkent University, 06800 Ankara, Türkiye

  27. A JoLT for the KV cache: Near-Lossless KV Cache Compression via Joint Rank-bit Allocation

    Jul 14, 2026Rahul Krishnan, Volker SchulzKey-Value Cache CompressionKey-Value Cache

    Universität Trier · Fachbereich IV, Mathematik, Universität Trier

  28. Spectral Stability of Pseudoinverse-Based Extreme Learning Machine

    Jul 9, 2026Bich Van Nguyen, Ngoc Anh KhongLeast SquaresSingular Value Decomposition

    Institute for Artificial Intelligence, VNU University of Engineering and Technology, Vietnam

  29. Statistically Meaningful Geometry and Gauge Symmetry Breaking: A Geometric Foundation for Scientific Discovery and Intelligence Emergence

    Jul 3, 2026Bing Cheng, Yi-Shuai Niu, Howell Tong +1EmergenceScientific Discovery

    Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China · Beijing Institute of Mathematical Sciences and Applications (BIMSA), Beijing, China · Department of Statistics, London School of Economics and Political Science, London WC2A 2AE, UK +3

  30. LACE-SVD: Loss-Aware SVD with Cumulative Error Correction for LLM Compression

    Jul 3, 2026Zhuowen Liu, Longkun Hao, Shiyu Feng +3Large Language Model CompressionSingular Value Decomposition

    Zhuowen Liu1 · Longkun Hao2 · Shiyu Feng3 +3

  31. In-context learning from self-generated trajectories for adaptive model reduction

    Jul 3, 2026Amirpasha Hedayat, Laura Balzano, Karthik DuraisamyReduced-Order ModelsNonlinear Dynamics

    Department of Aerospace Engineering · Michigan Institute for Computational Discovery and Engineering, University of Michigan, Ann Arbor, MI, USA · Department of Electrical Engineering and Computer Science

  32. SE-UNet: Singular Equivariant Imaging for Real-World Constrained Generation

    Jul 2, 2026Kanishk AwadhiyaBayesian Inverse ProblemsU-Net

    Independent Researcher

  33. CORA: Per-Slice Coherent Orthogonal Rotation for SVD-based Low-Rank Adaptation

    Jun 30, 2026Pengcheng Wang, Ziran Liu, Wei Wang +1Singular Value DecompositionModel Fine-Tuning

    Purdue University · Shanghai Institute for Mathematics and Interdisciplinary Sciences / Fudan University · Futurewei Technologies, Inc.

  34. Shift Variant Image Degradation and Restoration Using Singular Value Decomposition

    Jun 24, 2026Arun D. KulkarniVisual DegradationRestoration

    Computer Science Department at University of Texas at Tyler, Tyker, TX 75799 USA

  35. A Framework for Directed Hypergraph Signal Processing via tensor t-SVD

    Jun 23, 2026Carlos Mundo-Levano, Nicolás Bello, Daniel L. Lau +1HypergraphsGraph Edge Sparsification

    Department of Electrical and Computer Engineering, University of Delaware, Newark, DE 19716, USA · Institute for Financial Services Analytics, University of Delaware, Newark, DE 19716, USA · Department of Electrical and Computer Engineering, University of Kentucky, Lexington, KY 40506, USA

  36. Low-Cost High-Order Singular Value Decomposition for Tensor-Based Reconstruction from Sparse Sensor Measurements: Urban Flow and Air-Quality Applications

    Jun 23, 2026Arindam Sengupta, Paul Jeanney, Ricardo Vinuesa +2Tensor DecompositionSingular Value Decomposition

    ETSI Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Plaza Cardenal Cisneros, 3, Madrid, 28040, Spain · Ove Arup, C. de Alfonso XI, 12, Retiro, Madrid, 28014, Spain · Department of Aerospace Engineering, University of Michigan, Ann Arbor, MI 48109, United States

  37. Uniform Sampling from High-dimensional Spectral Norm Balls

    Jun 23, 2026Michael R. MetelSpectral NormSingular Value Decomposition

  38. Exact Schur-Sylvester Dimensionality Reductions for Non-Smooth Stochastic Complexity and Manifold Sampling

    Jun 22, 2026Trenton Lau, Gary P. T. ChoiMaximum LikelihoodOptimal Sample Complexity

    Department of Mathematics, The Chinese University of Hong Kong

  39. SVD-Surgeon: Optimal Singular-Value Surgery for Large Language Model Compression

    Jun 22, 2026Mahmoud Safari, Frank HutterLarge Language Model CompressionSingular Value Decomposition

    University of Freiburg · Prior Labs · ELLIS Institute Tübingen

  40. Differential Spectral Damping Gap Adaptive Regularization for Ill-Conditioned Kernel Methods

    Jun 22, 2026Praveg VashishthaKernel MethodSingular Value Decomposition

    Department of Computer Science and Engineering, Indian Institute of Technology Patna, India · Sopra Banking Software India

  41. Dead-Direction Signatures: A Cheap Spectral Reading of Singular Complexity

    Jun 19, 2026Tejas Pradeep Shirodkar, P. J. NarayananDistributional SignaturesSingular Value Decomposition

    IIIT, Hyderabad

  42. Algebraic Dead Directions in LayerNorm Transformers: A Forward-Pass-Only Diagnostic at LLM Scale

    Jun 17, 2026Tejas Pradeep Shirodkar, P. J. NarayananBatch NormalizationTransformer Architectures

    IIIT, Hyderabad

  43. The Algebra of Units: From Buckingham's Pi-grec Theorem to Latent-Variable Learning

    Jun 15, 2026Mauro ValoraniSingular Value DecompositionExponents

    Department of Mechanical and Aerospace Engineering Sapienza University of Rome

  44. SPRI: SVD-Partitioned Residual Initialization for Data-Constrained MoE Upcycling

    Jun 15, 2026Weiqiao Shan, Ruixiang Mao, Yuang Li +10Mixture-Of-Experts ArchitecturesMixture-Of-Experts

    Northeastern University, China · Huawei TSC, China · CUHK-Shenzhen, China +4

  45. CLARITree: Cholesky and Lookahead Accelerations for Regression with Interpretable Piecewise Linear Trees

    Jun 11, 2026Yixiao Wang, Hayden McTavish, Varun Babbar +2Decision TreesKernel Ridge Regression

    Department of Computer Science, Duke University, Durham, USA · Department of Computer Science, University of British Columbia, Vancouver, Canada

  46. Accurate and Resource-Efficient Federated Continual Learning

    Jun 9, 2026Jebacyril Arockiaraj, Dhruv Parikh, Jayashree Adivarahan +2Federated LearningReplay-Based Continual Learning

    University of Southern California · Los Angeles, USA · DEVCOM Army Research Office +1

  47. Physically Consistent Null Space Alignment for Detection of Low-Magnitude False Data Injection Attacks

    Jun 7, 2026Xin Li, Chenhan Xiao, Jonathan Cohen +3Intrusion DetectionState Estimation

    Faculty of Computer and Information Science, Ben-Gurion-University, Be’er Sheva, Israel · School of Electrical, Computer and Energy Engineering, Arizona State University, AZ, USA · Department of Computer Science, Shamoon College of Engineering, Be’er Sheva, Israel

  48. TailLoR: Protecting Principal Components in Parameter-Efficient Continual Learning

    Jun 4, 2026Marius Dragoi, Ioana Pintilie, Alexandra Dragomir +2Replay-Based Continual LearningContinual Learning

    Bitdefender, Romania

  49. Sparse Functional Singular Value Decomposition for Biclustering and Triclustering Longitudinal Data

    Jun 3, 2026Yue Zhao, Thierry Chekouo, Sandra SafoSingular Value DecompositionLongitudinal Data

    Division of Biostatistics and Health Data Science University of Minnesota 2221 University Avenue SE2026 Minneapolis, MN 55414, United States

  50. LASER: Loss-Aware Singular-value Decomposition and Rank Allocation for Efficient Low-Precision Vision-Language Models

    May 30, 2026Haiyu Wang, Yutong Wang, Leshu Li +2Large Language Model CompressionLow-Rank Structure

    Tandon School of Engineering, New York University · Courant Institute of Mathematical Sciences, New York University · Brookhaven National Laboratory

  51. Stochastic Rounding Increases Small Singular Values

    May 29, 2026Linkai Ma, Tingzhou Yu, Petros DrineasSingular Value DecompositionFull-Precision Performance

    Department of Mathematics University of Alberta

  52. Cross-Layer Subspace Coupling for LLM Compression: A Unifying Framework and Its Empirical Limits

    May 29, 2026Snigdha Chandan KhilarLarge Language Model CompressionCross-Layer Interactions

    Independent Researcher

  53. Manifold-based Algorithms for the Hadamard Decomposition

    May 27, 2026Nicolas Gillis, Subhayan Saha, Stefano Sicilia +1Randomized Hadamard TransformsSingular Value Decomposition

    Department of Mathematics and Operational Research, University of Mons, Mons, Belgium. · SS is a member of the Gruppo Nazionale Calcolo Scientifico-Istituto Nazionale di Alta Matematica (GNCS-INdAM).

  54. History-aware adaptive reduced-order models via incremental singular value decomposition

    May 27, 2026Amirpasha Hedayat, Ali Mohaghegh, Laura Balzano +2Reduced-Order ModelsSingular Value Decomposition

    Department of Aerospace Engineering, University of Michigan, Ann Arbor, MI, USA · Department of Aerospace Engineering, University of Kansas, Lawrence, KS, USA · Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA

  55. Efficient Pre-Training of LLMs through Truncated SVD Representations

    May 27, 2026Kaivan Kamali, Kajetan Schweighofer, Hormoz Shahrzad +3Singular Value DecompositionLarge Language Model Pretraining

    Cognizant AI Lab

  56. Timestep-Aware SVDQuant-GPTQ for W4A4 Quantization of Wan2.2-I2V

    May 26, 2026Junhao Wu, Dezhong Yao, Hai JinVideo Diffusion ModelsSingular Value Decomposition

    School of Computer Science and Technology, Huazhong University of Science and Technology Wuhan, Hubei, China 430074

  57. The Stability of Singular Distribution: A Spectral Perspective on the Two-Phase Dynamics of Language Model Pre-training

    May 26, 2026Hongtao Zhang, Wenjie Zhou, Chenxi Jia +2Large Language Model PretrainingPretraining

    State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China +1

  58. Spectral Asymptotics of Neural Network Loss Landscapes: An Exact Decomposition of the Curvature Exponent

    May 22, 2026Anherutowa CalvoHessianLocal Curvature

    19D Labs

  59. Check Your LLM's Secret Dictionary! Five Lines of Code Reveal What Your LLM Learned (Including What It Shouldn't Have)

    May 21, 2026Hisashi MiyashitaSingular Value DecompositionSubspace

    Mgnite Inc.

  60. FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning

    May 19, 2026Yequan Zhao, Ruijie Zhang, Liyan Tan +3Parameter-Efficient Fine-Tuning MethodsModel Fine-Tuning

    University of California at Santa Barbara · Amazon Lab126