Low-Rank Factorization

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

9 new papers

A weekly snapshot of new work published in Low-Rank Factorization.

Inside this field

Focused directions

253 papers

Latest in Low-Rank Factorization

Browse all topics →
CardsList

  1. Gap-Free Streaming PCA Beyond Rank-One Updates: Near-Optimal Rates and Applications to Differential Privacy

    Sep 22, 2026Anming Gu, Syamantak Kumar, Kevin Tian +1Principal Component AnalysisOptimal Sample Complexity

  2. Topological Signal Processing With Unoriented Operators

    Sep 21, 2026Andrea Cavallo, Varun Sarathchandran, Geert Leus +1Signal ProcessingGraph Laplacians

  3. Not All Task Vectors Need Equal Rank: Energy-Proportional Allocation for Model Merging

    Sep 21, 2026Hyunjoong Cho, Jinhyeok JangContinual Model MergingGradient-Free Rank Allocator

  4. Randomized SVD Approximations for Spectral Co-Clustering of Word-Document Matrices

    Sep 16, 2026Fateme Mazdarani, Carlos ToxtliSingular Value DecompositionImage Clustering

  5. Principled Koopman Representations with Kalman Inference for Efficient Time-Series Prediction

    Sep 15, 2026Ruiquan Li, Yuheng BuKoopman OperatorState Space Models

  6. A unified framework for global and local interpretability using adaptive derivative-ordered random explanation

    Sep 15, 2026Lemen Chao, Ming Lei, Anran FangModel InterpretabilityFeature Importance

  7. Causal Discovery via Transformed Low-Rank Quantile Surfaces

    Sep 15, 2026Ryo Kamimura, Thong PhamQuantile RegressionStructural Causal Model

  8. Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression

    Sep 14, 2026Huicheng Zhang, Xiyao Feng, Ze-Tong Li +6Large Language Model CompressionSingular Value Decomposition

  9. MoARa: Module-Aware Rank Allocation and Structure-Preserving Decomposition for Low-Rank LLM Pre-training

    Sep 14, 2026Keunyoung Kim, Nojun KwakGradient-Free Rank AllocatorLarge Language Model Pretraining

  10. Pre-Trained Low-Rank Tensor Decomposition for Multi-Dimensional Image Recovery

    Sep 14, 2026Bing-Zhang Fu, Zhi-Long Han, Ting-Zhu Huang +2Low-Rank FactorizationMultimodal Pretraining

  11. Rank-Efficient LoRA via Joint Tangent-Space Optimization under Isotropic Curvature

    Sep 14, 2026Zihan Zhu, Zhehang Du, Xuyang Chen +5Low-Rank AdaptationLow-Rank Factorization

  12. Information-Induced Training Geometry: Exact Reduction, Canonical Completion, and Structured Expressivity

    Sep 14, 2026Zavier LiAffineReference-Free Metric

  13. A Functional SVD Framework for Regularized Multivariate Functional PCA with Dual Penalization

    Sep 13, 2026Yue Zhao, Hossein Haghbin, Rebecca Sanders +1Principal Component AnalysisSingular Value Decomposition

  14. Semi-Tensor Product-Based Multi-Term Randomized T-SVD and Its Visual Applications

    Sep 11, 2026Xingchen Xiao (School of Mathematics and Statistics, Southwest University, Chongqing +13Singular Value DecompositionTensor

  15. A Quantum-Inspired Dequantization Method for Diagonally Weighted Matrix Functions: Application to Learning with Optimized Random Features

    Sep 9, 2026Natsuto Isogai, Mio Murao, Hayata YamasakiQuantum AdvantageSingular Value Decomposition

  16. Exact Degeneracy Under Balanced k-Shot Sampling:Consequences for Small-Sample Discriminant Analysis on LLM Embeddings

    Sep 9, 2026Lingxiao QuPrincipal Component AnalysisIndependent Component Analysis

  17. When Does Low-Bit Quantization Preserve the Decisions of Vector Search?

    Sep 9, 2026Wenxuan Xiao, Xu CaoCalibration-Free Low-Bit Vector QuantizationVector Database

  18. Interpretable Hyperspectral Unmixing Framework with Fixed Endmember Prior and Structured Residual Refinement

    Sep 8, 2026Ziyi Guan, Jianping Zhang, Qian LiuHyperspectral UnmixingDiffusion Refinement

  19. Rank Without an Oracle: Deviation-Aware Interaction-Rank Selection from Offline Multi-Agent Logs

    Sep 8, 2026Xiangwu Wang, Chengwei Cao, Hongyuan TangGradient-Free Rank AllocatorRanking

  20. Mind the Approximation: Fisher-Weighted SVD Compression for ViTs

    Sep 7, 2026Moritz Thoma, Maximilian Groezinger, Maximilian Forstenhäusler +7Vision TransformerLarge Language Model Compression

  21. Reducing Hallucinated Transcripts in Whisper via Hallucination Space Projection

    Sep 7, 2026Maryam Abbasihafshejani, Murtuza JadliwalaAutomatic Speech Recognition SystemsHallucination Mitigation

  22. Spectral Convergence of Random Feature Method in Multiple Dimensions

    Sep 3, 2026Pingbing Ming, Hao YuConvergence AnalysisSingular Value Decomposition

  23. The Gradient Does Not See Rank: Rank-Indifference in Matrix-CODI on ProsQA

    Sep 2, 2026Samuel LarsonLow-Rank FactorizationRanking

  24. Overfitting Mitigation via Singular Value Decomposition in Minimum Bayes Risk Decoding

    Sep 1, 2026Riza Setiawan Soetedjo, Yusuke Sakai, Hidetaka Kamigaito +2Singular Value DecompositionLow-Rank Factorization

  25. Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs

    Sep 1, 2026Jingshen Zhang, Shaoyang Xu, Wenxuan ZhangLarge Language Model AlignmentLarge Language Model Bias

  26. Normalized Low-Rank Adaptation

    Aug 31, 2026Jiale Kang, Ziyin Yue, Zheng Zhan +2Low-Rank AdaptationParameter-Efficient Adaptation

  27. RSLM: Training-Free Vector Quantization for Approximate Nearest Neighbor Search

    Aug 31, 2026Rastislav Lenhardt, Teodora Dobos, Thomas Vecchiato +2Calibration-Free Low-Bit Vector QuantizationApproximate Nearest-Neighbor Search

  28. Compact and Infinite-Order Error Analysis for Null-Space SVD Estimation

    Aug 31, 2026Xin Li, Jonathan Cohen, Rami PuzisSingular Value DecompositionSingularity

  29. Intrinsic Interaction Geometry Controls the Low-Rank Complexity of Softmax Attention

    Aug 28, 2026Yuhe Sui, Jianing Zhang, Yingzhi TangLow-Rank FactorizationGumbel-Softmax Relaxation

  30. Toward a First-Principles Update Geometry for the Language-Model Head

    Aug 23, 2026Aditya Somasundaram, Charles Guille-Escuret, Alexander Moreno +2Spectral NormMulti-Head Self-Attention

  31. LoRA-GA2^2: Low Rank Adaptation with Multi-step Gradient Adaptive Alignment

    Aug 20, 2026Haonan He, Xinyue FanLow-Rank AdaptationGradient-Free Rank Allocator

  32. Fast Length-Squared Sampling for Positive-Semidefinite Matrices

    Aug 12, 2026Rajarshi Bhattacharjee, Ethan N. Epperly, Cameron Musco +1Low-Rank FactorizationSemidefinite Programming

  33. Low-Interaction-Rank Learning: Unifying Multiplicative Dual-Encoder Heads

    Aug 12, 2026Zijian Zhao, Sen LiEncoder-Decoder ArchitecturesLow-Rank Factorization

  34. FiGuRO: Intrinsic Dimension Estimation for Multi-Modal Data

    Aug 11, 2026Viktoria Schuster, Sana Tonekaboni, Caroline UhlerIntrinsic DimensionalityMulti-Modal Representation Learning

  35. Why Post-Norm Transformers Collapse: Attention Amplification and Gradient Repair Failure

    Aug 10, 2026Xingjian Wang, Qingyu Han, Xiaodong Luo +1Batch NormalizationTransformer Encoder

  36. Exact Rank-Space KL Projection for Shared-Marginal Low-Rank Factors: Application to Doubly Stochastic Clustering

    Aug 9, 2026Enliang HuLow-Rank FactorizationProximal Gradient Descent

  37. Understanding Calibration and Truncation Error Propagation in Training-Free Low-Rank Compression for LLMs

    Aug 9, 2026Mohanad Odema, Gabrielle De Micheli, Dayin Gou +3Large Language Model CompressionLow-Rank Factorization

  38. Exact Rank and Convex Calibration Dimension Lower Bounds for the Multi-Label F1 Loss

    Aug 9, 2026Mingyuan ZhangMulti-Label ClassificationLow-Rank Factorization

  39. Shape Mutating Expert Compression:LorExperts and BTExperts

    Aug 7, 2026Inesh Chakrabarti, Sourjya Roy, Bowen Bao +3Mixture-Of-Expert Language ModelsExperts

  40. LoRSA: Toward Generalizable Parameter-Efficient Fine-Tuning for Biomedical Downstream Tasks

    Aug 7, 2026Saed Moradi, Benyamin Ghojogh, M. Hadi Sepanj +2Low-Rank AdaptationParameter-Efficient Fine-Tuning

  41. Finding Usable Weight Mechanisms with Tiled SVD

    Aug 7, 2026Ash Manvi, Samreena TajreenModel WeightsSingular Value Decomposition

  42. The Loss Does Not See the Basis, but Adam Does

    Aug 5, 2026Devender SinghLow-Rank FactorizationAdam

  43. SRAP: SVD-Refined Adversarial Perturbations for Imperceptible Face-Swap Defense

    Aug 4, 2026Sungwon Cho, Kwanghyun Ko, Myungjoo KangSingular Value DecompositionPerturbations

  44. Tight Worst-Case Bounds for the Smallest Eigenvalue of ReLU NTK Gram Matrices

    Aug 4, 2026Zhao SongLargest EigenvalueRectified Linear Unit

  45. Not the Dimension, the Norm: What Matters in Gradient-Free Weight Perturbation of Language Models

    Aug 3, 2026Taeyeong Kim, Ahhyun Kim, TaeHyeon Kim +1Model WeightsGradient-Based Optimization

  46. QR-Erase: Efficient Subspace-Based Machine Unlearning with Layer Localization

    Aug 2, 2026Tyler Lizzo, Larry HeckMachine UnlearningSingular Value Decomposition

  47. Riemannian Attention Mechanisms for Transformers: A Theoretical Framework and Architecture Design

    Aug 2, 2026Sen SongTransformer AttentionSoftmax Attention

  48. S4^4R: Selective Sampling, Subspaces, and Sparse Reconstruction for Compressed Long-Context KV Caching

    Aug 1, 2026Jialong Han, You Wu, Kewei TuKey-Value Cache CompressionKey-Value Cache

  49. Learning to Understand Body Language from Flight through Robust 3D Avatar Placing

    Jul 30, 2026Dragos Costea, Alina Marcu, Cristina Lazar +1Aerial RobotsHuman Motion

  50. Quasi-SVD: Learning a Lie-constrained matrix factorisation for real-time imaging

    Jul 28, 2026Christopher HahneSingular Value DecompositionMatrix Factorization

  51. Breaking the Periodicity Assumption: Robust Tensorial Multi-View Clustering via Graph-Spectral Low-Rank Learning

    Jul 28, 2026Jintian Ji, Xingsu Li, Songhe FengManifold Learning MethodMulti-View

  52. DynaCalKV: Key-Value Cache Compression via Head Grouping and Adaptive Rank Allocation

    Jul 27, 2026Tan T. Nguyen, Quan V. DangKey-Value Cache CompressionCache

  53. Structural Loss Metrics for Tensor Approximation via Matrix Low-Rank Approximation

    Jul 27, 2026Hiroki HasegawaLow-Rank FactorizationReconstruction Error

  54. Distributed Convolutional Rank Regression over Decentralized Networks

    Jul 26, 2026Chunjing Li, Tiange Zhao, Xiaohui YuanKernel Ridge RegressionLow-Rank Factorization

  55. Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

    Jul 25, 2026Dhruvil S, Fenil Sojitra, Ravirajsinh ChauhanMulti-Head Self-AttentionLatent Representation

  56. The Entropic Bound for Transformers: Why Static Rank Fails and Attention-Native Rank Recovers

    Jul 25, 2026Byeong Hoon YoonLow-Rank FactorizationTransformer Architectures

  57. Hybrid Semantic and Spectral Ensemble for Robust Synthetic Image Source Attribution

    Jul 24, 2026Md. Ajwad HossainSynthetic Image DetectionDeep Semantic Representations

  58. \k{appa}-LoRA: Condition Numbers Reveal Which LoRA Matrices Worth Updating

    Jul 24, 2026Jianghui Wang, Silong Yong, Francesco Orabona +3Low-Rank AdaptationLow-Rank Factorization

  59. Singular value soft-thresholding via the polar decomposition

    Jul 24, 2026Stephen BeckerSingular Value DecompositionMulti-Gpu Systems

  60. Variational Low-rank Tensor Decomposition for Multisubject Spatiotemporal Data Analysis

    Jul 24, 2026Laura M. Montaldo, Ricardo A. Borsoi, Sebastian Miron +1SpatiotemporalMatrix Factorization