Low-Rank Factorization

Ask about this topic

Recent momentum

-50%

10 papers in the last 28 days · 0.3% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Low-Rank Factorization

Neighbouring directions

Singular Value DecompositionGradient-Free Rank Allocator

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Low-Rank Factorization.

Period ending 2026-09-07

5 new papers

A weekly snapshot of new work published in Low-Rank Factorization.

166 papers

Latest in Low-Rank Factorization

Open your feed →
CardsList

  1. Causal Discovery via Transformed Low-Rank Quantile Surfaces

    Sep 15, 2026Ryo Kamimura, Thong PhamQuantile RegressionStructural Causal Model

  2. Pre-Trained Low-Rank Tensor Decomposition for Multi-Dimensional Image Recovery

    Sep 14, 2026Bing-Zhang Fu, Zhi-Long Han, Ting-Zhu Huang +2Low-Rank FactorizationMultimodal Pretraining

  3. Information-Induced Training Geometry: Exact Reduction, Canonical Completion, and Structured Expressivity

    Sep 14, 2026Zavier LiAffineReference-Free Metric

  4. Rank-Efficient LoRA via Joint Tangent-Space Optimization under Isotropic Curvature

    Sep 14, 2026Zihan Zhu, Zhehang Du, Xuyang Chen +5Low-Rank AdaptationLow-Rank Factorization

  5. Exact Degeneracy Under Balanced k-Shot Sampling:Consequences for Small-Sample Discriminant Analysis on LLM Embeddings

    Sep 9, 2026Lingxiao QuPrincipal Component AnalysisIndependent Component Analysis

  6. When Does Low-Bit Quantization Preserve the Decisions of Vector Search?

    Sep 9, 2026Wenxuan Xiao, Xu CaoCalibration-Free Low-Bit Vector QuantizationVector Database

  7. Mind the Approximation: Fisher-Weighted SVD Compression for ViTs

    Sep 7, 2026Moritz Thoma, Maximilian Groezinger, Maximilian Forstenhäusler +7Vision TransformerLarge Language Model Compression

  8. Reducing Hallucinated Transcripts in Whisper via Hallucination Space Projection

    Sep 7, 2026Maryam Abbasihafshejani, Murtuza JadliwalaAutomatic Speech Recognition SystemsHallucination Mitigation

  9. The Gradient Does Not See Rank: Rank-Indifference in Matrix-CODI on ProsQA

    Sep 2, 2026Samuel LarsonLow-Rank FactorizationRanking

  10. Overfitting Mitigation via Singular Value Decomposition in Minimum Bayes Risk Decoding

    Sep 1, 2026Riza Setiawan Soetedjo, Yusuke Sakai, Hidetaka Kamigaito +2Singular Value DecompositionLow-Rank Factorization

  11. Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs

    Sep 1, 2026Jingshen Zhang, Shaoyang Xu, Wenxuan ZhangLarge Language Model AlignmentLarge Language Model Bias

  12. Normalized Low-Rank Adaptation

    Aug 31, 2026Jiale Kang, Ziyin Yue, Zheng Zhan +2Low-Rank AdaptationParameter-Efficient Adaptation

  13. RSLM: Training-Free Vector Quantization for Approximate Nearest Neighbor Search

    Aug 31, 2026Rastislav Lenhardt, Teodora Dobos, Thomas Vecchiato +2Calibration-Free Low-Bit Vector QuantizationApproximate Nearest-Neighbor Search

  14. Toward a First-Principles Update Geometry for the Language-Model Head

    Aug 23, 2026Aditya Somasundaram, Charles Guille-Escuret, Alexander Moreno +2Spectral NormMulti-Head Self-Attention

  15. Fast Length-Squared Sampling for Positive-Semidefinite Matrices

    Aug 12, 2026Rajarshi Bhattacharjee, Ethan N. Epperly, Cameron Musco +1Low-Rank FactorizationSemidefinite Programming

  16. Low-Interaction-Rank Learning: Unifying Multiplicative Dual-Encoder Heads

    Aug 12, 2026Zijian Zhao, Sen LiEncoder-Decoder ArchitecturesLow-Rank Factorization

  17. FiGuRO: Intrinsic Dimension Estimation for Multi-Modal Data

    Aug 11, 2026Viktoria Schuster, Sana Tonekaboni, Caroline UhlerIntrinsic DimensionalityMulti-Modal Representation Learning

  18. Why Post-Norm Transformers Collapse: Attention Amplification and Gradient Repair Failure

    Aug 10, 2026Xingjian Wang, Qingyu Han, Xiaodong Luo +1Batch NormalizationTransformer Encoder

  19. Exact Rank-Space KL Projection for Shared-Marginal Low-Rank Factors: Application to Doubly Stochastic Clustering

    Aug 9, 2026Enliang HuLow-Rank FactorizationProximal Gradient Descent

  20. Understanding Calibration and Truncation Error Propagation in Training-Free Low-Rank Compression for LLMs

    Aug 9, 2026Mohanad Odema, Gabrielle De Micheli, Dayin Gou +3Large Language Model CompressionLow-Rank Factorization

  21. Exact Rank and Convex Calibration Dimension Lower Bounds for the Multi-Label F1 Loss

    Aug 9, 2026Mingyuan ZhangMulti-Label ClassificationLow-Rank Factorization

  22. Shape Mutating Expert Compression:LorExperts and BTExperts

    Aug 7, 2026Inesh Chakrabarti, Sourjya Roy, Bowen Bao +3Mixture-Of-Expert Language ModelsExperts

  23. LoRSA: Toward Generalizable Parameter-Efficient Fine-Tuning for Biomedical Downstream Tasks

    Aug 7, 2026Saed Moradi, Benyamin Ghojogh, M. Hadi Sepanj +2Low-Rank AdaptationParameter-Efficient Fine-Tuning

  24. The Loss Does Not See the Basis, but Adam Does

    Aug 5, 2026Devender SinghLow-Rank FactorizationAdam

  25. Tight Worst-Case Bounds for the Smallest Eigenvalue of ReLU NTK Gram Matrices

    Aug 4, 2026Zhao SongLargest EigenvalueRectified Linear Unit

  26. Riemannian Attention Mechanisms for Transformers: A Theoretical Framework and Architecture Design

    Aug 2, 2026Sen SongTransformer AttentionSoftmax Attention

  27. S^4R: Selective Sampling, Subspaces, and Sparse Reconstruction for Compressed Long-Context KV Caching

    Aug 1, 2026Jialong Han, You Wu, Kewei TuKey-Value Cache CompressionKey-Value Cache

  28. Breaking the Periodicity Assumption: Robust Tensorial Multi-View Clustering via Graph-Spectral Low-Rank Learning

    Jul 28, 2026Jintian Ji, Xingsu Li, Songhe FengManifold Learning MethodMulti-View

  29. Structural Loss Metrics for Tensor Approximation via Matrix Low-Rank Approximation

    Jul 27, 2026Hiroki HasegawaLow-Rank FactorizationReconstruction Error

  30. Distributed Convolutional Rank Regression over Decentralized Networks

    Jul 26, 2026Chunjing Li, Tiange Zhao, Xiaohui YuanKernel Ridge RegressionLow-Rank Factorization

  31. Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

    Jul 25, 2026Dhruvil S, Fenil Sojitra, Ravirajsinh ChauhanMulti-Head Self-AttentionLatent Representation

  32. The Entropic Bound for Transformers: Why Static Rank Fails and Attention-Native Rank Recovers

    Jul 25, 2026Byeong Hoon YoonLow-Rank FactorizationTransformer Architectures

  33. \k{appa}-LoRA: Condition Numbers Reveal Which LoRA Matrices Worth Updating

    Jul 24, 2026Jianghui Wang, Silong Yong, Francesco Orabona +3Low-Rank AdaptationLow-Rank Factorization

  34. Variational Low-rank Tensor Decomposition for Multisubject Spatiotemporal Data Analysis

    Jul 24, 2026Laura M. Montaldo, Ricardo A. Borsoi, Sebastian Miron +1SpatiotemporalMatrix Factorization

  35. Bandit PCA with Minimax Optimal Regret

    Jul 12, 2026Moïse Blanchard, Dmitrii Ostrovskii, Aadirupa SahaPrincipal Component AnalysisRegret

  36. Learning from Noise: Effective-Rank Collapse and Out-of-Distribution Rejection in Restricted Boltzmann Machines

    Jul 11, 2026Oshada Rathnayake, Nikhil ShuklaOut-Of-DistributionLow-Rank Factorization

  37. Graph-Regularized Low-Rank Matrix Completion by Variable Projection

    Jul 10, 2026Benoît Loucheur, P. -A. Absil, Michel JournéeTensor CompletionLow-Rank Factorization

  38. Performance Benchmarking and Optimisation of Clustering Algorithms for Local and Non-Local Similarity Measure in Medical Image Analysis

    Jul 10, 2026Sisipho Hamlomo, Marcellin AtemkengImage ClusteringMedical Imaging

  39. SLORR: Simple and Efficient In-Training Low-Rank Regularization

    Jul 9, 2026David González-Martínez, Shiwei LiuLow-Rank FactorizationLarge Language Model Compression

  40. Super Weights in LLMs and the Failure of Selective Training

    Jul 9, 2026Shreyas Subramanian, Adewale Akinfaderin, Akarsha SehwagModel WeightsTrainable Parameter

  41. No Subspace to Track: Non-Identifiability and Optimizer State in Low-Rank Training

    Jul 7, 2026Noel ThomasLow-Rank FactorizationLarge Models

  42. LACE-SVD: Loss-Aware SVD with Cumulative Error Correction for LLM Compression

    Jul 3, 2026Zhuowen Liu, Longkun Hao, Shiyu Feng +3Large Language Model CompressionLow-Rank Factorization

  43. ZO-Act: Efficient Zeroth-Order Fine-Tuning via One-Shot Activation-Informed Low-Rank Subspaces

    Jul 1, 2026Xun Dong, Yibo Xu, Naigang Wang +3Continual Fine-TuningLarge Language Model Fine-Tuning

  44. Identifying Latent Concepts and Structures for Generalized Category Discovery

    Jul 1, 2026Boyang Dai, Chaoqi Chen, Yizhou YuGeneralized Category DiscoveryGlobal Embeddings

  45. Distributionally Robust Linear Regression With Block Lewis Weights

    Jun 30, 2026Naren Sarayu Manoj, Kumar Kshitij PatelLeast SquaresProximal Gradient Descent

  46. Direction-Magnitude Decomposition for Low-Rank Matrix Optimization: Faster Convergence and Saddle-to-saddle Dynamics

    Jun 30, 2026Yudong Wei, Liang Zhang, Bingcong Li +1Low-Rank FactorizationUniversal Factorization Problem

  47. Curvature-Guided Module Localization for Low-Rank Detoxification of Backdoored Large Language Models

    Jun 29, 2026Arash Raftari, Mehrdad Mahdavi, Nathan Blackthorn +1Backdoor AttacksDetoxification

  48. DLR: Zero-Inference-Cost Latent Residuals for Low-Rank Pre-Training

    Jun 27, 2026Dong Wang, Wenwu Tang, Yun Cheng +1Large Language Model PretrainingLow-Rank Factorization

  49. MixTTA: Low-Rank Cross-Channel Mixing for Reliable Test-Time Adaptation

    Jun 26, 2026Mansoo Jung, Youngwook Kim, Jungwoo LeeStable Test-Time AdaptationContinual Test-Time Adaptation

  50. When One Adapter Speaks for Many: Discovering Low-Rank Redundancy in Continual Fine-Tuning

    Jun 26, 2026Tanguy Dieudonné, Giulia Lanzillotta, Enis Simsar +2Low-Rank Adaptation AdaptersContinual Fine-Tuning

  51. Low-rank Updates in Slowly Time-varying Graphs for Spatial-Temporal Signal Interpolation

    Jun 22, 2026Saghar Bagheri, Gene Cheung, Tim Eadie +1Temporal Graph Neural NetworksSignal Processing

  52. SVD-Surgeon: Optimal Singular-Value Surgery for Large Language Model Compression

    Jun 22, 2026Mahmoud Safari, Frank HutterLarge Language Model CompressionSingular Value Decomposition

  53. Exposing the Illusion of Erasure in Knowledge Editing for LLMs

    Jun 22, 2026Advik Raj Basani, Anshuman ChhabraMultimodal Knowledge EditingConcept Erasure

  54. Low-Rank Attention Residuals

    Jun 19, 2026Jonathan SuQuadratic AttentionLow-Rank Factorization

  55. Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panels

    Jun 18, 2026Yuecheng Cai, Jasmin JelovicaFinite Element MethodGraph Neural Networks

  56. Activation- and Influence-Aware Ranks (AIR): Function-Preserving SVD Compression for LLMs

    Jun 18, 2026Nico Harder, Daniel Becking, Karsten Mueller +1Large Language Model CompressionLow-Rank Factorization

  57. A fast direct solver based neural network for solving PDEs

    Jun 18, 2026Jashwanth Reddy Kadaru, Vaishnavi GujjulaNeural Partial Differential Equation SolversPartial Differential Equations

  58. SDS-LoRA: Overcoming Anisotropic Gradient Scaling in Low-Rank Adaptation

    Jun 15, 2026Junghun Oh, Sungyong Baik, Kyoung Mu LeeLow-Rank AdaptationLow-Rank Factorization

  59. Active Learning with Low-Rank Structure for Data Selection

    Jun 14, 2026Vincent Cohen-Addad, Sasidhar Kunapuli, Vahab Mirrokni +3Geometry-Aware Uncertainty CoresetsLow-Rank Factorization

  60. PreLort: Prefix-Nested LoRA for Federated Fine-Tuning under Rank Heterogeneity

    Jun 14, 2026Muhammad Waseem, Nurbek Tastan, Andrej Jovanovic +4Low-Rank AdaptationLow-Rank Factorization