Low-Rank Factorization

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

9 new papers

A weekly snapshot of new work published in Low-Rank Factorization.

Inside this field

Focused directions

253 papers

Latest in Low-Rank Factorization

Browse all topics →
CardsList

  1. IFCLoRA: Topology-Aware Rank Allocation for Parameter-Efficient Fine-Tuning

    Jul 24, 2026Wei Zhang, Xinwu Liu, Yihang ChengGradient-Free Rank AllocatorLow-Rank Adaptation

  2. Deep Convolutional Large-Margin ℓp\ell_p-SVDD for Visual Anomaly Detection

    Jul 24, 2026Alireza Dastmalchi Saei, Shervin Rahimzadeh ArashlooReconstruction-Based Anomaly DetectionAnomaly Detection

  3. Statistical Inference for Rank Allocation in Low-Rank Adaptation

    Jul 22, 2026Yihang Gao, Vincent Y. F. TanGradient-Free Rank AllocatorLow-Rank Adaptation

  4. A JoLT for the KV Cache: Near-Lossless KV Cache Compression via Joint Tucker and JL-Residual Allocation for LLMs

    Jul 14, 2026Rahul Krishnan, Volker SchulzKey-Value Cache CompressionKey-Value Cache

  5. Bandit PCA with Minimax Optimal Regret

    Jul 12, 2026Moïse Blanchard, Dmitrii Ostrovskii, Aadirupa SahaPrincipal Component AnalysisRegret

  6. Learning from Noise: Effective-Rank Collapse and Out-of-Distribution Rejection in Restricted Boltzmann Machines

    Jul 11, 2026Oshada Rathnayake, Nikhil ShuklaOut-Of-DistributionLow-Rank Factorization

  7. Graph-Regularized Low-Rank Matrix Completion by Variable Projection

    Jul 10, 2026Benoît Loucheur, P. -A. Absil, Michel JournéeTensor CompletionLow-Rank Factorization

  8. Performance Benchmarking and Optimisation of Clustering Algorithms for Local and Non-Local Similarity Measure in Medical Image Analysis

    Jul 10, 2026Sisipho Hamlomo, Marcellin AtemkengImage ClusteringMedical Imaging

  9. SLORR: Simple and Efficient In-Training Low-Rank Regularization

    Jul 9, 2026David González-Martínez, Shiwei LiuLow-Rank FactorizationLarge Language Model Compression

  10. Super Weights in LLMs and the Failure of Selective Training

    Jul 9, 2026Shreyas Subramanian, Adewale Akinfaderin, Akarsha SehwagModel WeightsTrainable Parameter

  11. Spectral Stability of Pseudoinverse-Based Extreme Learning Machine

    Jul 9, 2026Bich Van Nguyen, Ngoc Anh KhongLeast SquaresSingular Value Decomposition

  12. No Subspace to Track: Non-Identifiability and Optimizer State in Low-Rank Training

    Jul 7, 2026Noel ThomasLow-Rank FactorizationLarge Models

  13. RSLoRA: Training-free Rank Allocation for LoRA via Representational Sensitivity Probing

    Jul 5, 2026Jiaqi Liu, Haidong Kang, Qihui Zhao +1Gradient-Free Rank AllocatorLow-Rank Adaptation

  14. Statistically Meaningful Geometry and Gauge Symmetry Breaking: A Geometric Foundation for Scientific Discovery and Intelligence Emergence

    Jul 3, 2026Bing Cheng, Yi-Shuai Niu, Howell Tong +1EmergenceGauge

  15. LACE-SVD: Loss-Aware SVD with Cumulative Error Correction for LLM Compression

    Jul 3, 2026Zhuowen Liu, Longkun Hao, Shiyu Feng +3Large Language Model CompressionLow-Rank Factorization

  16. In-context learning from self-generated trajectories for adaptive model reduction

    Jul 3, 2026Amirpasha Hedayat, Laura Balzano, Karthik DuraisamyReduced-Order ModelsPhysics-Informed Machine Learning

  17. SE-UNet: Singular Equivariant Imaging for Real-World Constrained Generation

    Jul 2, 2026Kanishk AwadhiyaLarge-Scale Image GenerationGenerative Priors

  18. ZO-Act: Efficient Zeroth-Order Fine-Tuning via One-Shot Activation-Informed Low-Rank Subspaces

    Jul 1, 2026Xun Dong, Yibo Xu, Naigang Wang +3Continual Fine-TuningLarge Language Model Fine-Tuning

  19. Identifying Latent Concepts and Structures for Generalized Category Discovery

    Jul 1, 2026Boyang Dai, Chaoqi Chen, Yizhou YuGeneralized Category DiscoveryGlobal Embeddings

  20. Distributionally Robust Linear Regression With Block Lewis Weights

    Jun 30, 2026Naren Sarayu Manoj, Kumar Kshitij PatelLeast SquaresProximal Gradient Descent

  21. CORA: Per-Slice Coherent Orthogonal Rotation for SVD-based Low-Rank Adaptation

    Jun 30, 2026Pengcheng Wang, Ziran Liu, Wei Wang +1Parameter-Efficient Fine-TuningSingular Value Decomposition

  22. Direction-Magnitude Decomposition for Low-Rank Matrix Optimization: Faster Convergence and Saddle-to-saddle Dynamics

    Jun 30, 2026Yudong Wei, Liang Zhang, Bingcong Li +1Low-Rank FactorizationUniversal Factorization Problem

  23. Curvature-Guided Module Localization for Low-Rank Detoxification of Backdoored Large Language Models

    Jun 29, 2026Arash Raftari, Mehrdad Mahdavi, Nathan Blackthorn +1Backdoor AttacksDetoxification

  24. DLR: Zero-Inference-Cost Latent Residuals for Low-Rank Pre-Training

    Jun 27, 2026Dong Wang, Wenwu Tang, Yun Cheng +1Large Language Model PretrainingLow-Rank Factorization

  25. MixTTA: Low-Rank Cross-Channel Mixing for Reliable Test-Time Adaptation

    Jun 26, 2026Mansoo Jung, Youngwook Kim, Jungwoo LeeStable Test-Time AdaptationContinual Test-Time Adaptation

  26. When One Adapter Speaks for Many: Discovering Low-Rank Redundancy in Continual Fine-Tuning

    Jun 26, 2026Tanguy Dieudonné, Giulia Lanzillotta, Enis Simsar +2Low-Rank Adaptation AdaptersContinual Fine-Tuning

  27. Shift Variant Image Degradation and Restoration Using Singular Value Decomposition

    Jun 24, 2026Arun D. KulkarniVisual DegradationRestoration

  28. A Framework for Directed Hypergraph Signal Processing via tensor t-SVD

    Jun 23, 2026Carlos Mundo-Levano, Nicolás Bello, Daniel L. Lau +1HypergraphsTensor

  29. Low-Cost High-Order Singular Value Decomposition for Tensor-Based Reconstruction from Sparse Sensor Measurements: Urban Flow and Air-Quality Applications

    Jun 23, 2026Arindam Sengupta, Paul Jeanney, Ricardo Vinuesa +2Singular Value DecompositionAir Pollution

  30. Uniform Sampling from High-dimensional Spectral Norm Balls

    Jun 23, 2026Michael R. MetelSpectral NormSingular Value Decomposition

  31. Low-rank Updates in Slowly Time-varying Graphs for Spatial-Temporal Signal Interpolation

    Jun 22, 2026Saghar Bagheri, Gene Cheung, Tim Eadie +1Temporal Graph Neural NetworksSignal Processing

  32. Exact Schur-Sylvester Dimensionality Reductions for Non-Smooth Stochastic Complexity and Manifold Sampling

    Jun 22, 2026Trenton Lau, Gary P. T. ChoiMaximum LikelihoodOptimal Sample Complexity

  33. SVD-Surgeon: Optimal Singular-Value Surgery for Large Language Model Compression

    Jun 22, 2026Mahmoud Safari, Frank HutterLarge Language Model CompressionSingular Value Decomposition

  34. Differential Spectral Damping Gap Adaptive Regularization for Ill-Conditioned Kernel Methods

    Jun 22, 2026Praveg VashishthaKernel MethodSingular Value Decomposition

  35. Exposing the Illusion of Erasure in Knowledge Editing for LLMs

    Jun 22, 2026Advik Raj Basani, Anshuman ChhabraMultimodal Knowledge EditingConcept Erasure

  36. UniRank: Unified Rank Allocation for Low-Rank LLM Compression

    Jun 20, 2026Chao Han, Yongjie Du, Junjie Tan +1Large Language Model CompressionGradient-Free Rank Allocator

  37. Low-Rank Attention Residuals

    Jun 19, 2026Jonathan SuQuadratic AttentionLow-Rank Factorization

  38. Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panels

    Jun 18, 2026Yuecheng Cai, Jasmin JelovicaFinite Element MethodGraph Neural Networks

  39. Activation- and Influence-Aware Ranks (AIR): Function-Preserving SVD Compression for LLMs

    Jun 18, 2026Nico Harder, Daniel Becking, Karsten Mueller +1Large Language Model CompressionLow-Rank Factorization

  40. A fast direct solver based neural network for solving PDEs

    Jun 18, 2026Jashwanth Reddy Kadaru, Vaishnavi GujjulaNeural Partial Differential Equation SolversPartial Differential Equations

  41. Algebraic Dead Directions in LayerNorm Transformers: A Forward-Pass-Only Diagnostic at LLM Scale

    Jun 17, 2026Tejas Pradeep Shirodkar, P. J. NarayananBatch NormalizationTransformer Architectures

  42. The Algebra of Units: From Buckingham's Pi-grec Theorem to Latent-Variable Learning

    Jun 15, 2026Mauro ValoraniSingular Value DecompositionExponents

  43. SPRI: SVD-Partitioned Residual Initialization for Data-Constrained MoE Upcycling

    Jun 15, 2026Weiqiao Shan, Ruixiang Mao, Yuang Li +10Mixture-of-Experts ModelsModel Pretraining

  44. SDS-LoRA: Overcoming Anisotropic Gradient Scaling in Low-Rank Adaptation

    Jun 15, 2026Junghun Oh, Sungyong Baik, Kyoung Mu LeeLow-Rank AdaptationLow-Rank Factorization

  45. Active Learning with Low-Rank Structure for Data Selection

    Jun 14, 2026Vincent Cohen-Addad, Sasidhar Kunapuli, Vahab Mirrokni +3Geometry-Aware Uncertainty CoresetsLow-Rank Factorization

  46. PreLort: Prefix-Nested LoRA for Federated Fine-Tuning under Rank Heterogeneity

    Jun 14, 2026Muhammad Waseem, Nurbek Tastan, Andrej Jovanovic +4Low-Rank AdaptationLow-Rank Factorization

  47. Policy Regret for Embedding Model Routing: Contextual Bandits with Low-Rank Experts

    Jun 12, 2026Yan Dai, Negin Golrezaei, Patrick JailletLarge-Scale Recommendation SystemsOptimal Bandit Algorithms

  48. Semidirect Fourier Delta Attention: Phase-Controlled Delta Memory with Constructive Chunk-WY Kernels

    Jun 12, 2026Tiantian ZhangQuadratic AttentionRecurrent State

  49. LoRA-Muon: Spectral Steepest Descent on the Low-Rank Manifold

    Jun 11, 2026Franz Louis Cesista, Katherine Crowson, Cédric Simal +1Low-Rank AdaptationLow-Rank Factorization

  50. TimeROME-DLM: Temporal Causal Tracing and Low-Rank Inference-Time Knowledge Editing for Masked Diffusion Language Models

    Jun 11, 2026Zhengtao Yao, Liuyang Song, Hongbo Zhang +4Masked Diffusion Language ModelsMultimodal Knowledge Editing

  51. A Riemannian Approach to Low-Rank Optimal Transport

    Jun 10, 2026Pratik Jawanpuria, Bamdev MishraOptimal TransportLow-Rank Factorization

  52. Accurate and Resource-Efficient Federated Continual Learning

    Jun 9, 2026Jebacyril Arockiaraj, Dhruv Parikh, Jayashree Adivarahan +2Federated LearningEfficient Continual Learning

  53. Annealed Entropic Allocation for Ranking and Selection

    Jun 9, 2026Xin Fei, Juergen BrankeGradient-Free Rank AllocatorCosine Annealing

  54. Recoverable but Not Stationary:Local Linear Structures in Weights and Activations

    Jun 9, 2026Irina Piontkovskaia, Sergey NikolenkoLow-Rank AdaptationLow-Rank Factorization

  55. Schmidt Decomposition-Based Methods for Efficient Quantum Image Encoding

    Jun 9, 2026Ana-Maria Pangeva, Yassine Ferhi, Alexander Geng +3Image ProcessingLow-Rank Factorization

  56. Geometric bias in eigenspace perturbation under random heterogeneous noise

    Jun 9, 2026Fengkai Liu, Ke Wang, Wanjie WangLargest EigenvalueLow-Rank Factorization

  57. Bidirectional Random Projections

    Jun 9, 2026Chao Lan, Luyuan YangLeast SquaresLow-Rank Factorization

  58. EinSort: Sorting is All We Need for Tensorizing LLM

    Jun 7, 2026Toshiaki Koike-Akino, Jing Liu, Ye WangTensor NetworksLow-Rank Factorization

  59. STAR-KV: Low-Rank KV Cache Compression via Soft Thresholding for Adaptive Rank Control

    Jun 7, 2026Priyansh Bhatnagar, Ashkan Moradifirouzabadi, Se-Hyun Yang +3Key-Value Cache CompressionKey-Value Cache

  60. What Does Debiasing Really Remove? A Geometric Study of PCA-Based Gender Debiasing in Word Embeddings

    Jun 6, 2026Alexey Kresin, Tchifou M. Dieffi, Tomer CaspiGender BiasBias Mitigation