Low-Rank Adaptation

Ask about this topic

Recent momentum

-41%

23 papers in the last 28 days · 0.4% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Low-Rank Adaptation

Neighbouring directions

FinetuningLarge Language Model Fine-TuningLarge Language Model AdaptationSupervised Fine-TuningParameter-Efficient Fine-TuningLow-Rank Adaptation AdaptersContinual Fine-Tuning

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

5 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Low-Rank Adaptation.

Period ending 2026-09-07

11 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

293 papers

Latest in Low-Rank Adaptation

Browse all topics →
CardsList

  1. When Top-1 Fails: Calibrating LoRA Monitors for Masked Diffusion LMs

    Jun 23, 2026Lucky Verma, Pratik YadavDiffusion Language ModelsMasked Diffusion Language Models

  2. Diffusion Models Adapt to Low-Dimensional Structure Under Flexible Coefficient Choices

    Jun 22, 2026Changxiao Cai, Yuchen Jiao, Gen LiDiffusion SamplingLow-Dimensional Structure

  3. Priority-Aware Learning-Unlearning Correction for Dynamic Decentralized LoRA Fine-Tuning

    Jun 22, 2026Nuocheng Yang, Yechen He, Sihua Wang +3Federated LearningLow-Rank Adaptation

  4. Subspace-Constrained Federated Learning with Low-Rank Adaptation

    Jun 21, 2026Neranjan Senarath, Rohit Muralitharan, Sadia AsifFederated LearningLow-Rank Adaptation

  5. Enhancing LLMs for Graph Tasks via Graph-aware LoRA Generation

    Jun 21, 2026Junshu Sun, Wanxing Chang, Qingming Huang +1Graph Neural NetworksGraph Representations

  6. Bayesian Adaptation Gym: A Benchmark for the Bayesian Low-Rank Adaptation of Multi-Modal Language Models

    Jun 20, 2026Colin Samplawski, Ramneet Kaur, Manoj Acharya +2Large Language Model AdaptationLow-Rank Adaptation

  7. FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining

    Jun 18, 2026Jinghong Lan, Wei Cheng, Yunuo Chen +10Photorealistic Style TransferLarge-Scale Image Generation

  8. Predicting Mergeability of Parameter-Efficient Fine-Tuning Updates

    Jun 17, 2026Lin Tang, Wei Zhang, Jing Li +3Low-Rank AdaptationLarge Language Model Adaptation

  9. Techniques for Peak Memory Reduction for LoRA Fine-tuning of LLMs on Edge Devices

    Jun 17, 2026Hassan Dbouk, Matthias Reisser, Prathamesh Mandke +2Low-Rank AdaptationQuantizer

  10. User as Engram: Internalizing Per-User Memory as Local Parametric Edits

    Jun 17, 2026Bojie LiLarge Language Model MemoryMemory Retrieval

  11. Pareto LoRA: Mitigating Modality Imbalance in Unified Multimodal Models via Pareto-Optimal Gradient Integration

    Jun 15, 2026Xiwen Wei, Mark Nutter, Madhusudhanan Srinivasan +1Unified Multimodal ModelsMultimodal Instruction Tuning

  12. SDS-LoRA: Overcoming Anisotropic Gradient Scaling in Low-Rank Adaptation

    Jun 15, 2026Junghun Oh, Sungyong Baik, Kyoung Mu LeeLow-Rank AdaptationLow-Rank Factorization

  13. Variable-Rate Deep Image Compression based on Low-Rank Adaptation by Progressive Learning

    Jun 15, 2026Xing-Yu Xu, Chen-Hsiu Huang, Ja-Ling WuLearned Image CompressionLow-Rank Adaptation

  14. PreLort: Prefix-Nested LoRA for Federated Fine-Tuning under Rank Heterogeneity

    Jun 14, 2026Muhammad Waseem, Nurbek Tastan, Andrej Jovanovic +4Low-Rank AdaptationLow-Rank Factorization

  15. Dense Coordinate-List Fine-Tuning Induces a Controllable Interference Surface in Vision-Language Models

    Jun 12, 2026Chenyu Zhou, Qiliang Jiang, Boguang PanLow-Rank AdaptationVisual Grounding

  16. Applicability Condition Extraction for Therapeutic Drug-Disease Relations

    Jun 12, 2026Guanting Luo, Noriki Nishida, Yuji Matsumoto +1Biomedical TextDrug-Drug Interactions

  17. Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation

    Jun 11, 2026Xiaomeng Yang, Yanyu Li, Gordon Guocheng Qian +7Pre-Trained Video Diffusion ModelsLow-Rank Adaptation

  18. Compressing Image Style Training into a Single Model Forward

    Jun 11, 2026Zhongjie Duan, Yingda ChenPhotorealistic Style TransferGenerative Image Compression

  19. Beyond LoRA: Is Sparsity-Induced Adaptation Better?

    Jun 11, 2026Elijah Cadenhead, Cristian McGee, Xin Li +2Low-Rank Adaptation

  20. LoRA-Muon: Spectral Steepest Descent on the Low-Rank Manifold

    Jun 11, 2026Franz Louis Cesista, Katherine Crowson, Cédric Simal +1Low-Rank AdaptationLow-Rank Factorization

  21. The Hidden Power of Scaling Factor in LoRA Optimization

    Jun 11, 2026Zicheng Zhang, Haoran Li, Jiaxing Wang +10Low-Rank AdaptationLearning Rates

  22. AuRA: Internalizing Audio Understanding into LLMs as LoRA

    Jun 9, 2026Bo Cheng, Lei Shi, Zhanyu Ma +5Speech Large Language ModelsSpeech Encoder

  23. Recoverable but Not Stationary:Local Linear Structures in Weights and Activations

    Jun 9, 2026Irina Piontkovskaia, Sergey NikolenkoLow-Rank AdaptationLow-Rank Factorization

  24. SSR-Merge: Subspace Signal Routing for Training-Free LoRA Merging in Diffusion Models

    Jun 9, 2026Zhengxuan Wei, Yi Dong, Zonghui Li +6Low-Rank AdaptationModel Merging

  25. Which LoRA? An Empirical Study on the Effectiveness of LoRA Techniques During Multilingual Instruction Tuning

    Jun 9, 2026Thamali Wijewardhana, Napoleon H. Reyes, Surangika RanathungaMultimodal Instruction TuningMultilingual

  26. Instruction Finetuning DeepSeek-R1-8B Model Using LoRA and NEFTune

    Jun 9, 2026Wu Yuerong, Mingni LuoNamed-Entity RecognitionLarge Language Model Fine-Tuning

  27. Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation

    Jun 7, 2026Xingyue Zhao, Wenke Huang, Linghao Zhuang +7Low-Rank AdaptationMedical Image Segmentation

  28. How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

    Jun 6, 2026Donghao Huang, Tomas Drietomsky, Benjamin Barrett +1Large Language Model Fine-TuningTransaction Histories

  29. Robotic Policy Adaptation via Weight-Space Meta-Learning

    Jun 5, 2026Christian Bianchi, Siamak Yousefi, Alessio Sampieri +4Robot PoliciesMeta-Learning

  30. AdaTok: Self-Budgeting Image Tokenization with Quality-Preserving Dynamic Tokens

    Jun 5, 2026Xiaocheng Lu, Yuxi Chen, Jie Zhang +5Visual TokensTokenization

  31. Amortizing Federated Adaptation: Hypernetwork Driven LoRA for Personalized Foundation Models

    Jun 4, 2026Sunny Gupta, Shambhavi Shanker, Amit SethiLow-Rank AdaptationWireless Foundation Models

  32. High-Dimensional Theory of LoRA Fine-Tuning in a Solvable Attention Model

    Jun 4, 2026O. Duranthon, F. Boncoraglio, L. ZdeborováLow-Rank AdaptationFinetuning

  33. GLASS: GRPO-Trained LoRA for Acoustic Style Steering in Zero-Shot Text-to-Speech

    Jun 4, 2026Jaehoon Kang, Yejin Lee, Kyuhong ShimZero-Shot Text-To-SpeechSpeaker Identity

  34. Emotion-Aware Image Generation from Korean Diary Text via LLM-based Prompt Translation and LoRA Fine-Tuning

    Jun 4, 2026Jihun Cho, Soo-Yeon Jeong, Sun-Young IhmText-To-ImageText Generation

  35. Domain-Adapted Small Language Models with Hybrid Post-Processing: Achieving Cost-Efficient, Low-Latency Multi-Label Structured Prediction via LoRA Fine-Tuning on Scarce Data

    Jun 4, 2026Srinivasan Manoharan, Dilipkumar Nallusamy, Sachin Kumar +1Low-Rank AdaptationData Scarcity

  36. Rethinking LoRA Memory Through the Lens of KV Cache Compression

    Jun 4, 2026Chunsheng Zuo, Liaoyaqi Wang, William Jurayj +2Key-Value Cache CompressionKey-Value Cache

  37. TaDA: Calibrated Probe Gating for Task-Domain LoRA Merging

    Jun 3, 2026Huy Quoc To, Fuyi Li, Guangyan Huang +1Low-Rank Adaptation AdaptersLow-Rank Adaptation

  38. Crafting Your Evolving Dreams: Concept-Incremental Versatile Customization

    Jun 3, 2026Jiahua Dong, Wenqi Liang, Hongliu Li +7Discrete Diffusion ModelCatastrophic Forgetting

  39. Scaling Self-Evolving Agents via Parametric Memory

    Jun 3, 2026Tao Ren, Weiyao Luo, Hui Yang +8Self-Evolving AgentsLow-Rank Adaptation

  40. Parameter-Efficient Fine-Tuning with Learnable Rank

    Jun 3, 2026Arpit Garg, Simon Lucey, Hemanth SaratchandranParameter-Efficient Fine-TuningLow-Rank Adaptation

  41. Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting

    Jun 2, 2026Georgios Tsoumplekas, Stella Bounareli, Vasileios ArgyriouText-To-ImageLow-Rank Adaptation

  42. Compress then Merge: From Multiple LoRAs into One Low-Rank Adapter

    Jun 2, 2026Zhengbao He, Ruiqi Ding, Zhehao Huang +3Low-Rank AdaptationLarge Language Model Compression

  43. Normality-Preserving Continual Industrial Anomaly Detection via Orthogonal LoRA Banks

    Jun 1, 2026Weibai Fang, Haijun Che, Feiyang Ren +1Zero-Shot Anomaly DetectionLow-Rank Adaptation

  44. Low-Rank Adaptation of Frozen Vision-Language Models for Blind Image Quality Assessment

    Jun 1, 2026Bishr Omer Adam, Xu LiImage Quality AssessmentFrozen Vision-Language Models

  45. Parameter-Efficient Fine-Tuning of Large Pretrained Models for Instance Segmentation Tasks

    Jun 1, 2026Nermeen Abou Baker, David Rohrschneider, Uwe HandmannParameter-Efficient Fine-TuningLow-Rank Adaptation

  46. Beyond Low-Rank: Low-Rank Sparse Prompting via Spiking Neural Network and Prompt Factorization

    Jun 1, 2026Yumiao Zhao, Bo Jiang, Beibei Wang +3Visual In-Context LearningLow-Rank Adaptation

  47. LayerRoute: Input-Conditioned Adaptive Layer Skipping via LoRA Fine-Tuning for Agentic Language Models

    Jun 1, 2026Prateek Kumar SikdarLarge Language Model BackbonesTransformer Layers

  48. GPTQ-intrinsic LoRA: A Near-optimal Algorithm for Low-precision Quantization with Low-rank Adaptation

    May 31, 2026Shihao Zhang, Rayan SaabWeight-Only QuantizationQuantization

  49. ThinkSwitch: Context Distillation with LoRA and Weight Interpolation for Specific-Purpose Reasoning Tasks

    May 31, 2026Dhruv Saini, Rohan PandeyChain-Of-Thought DistillationInference-Time

  50. PRISM: Gauge-Invariant Tangent-Space Differentially Private LoRA

    May 31, 2026Shihao Wang, Xueru ZhangDifferential PrivacyLow-Rank Adaptation

  51. Subliminal Learning is a LoRA Artifact

    May 30, 2026Todd Nief, Harvey Yiyun Fu, Mark Muchane +1Low-Rank Adaptation

  52. Logit Distillation on Manifolds: Mapping by Learning

    May 30, 2026Yiru Yang, Junling Wang, Nishant Kumar Singh +2Model TrainingProgressive Distillation

  53. ProjQ: Project-and-Quantize for Adapter-Aware LLM Compression

    May 30, 2026Wenya Yu, Chao Zhang, Li Wang +2Large Language Model QuantizationLarge Language Model Compression

  54. Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters

    May 29, 2026Xinjue Wang, Xiuheng Wang, Yejun Zhang +3Low-Rank Adaptation AdaptersLow-Rank Adaptation

  55. From "Weak" Signals to Strong Models: Preference Delta Aggregation with LoRA Merging

    May 29, 2026Qi Sun, Siyue Zhang, Yulin Chen +3Large LanguageLow-Rank Adaptation

  56. Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence

    May 29, 2026Valérie Castin, Kimia Nadjahi, Pierre Ablin +1Low-Rank AdaptationFinetuning

  57. LEAF: Growing Trees Without Branching for Speech-Aware Large Language Model Post-Training

    May 29, 2026Argyrios Gerogiannis, Yekaterina Yegorova, Mark Hasegawa-Johnson +1Speech Large Language ModelsSpeech-Llms

  58. CSULoRA: Closest Safe Update Low-Rank Adaptation

    May 28, 2026Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh +1Low-Rank AdaptationHarmful Fine-Tuning

  59. Foundation-Preserving Adaptation via Generalized Rayleigh-Quotient Optimization

    May 28, 2026Dongjun Kim, Adrian de Wynter, Huancheng Chen +2Low-Rank AdaptationParameter-Efficient Adaptation

  60. How LoRA Remembers? A Parametric Memory Law for LLM Finetuning

    May 28, 2026Ziwen Xu, Haiwen Hong, Linsong Yu +4Large Language Model MemoryLarge Language Model Fine-Tuning