Low-Rank Adaptation

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

23 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

Period ending 2026-09-07

14 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

Inside this field

Focused directions

858 papers

Latest in Low-Rank Adaptation

Browse all topics →
CardsList

  1. The Hidden Power of Scaling Factor in LoRA Optimization

    Jun 11, 2026Zicheng Zhang, Haoran Li, Jiaxing Wang +10Low-Rank AdaptationLearning Rates

  2. Small LLMs for Biomedical Claim Verification: Cost-Effective Fine-Tuning, Structural Dataset Shortcuts, and Cross-Domain Generalization

    Jun 11, 2026Gaurav KumarSmall Language ModelsFinetuning

  3. ViT-FREE: Efficient Face Recognition via Early Exiting and Synthetic Adaptation

    Jun 10, 2026Tahar Chettaoui, Guray Ozgur, Eduarda Caldeira +2Self-Supervised Vision TransformersFacial Recognition

  4. Semantic Grading of Written Answers in Low-Resource Language Bangla Using a Fine-Tuned Lightweight Language Model

    Jun 10, 2026Meherun Farzana, Aniket Joarder, Mahmudul Hasan +1BanglaGrading

  5. Fine-tuning Multi-modal LLMs with ART: Art-based Reinforcement Training

    Jun 10, 2026Michal Chudoba, Sergey Alyaev, Petra Galuscakova +1Large Language Model Fine-TuningMulti-Modal Large Language Models

  6. A Unifying Lens on Supervised Fine-Tuning Through Target Distribution Design

    Jun 9, 2026Tong Xie, Yuanhao Ban, Yunqi Hong +3Supervised Fine-TuningToken-Level Uncertainty

  7. AuRA: Internalizing Audio Understanding into LLMs as LoRA

    Jun 9, 2026Bo Cheng, Lei Shi, Zhanyu Ma +5Speech Large Language ModelsSpeech Encoder

  8. Structure from Reasoning, Numbers from Search: On-Premise Open LLMs as Structural Priors for Coupled MIMO Controller Tuning

    Jun 9, 2026Jiaxuan Chen, Haonan Li, Yang ShuTuningFeedback Linearization

  9. Recoverable but Not Stationary:Local Linear Structures in Weights and Activations

    Jun 9, 2026Irina Piontkovskaia, Sergey NikolenkoLow-Rank AdaptationLow-Rank Factorization

  10. SSR-Merge: Subspace Signal Routing for Training-Free LoRA Merging in Diffusion Models

    Jun 9, 2026Zhengxuan Wei, Yi Dong, Zonghui Li +6Low-Rank AdaptationModel Merging

  11. Small Data, Big Noise: Adversarial Training for Robust Parameter-Efficient Fine-Tuning

    Jun 9, 2026Eitan Cohen, Idan Simai, Uri ShahamParameter-Efficient Fine-TuningAdversarial Training

  12. 5% > 100%: Flatness Preference is All You Need for Multimodal Parameter-Efficient Fine-Tuning

    Jun 9, 2026Yifan Zhu, Can Lin, Hangjie Yuan +4Parameter-Efficient Fine-TuningSharpness-Aware Minimization

  13. Advancing the State-of-the-Art in Empirical Privacy Auditing

    Jun 9, 2026Nicole Mitchell, Galen Andrew, Arun Ganesh +2Efficient Privacy LossAlgorithm Auditing

  14. Which LoRA? An Empirical Study on the Effectiveness of LoRA Techniques During Multilingual Instruction Tuning

    Jun 9, 2026Thamali Wijewardhana, Napoleon H. Reyes, Surangika RanathungaMultimodal Instruction TuningMultilingual

  15. FOGO: Forgetting-aware Orthogonalization Optimizer

    Jun 9, 2026Toan Nguyen, Yang Liu, Trung Le +2ForgettingContinual Learning Methods

  16. Instruction Finetuning DeepSeek-R1-8B Model Using LoRA and NEFTune

    Jun 9, 2026Wu Yuerong, Mingni LuoNamed-Entity RecognitionLarge Language Model Fine-Tuning

  17. Supervised Fine-tuning with Synthetic Rationale Data Hurts Real-World Disease Prediction

    Jun 9, 2026Buxin Su, Bingxuan Li, Cheng Qian +3Clinical PredictionSupervised Fine-Tuning

  18. FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution

    Jun 9, 2026Amjad Mahdi Alqarni, Peizhong JuGenerative Super-ResolutionImage Restoration

  19. Fisher-Guided Progressive Parameter Selection for Adaptive Fine-Tuning

    Jun 8, 2026Ghodsiyeh Rostami, Po-Han Chen, Mahdi S. HosseiniParameter-Efficient Fine-TuningFisher Information

  20. Data Synthesis and Parameter-Efficient Fine-Tuning for Low-Resource NMT: A Case Study on Q'eqchi' Mayan

    Jun 8, 2026Alexander Chulzhanov, Soeren Eberhardt, Arjun MukherjeeNeural Machine Translation ModelsLow-Resource Languages

  21. Benchmarking Empirical Privacy Protection for Adaptations of Large Language Models

    Jun 8, 2026Bartłomiej Marek, Lorenzo Rossi, Vincent Hanke +4Large Language Model AdaptationEfficient Privacy Loss

  22. PriFT: Prior-Support Guided Supervised Fine-Tuning

    Jun 8, 2026Ke Wang, Shuangqi Li, Mathieu Salzmann +1Supervised Fine-TuningToken-Level Uncertainty

  23. Distilling Safe LLM Systems via Soft Prompts for On Device Settings

    Jun 8, 2026Motasem Alfarra, Cristina Pinneri, Dana Kianfar +2Large Language Model SafetySafety Alignment

  24. When RL Fails after SFT: Rejuvenating Model Plasticity for Robust SFT-to-RL Handoff

    Jun 7, 2026Runze Liu, Jiashun Liu, Xu Wan +2Supervised Fine-TuningPlasticity

  25. Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation

    Jun 7, 2026Xingyue Zhao, Wenke Huang, Linghao Zhuang +7Low-Rank AdaptationMedical Image Segmentation

  26. Lost in the Non-convex Loss Landscape: How to Fine-tune the Large Time Series Model?

    Jun 7, 2026Xu Zhang, Peang Wang, Wei WangFinetuningTime Series

  27. How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

    Jun 6, 2026Donghao Huang, Tomas Drietomsky, Benjamin Barrett +1Large Language Model Fine-TuningTransaction Histories

  28. Rosetta Memory: Adaptive Memory for Cross-LLM Agents

    Jun 5, 2026Hao Yang, Shiqi Shen, Haoxuan Li +3Large Language Model AdaptationExperience

  29. Robotic Policy Adaptation via Weight-Space Meta-Learning

    Jun 5, 2026Christian Bianchi, Siamak Yousefi, Alessio Sampieri +4Robot PoliciesMeta-Learning

  30. AdaTok: Self-Budgeting Image Tokenization with Quality-Preserving Dynamic Tokens

    Jun 5, 2026Xiaocheng Lu, Yuxi Chen, Jie Zhang +5Visual TokensTokenization

  31. RASFT: Rollout-Adaptive Supervised Fine-Tuning for Reasoning

    Jun 5, 2026Yongliang Miao, Fengyuan Liu, Wei Shi +4Supervised Fine-Tuning

  32. Auditing Training Data in Domain-adapted LLMs: LoRA-MINT

    Jun 5, 2026Gonzalo Mancera, Daniel DeAlcala, Aythami Morales +3Large Language Model AdaptationMembership Inference

  33. The Fine-Tuning Trap: Evaluating Negative Transfer and the Role of PEFT in Sub-1B Mathematical Reasoning

    Jun 5, 2026Rahul Nair, Chun TaoParameter-Efficient Fine-TuningFinetuning

  34. Modular Monolingual Adaptation using Pretrained Language Models

    Jun 4, 2026Nalin Kumar, Ondřej DušekMultilingual Language ModelsLow-Resource Languages

  35. Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution

    Jun 4, 2026Liliana Hotsko, Yinxi Li, Yuntian Deng +1CodebasesLow-Rank Adaptation Adapters

  36. Amortizing Federated Adaptation: Hypernetwork Driven LoRA for Personalized Foundation Models

    Jun 4, 2026Sunny Gupta, Shambhavi Shanker, Amit SethiLow-Rank AdaptationWireless Foundation Models

  37. LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents

    Jun 4, 2026Aofan Yu, Chenyu Zhou, Tianyi Xu +8Large Language Model AgentsLow-Rank Adaptation Adapters

  38. RedditPersona: A Modular Framework for Community-Conditioned LLM Adaptation from Reddit

    Jun 4, 2026Amirhossein Ghaffari, Ali Goodarzi, Huong Nguyen +3Large Language Model AdaptationReddit

  39. High-Dimensional Theory of LoRA Fine-Tuning in a Solvable Attention Model

    Jun 4, 2026O. Duranthon, F. Boncoraglio, L. ZdeborováLow-Rank AdaptationFinetuning

  40. GLASS: GRPO-Trained LoRA for Acoustic Style Steering in Zero-Shot Text-to-Speech

    Jun 4, 2026Jaehoon Kang, Yejin Lee, Kyuhong ShimZero-Shot Text-To-SpeechSpeaker Identity

  41. Emotion-Aware Image Generation from Korean Diary Text via LLM-based Prompt Translation and LoRA Fine-Tuning

    Jun 4, 2026Jihun Cho, Soo-Yeon Jeong, Sun-Young IhmText-To-ImageText Generation

  42. Domain-Adapted Small Language Models with Hybrid Post-Processing: Achieving Cost-Efficient, Low-Latency Multi-Label Structured Prediction via LoRA Fine-Tuning on Scarce Data

    Jun 4, 2026Srinivasan Manoharan, Dilipkumar Nallusamy, Sachin Kumar +1Low-Rank AdaptationData Scarcity

  43. Automated Proving of Shannon-Type Entropy Inequalities via Fine-Tuned Language Models and Guided Tree Search

    Jun 4, 2026Shing Yin Wong, Shaocheng Liu, Linqi Song +2TheoremSmall Language Models

  44. Rethinking LoRA Memory Through the Lens of KV Cache Compression

    Jun 4, 2026Chunsheng Zuo, Liaoyaqi Wang, William Jurayj +2Key-Value Cache CompressionKey-Value Cache

  45. Multilingual Fine-Tuning via Localized Gradient Conflict Resolution

    Jun 4, 2026Long P. Hoang, Yiran Zhao, Wei Lu +1Multilingual Language ModelsLarge Language Model Fine-Tuning

  46. Dominant-Layer ZO: A Single Layer Dominates Zeroth-Order Fine-Tuning of LLMs

    Jun 3, 2026Wanhao Yu, Ziyan Wang, Zheng Wang +7Continual Fine-TuningTransformer Layers

  47. TaDA: Calibrated Probe Gating for Task-Domain LoRA Merging

    Jun 3, 2026Huy Quoc To, Fuyi Li, Guangyan Huang +1Low-Rank Adaptation AdaptersLow-Rank Adaptation

  48. Crafting Your Evolving Dreams: Concept-Incremental Versatile Customization

    Jun 3, 2026Jiahua Dong, Wenqi Liang, Hongliu Li +7Discrete Diffusion ModelCatastrophic Forgetting

  49. Scaling Self-Evolving Agents via Parametric Memory

    Jun 3, 2026Tao Ren, Weiyao Luo, Hui Yang +8Self-Evolving AgentsLow-Rank Adaptation

  50. (Mis)generalization of Helpful-only Fine-tuning

    Jun 3, 2026Mohammad Omar Khursheed, Baram Sosis, Fabien RogerHarmful Fine-TuningFinetuning

  51. Parameter-Efficient Fine-Tuning with Learnable Rank

    Jun 3, 2026Arpit Garg, Simon Lucey, Hemanth SaratchandranParameter-Efficient Fine-TuningLow-Rank Adaptation

  52. Long Live Fine-Tuning: Task-Specific Transformers Outperform Zero-Shot LLMs for Misinformation Response Classification on Reddit

    Jun 2, 2026JooYoung Lee, Lin Tian, Angela Brillantes +2Misinformation DetectionMisinformation

  53. StepPRM-RTL: Stepwise Process-Reward Guided LLM Fine-Tuning for Enhanced RTL Synthesis

    Jun 2, 2026Prashanth Vijayaraghavan, Apoorva Nitsure, Luyao Shi +2VhdlFlexible Register Transfer Level Design Automation

  54. EvalStop: Using World Feedback to Detect and Correct Reward Overoptimization in Multi-Tenant RLHF Platforms

    Jun 2, 2026Guilin Zhang, Chuanyi Sun, Kai Zhao +3Reinforcement Learning From Human FeedbackOptimal Scheduling

  55. Where Do We (Not) Need Temporal Context in Low-Resource Video Task Adaptation?

    Jun 2, 2026Luc P. J. Sträter, Hazel DoughtyParameter-Efficient Fine-TuningDomain Adaptation

  56. Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting

    Jun 2, 2026Georgios Tsoumplekas, Stella Bounareli, Vasileios ArgyriouText-To-ImageLow-Rank Adaptation

  57. Compress then Merge: From Multiple LoRAs into One Low-Rank Adapter

    Jun 2, 2026Zhengbao He, Ruiqi Ding, Zhehao Huang +3Low-Rank AdaptationLarge Language Model Compression

  58. RIZZ: Routing Interactions to Near Zero-Interference Zones for Continual Adaptation of Black-Box Agents

    Jun 2, 2026Sonali Goel, Pranav Vaidhyanathan, Lucas Schorling +2Large Language Model AdaptationParameter-Efficient Adaptation

  59. A Close Look At World Model Recovery In Supervised Fine-Tuned LLM Planners

    Jun 2, 2026Patrick Emami, Nan Qiang, Peter GrafLarge Language Model PlanningLatent World Models

  60. Safety Measurements for Fine-tuned LLMs Should be Grounded in Capability

    Jun 2, 2026Krishnapriya Vishnubhotla, Hillary Dawkins, Isar Nejadgholi +1Large Language Model SafetyLarge Language Model Fine-Tuning