Low-Rank Adaptation

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

23 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

Period ending 2026-09-07

14 new papers

A weekly snapshot of new work published in Low-Rank Adaptation.

Inside this field

Focused directions

Focused topic

Low-Rank Adaptation

Within Low-Rank Adaptation

293 papersExplore

Focused topic

Finetuning

Within Low-Rank Adaptation

140 papersExplore

Focused topic

Large Language Model Fine-Tuning

Within Low-Rank Adaptation

139 papersExplore

Focused topic

Large Language Model Adaptation

Within Low-Rank Adaptation

117 papersExplore

Focused topic

Supervised Fine-Tuning

Within Low-Rank Adaptation

109 papersExplore

Focused topic

Parameter-Efficient Fine-Tuning

Within Low-Rank Adaptation

108 papersExplore

Focused topic

Low-Rank Adaptation Adapters

Within Low-Rank Adaptation

63 papersExplore

Focused topic

Continual Fine-Tuning

Within Low-Rank Adaptation

28 papersExplore

858 papers

Latest in Low-Rank Adaptation

Browse all topics →

Thinking-while-speaking: A Controlled, Interleaved Reasoning Method for Real-Time Speech Generation
May 20, 2026Xuan Du, Qiangyu Yan, Wenshuo Li +4Speech-Llms Supervised Fine-Tuning
Frequency-Domain Regularized Adversarial Alignment for Transferable Attacks against Closed-Source MLLMs
May 20, 2026Leitao Yuan, Qinghua Mao, Daizong Liu +5Adversarial Transferability Large Language Model Adaptation
AirCast-SR: A Foundation Model for Kilometer-Scale Atmospheric Super-Resolution via Latent Consistency Diffusion
May 20, 2026Somnath Luitel, Manmeet Singh, Joshua Durkee +11Foundation Model Continual Fine-Tuning
Most Transformer Modifications Still Do Not Transfer at 1-3B: A 2020-2026 Update to Narang et al. (2021) with Downstream Evaluation and a Noise Floor
May 20, 2026Yang Zhao, Jiahao Lu, Bin Huang +2Finetuning Loss Function
Pareto-Enhanced Portrait Generation: Vision-Aligned Text Supervision for Alignment, Realism, and Aesthetics
May 20, 2026Yunlong Wang, Jinjin Shi, Wenbin Gao +3Text-To-Image Diffusion Models Video-Text Alignment
FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
May 19, 2026Yequan Zhao, Ruijie Zhang, Liyan Tan +3Parameter-Efficient Fine-Tuning Low-Rank Adaptation
An exponential mechanism based on quadratic approximations for fine-tuning machine learning models with privacy guarantees
May 19, 2026Hoang Tran, Jorge Ramirez, Jiayi Wang +3Differential Privacy Finetuning
Spectral Souping: A Unified Framework for Online Preference Alignment
May 19, 2026Yinlam Chow, Guy Tennenholtz, Ted Yun +4Preference Alignment Large Language Model Adaptation
Security Document Classification with a Fine-Tuned Local Large Language Model: Benchmark Data and an Open-Source System
May 19, 2026Ivan DobrovolskyiObject Classification Qwen3
AR1-ZO: Topology-Aware Rank-1 Zeroth-Order Queries for High-Rank LoRA Fine-Tuning
May 19, 2026Ziye Chen, Hongbin Lin, Chenyu Zhang +3Low-Rank Adaptation Zeroth-Order Optimization
MedCRP-CL: Continual Medical Image Segmentation via Bayesian Nonparametric Semantic Modality Discovery
May 19, 2026Ziyuan GaoMedical Image Segmentation Efficient Continual Learning
Spectral Unforgetting: Post-Hoc Recovery of Damaged Capabilities Without Retraining
May 19, 2026Aarash Abro, Muhammad TahirFinetuning Catastrophic Forgetting
iGSP:Implicit Gradient Subspace Projection for Efficient Continual Learning of Vision-Language Models
May 19, 2026Xuezhi Cui, Dongbo Zhou, Wang Guo +8Vision-Language Model Adaptation Parameter-Efficient Fine-Tuning
Modality-Decoupled Online Recursive Editing
May 19, 2026Siyuan Li, Youyuan Zhang, Fangming Liu +1Multi-Modal Large Language Models Multimodal Knowledge Editing
Fine-tuning language encoding models on slow fMRI improves prediction for fast ECoG
May 19, 2026Aditya R. Vaidya, Richard J. Antonello, Alexander G. HuthElectrocorticography Brain Magnetic Resonance Imaging
Learning When to Adapt
May 18, 2026Ali Zindari, Xiaowen Jiang, Rotem Mulayoff +1Low-Rank Adaptation
LoRA vs. Full Fine-Tuning: A Theoretical Perspective
May 18, 2026Ali Zindari, Rotem Mulayoff, Sebastian U. StichLow-Rank Adaptation Finetuning
Distilling Linearized Behavior into Non-Linear Fine-Tuning for Effective Task Arithmetic
May 18, 2026Thomas Sommariva, Francesca Morandi, Simone Calderara +1Finetuning Model Pretraining
Alignment Dynamics in LLM Fine-Tuning
May 18, 2026Yuhan Huang, Huanran Chen, Yinpeng DongLarge Language Model Alignment Large Language Model Fine-Tuning
Reconciling Contradictory Views on the Effectiveness of SFT in LLMs: An Interaction Perspective
May 18, 2026Junpeng Zhang, Lei Cheng, Guoxi Zhang +3Supervised Fine-Tuning Overfitting
SNLP: Layer-Parallel Inference via Structured Newton Corrections
May 18, 2026Ligong Han, Kai Xu, Hao Wang +1Transformer Layers Transformer Residual Streams
ClaHF: A Human Feedback-inspired Reinforcement Learning Framework for Improving Classification Tasks
May 17, 2026Tianxiang Xu, Xiaoyan Zhu, Xin Lai +1Reinforcement Learning From Human Feedback Supervised Fine-Tuning
DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
May 17, 2026Haichao Sha, Zihao Wang, Yuncheng Wu +2Differential Privacy Finetuning
Learning Faster with Better Tokens: Parameter-Efficient Vocabulary Adaptation for Specialized Text Summarization
May 17, 2026Gunjan Balde, Soumyadeep Roy, Mainack Mondal +1Large Language Model Adaptation Summarization
TSFLora: Token-Compressed Split Fine-Tuning for Wireless Edge Networks
May 17, 2026Xianke Qiang, Zheng Chang, Li Wang +1Heterogeneous Edge Devices Parameter-Efficient Fine-Tuning
Closing the Gap at CRAC 2026: Two-Stage Adaptation for LLM-Based Multilingual Coreference Resolution
May 16, 2026Antoine Bourgois, Olga Seminck, Thierry PoibeauCoreference Resolution Large Language Model Adaptation
MixSD: Mixed Contextual Self-Distillation for Knowledge Injection
May 16, 2026Jiarui Liu, Lechen Zhang, Yongjin Yang +5Knowledge Distillation Supervised Fine-Tuning
FIM-LoRA: Task-Informative Rank Allocation for LoRA via Calibration-Time Gradient-Variance Estimation
May 16, 2026Ramakrishnan SathyavageeswaranLow-Rank Adaptation Gradient-Free Rank Allocator
GLT-PEFT: Gated Lie-Tucker Parameter-Efficient Fine-Tuning for Alzheimer's Disease Diagnosis with Hippocampal Segmentation Pretraining
May 16, 2026Guanghua He, Hancan Zhu, Gaohang Yu +1Parameter-Efficient Fine-Tuning Low-Rank Adaptation
PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play
May 16, 2026Roger Creus Castanyer, Geoffrey Bradway, Lorenz Wolf +3Self-Play Reinforcement Learning With Verifiable Reward
A Scalable Nonparametric Continuous-Time Survival Model through Numerical Quadrature
May 15, 2026Chaeyeon Lee, Sehwan Kim, Hyungrok DoTime-To-Event Data Survival Analysis
Sparse Autoencoders enable Robust and Interpretable Fine-tuning of CLIP models
May 15, 2026Fabian Morelli, Arnas Uselis, Ankit Sonthalia +1Supervised Fine-Tuning Large Vision Language Models
LoCO: Low-rank Compositional Rotation Fine-tuning
May 15, 2026An Nguyen, Jaesik Choi, Anh TongLow-Rank Adaptation Parameter-Efficient Fine-Tuning
Strategic Over-Parameterization for Generalizable Low-Rank Adaptation
May 15, 2026Jing Gao, Zhong-Yi Lu, Pan Zhang +1Parameter-Efficient Fine-Tuning Low-Rank Adaptation
Representation Without Reward: A JEPA Audit for LLM Fine-Tuning
May 14, 2026Biswa SenguptaLarge Language Model Fine-Tuning Joint-Embedding Predictive Architectures
Training ML Models with Predictable Failures
May 14, 2026Will Schwarzer, Scott NiekumEarly Failure Prediction Model Evaluation
Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance
May 14, 2026Kai Yan, Alexander G. Schwing, Yu-Xiong WangReinforcement Learning With Verifiable Reward Verifiable Rewards
InfoSFT: Learn More and Forget Less with Information-Aware Token Weighting
May 14, 2026Mahdi Sabbaghi, George Pappas, Adel Javanmard +1Supervised Fine-Tuning
GPart: End-to-End Isometric Fine-Tuning via Global Parameter Partitioning
May 14, 2026Paolo Mandica, Michał Brzozowski, Zuzanna Dubanowska +1Parameter-Efficient Fine-Tuning Low-Rank Adaptation
Reducing the Safety Tax in LLM Safety Alignment with On-Policy Self-Distillation
May 14, 2026Yu Fu, Longxuan Yu, Haz Sameen Shahgir +4Unsupervised On-Policy Self-Distillation Safety Alignment
To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Model
May 14, 2026Chengshuai Zhao, Zhen Tan, Dawei Li +2Harmful Fine-Tuning Large Vision Language Models
PreFT: Prefill-only finetuning for efficient inference
May 14, 2026Andrew Lanpouthakoun, Aryaman Arora, Zhengxuan Wu +4Parameter-Efficient Fine-Tuning Prefill
GradShield: Alignment Preserving Finetuning
May 13, 2026Zhanhao Hu, Xiao Huang, Patrick Mendoza +4Large Language Model Safety Large Language Model Alignment
PEML: Parameter-efficient Multi-Task Learning with Optimized Continuous Prompts
May 13, 2026Anjir Ahmed Chowdhury, Syed Zawad, Xiaolong Ma +2Parameter-Efficient Fine-Tuning Multi--Task Learning
MinT: Managed Infrastructure for Training and Serving Millions of LLMs
May 13, 2026Mind Lab, :, Song Cao +60Low-Rank Adaptation Infrastructure
SCAR: Self-Supervised Continuous Action Representation Learning
May 13, 2026Hongjia Liu, Fan Feng, Minghao Fu +3Cross-Embodiment Transfer Inverse Dynamics
Children's English Reading Story Generation via Supervised Fine-Tuning of Compact LLMs with Controllable Difficulty and Safety
May 13, 2026Qian Shen, Fanghua Cao, Min Yao +3Llm-Generated Stories Large Language
LIFT: Last-Mile Fine-Tuning for Table Explicitation
May 13, 2026Divij Khaitan, Ashish TiwariTabular Data Large Language Model Fine-Tuning
Stylized Text-to-Motion Generation via Hypernetwork-Driven Low-Rank Adaptation
May 13, 2026Junhyuk Jeon, Seokhyeon Hong, Junyong NohPhotorealistic Style Transfer Text-To-Motion Generation
PRISM-X: Experiments on Personalised Fine-Tuning with Human and Simulated Users
May 13, 2026Hannah Rose Kirk, Liu Leqi, Fanzhi Zeng +4Personalization User Simulation
LoREnc: Low-Rank Encryption for Securing Foundation Models and LoRA Adapters
May 13, 2026Beomjin Ahn, Jungmin Kwon, Chanyong Jung +1Low-Rank Adaptation Adapters Wireless Foundation Models
Continual Fine-Tuning of Large Language Models via Program Memory
May 13, 2026Hung Le, Svetha VenkateshEfficient Continual Learning Continual Fine-Tuning
From Instance Selection to Fixed-Pool Data Recipe Search for Supervised Fine-Tuning
May 13, 2026Haodong Wu, Jiahao Zhang, Lijie Hu +1Supervised Fine-Tuning Table Reasoning Datasets
Data Difficulty and the Generalization--Extrapolation Tradeoff in LLM Fine-Tuning
May 13, 2026Siyuan Liu, Tinghong Chen, Xinghan Li +2Large Language Model Fine-Tuning Supervised Fine-Tuning
Low-Rank Adapters Initialization via Gradient Surgery for Continual Learning
May 12, 2026Joana Pasquali, Ramiro N. Barros, Arthur S. Bianchessi +7Low-Rank Adaptation Adapters Efficient Continual Learning
Early Data Exposure Improves Robustness to Subsequent Fine-Tuning
May 12, 2026Lawrence Feng, Gaurav R. Ghosal, Jacob Mitchell Springer +2Continual Fine-Tuning Trainability
CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesis
May 12, 2026Yunsung Chung, Alex El Darzi, Carlo El Khoury +3Medical Image Generation Clinical
ORBIT: Preserving Foundational Language Capabilities in GenRetrieval via Origin-Regulated Merging
May 12, 2026Neha Verma, Nikhil Mehta, Shao-Chuan Wang +7Large Language Model Fine-Tuning Catastrophic Forgetting
Output Composability of QLoRA PEFT Modules for Plug-and-Play Attribute-Controlled Text Generation
May 12, 2026Michela Lorandi, Anya BelzParameter-Efficient Fine-Tuning Large Language Model Quantization
Reconstruction of Personally Identifiable Information from Supervised Finetuned Models
May 12, 2026Sae Furukawa, Alina OpreaSupervised Fine-Tuning Language Model Evasion Attacks

May 20, 2026 · cs.CLJ/K move · Enter open · S save

Thinking-while-speaking: A Controlled, Interleaved Reasoning Method for Real-Time Speech Generation

Xuan Du, Qiangyu Yan, Wenshuo Li, Borui Jiang+3

The thinking-while-speaking paradigm aims to make AI communication more human. A key challenge is maintaining fluent speech while performing deep reasoning. Our method, InterRS, tackles this by inserting reasoning steps only during natural speech generation. This requires high-quality data where reasoning and speech are precisely aligned, and the length ratio are under controlled. We introduce a novel pipeline to generate such seamlessly interleaved audio data. To train our model, we combine interleaved SFT with refined data and reinforcement learning with two new rewards: a TA-Balance Reward to manage timing and thinking-answer ratio, and a Linguistic Quality Reward to refine expression. Experiments show our approach achieves 13% better performance on mathmatical and logic benchmarks while generating instant response like a spoken-language instruct model which outputs fast CoT response. Furthermore, our method generates more natural and fluent answers than prior methods.

Speech-Llms Supervised Fine-Tuning Linguistics

Open paper Ask about it PDF