Large Language Model Adaptation

Follow this topic Ask about this topic

Recent momentum

-62%

9 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Large Language Model Adaptation.

Period ending 2026-09-07

3 new papers

A weekly snapshot of new work published in Large Language Model Adaptation.

153 papers

Latest in Large Language Model Adaptation

Open your feed →

Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs
Sep 16, 2026Mohan Shi, Zilai Wang, Natarajan Balaji Shankar +3Speech Encoder Large Language Model Adaptation
Enhancing Accessibility of Medical Texts through Large Language Model-Driven Plain Language Adaptation
Sep 15, 2026Ting-Wei Chang, Hen-Hsen Huang, Hsin-Hsi ChenLarge Language Model Adaptation
Sequential Adapter Stacking for Cross-Lingual Low-Resource ASR
Sep 14, 2026Thai Thi Thanh Thao Dang, Mengjie Qian, Kate KnillLarge Language Model Adaptation
Merging the Knowledge of LLMs for Automatic Speech Recognition
Sep 14, 2026Hayato Futami, Tatsuya KawaharaLarge Language Model Adaptation
SALUTE: Benchmarking and Adapting LLMs for the Defense Domain
Sep 14, 2026Hyeongcheol Park, Sumin In, Suyeon Myeong +5Large Language Model Adaptation Large Language Models(Llms
Online Language Adaptive Sampling for Better Distributed Cross-lingual Gains
Sep 14, 2026Quang Phuoc Nguyen, Félix Gaschi, David Anugraha +2Cross-Lingual Transfer Large Language Model Adaptation
Beyond Confidence: Stability-Aware Test-Time Adaptation for LLM Reasoning
Sep 12, 2026Bincheng Gu, Min Gao, Zongwei Wang +3Test-Time Adaptation LLM Reasoning Methods
R4Tun: LLM-guided adaptive segmental tunnel lining segmentation in point clouds
Sep 11, 2026Xinghui Tao, Zehao Ye, Guangming Wang +2Large Language Model Adaptation Point Clouds
Perspectives on Cross-Lingual Consistency in LLMs for Medical Questions
Sep 7, 2026Minh Duc Bui, Mario Sanz-Guerrero, Abteen Ebrahimi +4Cross-Lingual Consistency Medical Question Answering
When Financial Fine-tuning Fails: A Three-Level Detectability Analysis of Numerical Hallucination in Domain-Adapted Language Models
Sep 7, 2026Xiaodong Li, Peiwei LiuLarge Language Model Hallucination Visual Hallucinations
Representational alignment yields generalizable safety in language models
Sep 3, 2026Lingyu Li, Yan Teng, Yingchun Wang +1Large Language Model Safety Large Language Model Alignment
Frozen Cores Need Task Signal: Fisher-Whitened Cross-Covariance for Low-Resource LLM Adaptation
Sep 1, 2026Wentao Ye, Zhanming Shen, Zhiqing Xiao +3Large Language Model Adaptation Covariance Estimation
Low-Resource Preference Adaptation of LLMs via Activation-Based Label Propagation
Aug 31, 2026Alessio Galatolo, Meriem BeloucifPreference Pairs Large Language Model Adaptation
Reading the News: Adapting Large Language Models to Swedish Journalism Through Continued Pre-Training
Aug 31, 2026Lukas Borggren, Jenny Kunz, Marco KuhlmannLarge Language Model Adaptation Headlines
CPR for LLMs: Critical-Point Routing against Catastrophic Forgetting in Domain Adaptation
Aug 31, 2026Kwangmin Ki, Yunhun Nam, Jongheon Jeong +1Large Language Model Adaptation Supervised Fine-Tuning
TELLME: Test-Enhanced Learning for Language Model Enrichment
Aug 12, 2026Minjun Kim, Inho Won, Hyeonseok Lim +6Large Language Model Adaptation Domain Adaptation
MERA: Model Evolution and Routing with Skill Adaptation for Agentic Systems at Scale
Aug 11, 2026Yuhang Yao, Zeyu Wang, Wanyi Chen +8Large Language Model Adaptation Low-Rank Adapters
Rethinking Factor Sharing in Federated LoRA: A Rank-Aware Adaptive Approach
Aug 10, 2026Xinyi Xu, Bingnan Xiao, Shuang Qin +2Standard Low-Rank Adaptation Federated Fine-Tuning
NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs
Aug 8, 2026Jiayue Jin, Jingwei Zhang, Chen Wang +2Large Language Model Adaptation Large Multimodal Models
LoRAScan: Detecting Backdoor Prompts in Low-Rank Adapters for Large Language Models via Down-Projection Activation Spikes
Aug 7, 2026Doniyorkhon Obidov, Honggang Yu, Xiaolong Guo +1Backdoor Attacks Low-Rank Adapters
Task-Conditional Flow Matching for Balanced Multilingual Text Embedding Adaptation
Aug 6, 2026Tirth Bhatt, Naren Kumar S, Mayank SinghMultilingual Language Models Large Language Model Adaptation
A Model Merging Approach for Continual MLLM Unlearning
Aug 5, 2026Yuhang Wang, Linlin Zhang, Haoxuan Ji +3Large Language Model Unlearning Large Multimodal Models
TACT: Taxonomy-Aligned Post-Training for Pedagogically Adaptive English Tutoring
Aug 4, 2026Dongjie Yang, Siyan Lin, Leixian Shen +3Large Language Model Adaptation Student
Activation-Guided Neuron Intervention to Induce Alzheimer's-Related Computational Language Phenotypes in a Large Language Model
Aug 4, 2026Rui He, Ercong Nie, Hong Jiang +3Alzheimer Large Language Model Adaptation
Two-Stage Bengali Sentiment Classification: Domain Adaptation Through Continual Learning and Parameter-Efficient Fine-Tuning
Aug 2, 2026MD Shaikh Rahman, Syed Maudud E Rabbi, Muhammad Mahbubur RashidBangla Large Language Model Adaptation
Learning to Adapt Cross-Domain Preferences via Meta-LoRA for LLM Personalization
Aug 1, 2026Xuefei Wang, Jun Han, Zixuan Wang +4Large Language Model Adaptation Priors
Bridging the English-Arabic Medical Knowledge Gap: Targeted Low-Rank Adaptation via Causal Layer Selection
Jul 31, 2026Chaimae Abouzahir, Musa Khan, Hala Ali-Hassan +7Large Language Model Adaptation Arabic Natural Language Processing
PARALLEL: A Prefrontal-Aligned Reinforcement inspired Approach for Language-Model Learning under Explicit Limits
Jul 31, 2026Namkyung Yoon, Sanghong Kim, Hwangnam KimLarge Language Model Adaptation Protein Language Model
Compliance2LoRA: Personalizable On-Demand Safety Alignment on Arbitrary Policy Subsets via Hypernetwork-Generated LoRA Adapters
Jul 30, 2026Pankayaraj Pathmanathan, Furong HuangSafety Alignment Large Language Model Adaptation
MemSFT: Mitigating Alignment Tax with an External Parametric Memory
Jul 28, 2026Jiarui Wang, Xiang Shi, Jiaqi Cao +8Large Language Model Memory Large Language Model Adaptation
Frustratingly Simple Black-Box Adaptation of Language Models via Logit Bias
Jul 24, 2026Ofek I. Cohen, Lior Shani, Aviv Rosenberg +3Large Language Model Adaptation Logit Lens
Biomedical Machine Translation for Low-Resource Arabic-Script Languages via Cross-Lingual Transfer and LoRA Adapter Merging
Jul 24, 2026Abdullah Alabdullah, Arash Eslamighayour, Sarp Harbalioglu +1Cross-Lingual Transfer Machine Translation
Data Quality over Capacity: Internalizing Documents into LoRA Adapters for Closed-Book QA
Jul 23, 2026Joan Figuerola HurtadoLarge Language Model Adaptation Question-Answer Pairs
Trustworthiness Costs of Domain Adaptation in Small Language Models:A Cross-Architecture Empirical Study
Jul 23, 2026Ramesh B. ParamkushamLarge Language Model Adaptation Large Language Model Reliability
The Blessing of Dimensionality: How Near-Orthogonality in High-Dimensional Spaces Explains Temporal Portability
Jul 22, 2026Abigail Woodring, Adrian Chan, Rana Muhammad Shahroz Khan +3Large Language Model Adaptation Model Pretraining
Adaptive Capitulation: A Structural Failure Mode of LLM Responses in Vulnerability Contexts
Jul 21, 2026Eunna LeeVulnerable Code Large Language Model Adaptation
Selective State-Space Adaptation and Retrieval for Language Model Reasoning
Jul 21, 2026Atahan Dokme, Larry HeckLarge Language Model Adaptation Mamba-Modulated Low-Rank Adaptation
Inference-Time Steering for Cross-Lingual Factual Consistency in LLMs
Jul 21, 2026Alexander ManevCross-Lingual Consistency Large Language Model Alignment
What Transfers Under Source Shift? Definitions, Examples, and Fine-Tuning for Climate Disclosure Classification
Jul 20, 2026Guosheng Li, Fenghui Ren, Bin Liu +5Financial Disclosures Large Language Model Adaptation
Investigating first-language bias in LLM-based automated essay scoring: A cross-prompt evaluation of an open-weight AI-model on TOEFL essays
Jul 16, 2026John Maurice GayedAutomated Essay Scoring Large Language Model Bias
Automated Compliance Mapping in Cloud Security with Domain-Adapted Sentence Transformers
Jul 7, 2026John Bianchi, Luca Petrillo, Fabio Martinelli +1Sentence Transformer Models Large Language Model Safety
Integrating knowledge graphs and multilingual scholarly corpora for domain-adaptive LLMs in SSH
Jul 7, 2026Adam Faci, Alessio Miaschi, Anne Combe +4Large Language Model Adaptation Large Language Models(Llms
LLM-Driven Neural Network Generation with Same-Family Architecture Guidance: Disentangling Transfer and Adaptation
Jul 6, 2026Kabir Dev Paul Baghel, Radu Timofte, Dmitry IgnatovLarge Language Model Adaptation Generative Adversarial Network
Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimation
Jul 2, 2026Jijie Zhang, Zhe Ren, Quan Zhang +1Large Language Model Uncertainty Adaptive-Rank Low-Rank Adaptation Baselines
Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs
Jun 30, 2026Seyed Alireza Molavi, Zhan Su, Yan Hu +3Low-Rank Adapters Standard Low-Rank Adaptation
TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs
Jun 28, 2026Shucan Ji, Yining Huang, Hongliang GuoMedical Question Answering Large Language Model Adaptation
Fine-Tuning General-Purpose Large Language Models for Agricultural Applications:A Reproducible Framework and Evaluation Protocol Based on Qwen3-8B
Jun 27, 2026Zhaoyang Li, Ruijie Zhang, Jiaqi Liu +1Precision Agriculture Large Language Model Adaptation
LoRA-Tuned Large Language Models for Dementia Detection via Multi-View Speech-Derived Features
Jun 26, 2026Jonghyeon Park, Olivier Jiyoun Jung, Myungwoo OhAlzheimer Speaker Identity
Cross-Platform Chinese Offensive Comment Detection via Dual-Threshold Hard Example Mining
Jun 26, 2026Ruixing Ren, Junhui Zhao, Fangfang WangSocial Media Texts Unsupervised Domain Adaptation
Closing the Quality Gap in Low-Resource Text-to-Speech: LoRA Fine-Tuning of VoxCPM2 for Khmer and Korean
Jun 25, 2026Phannet Pov, Sovandara Chhoun, Hyun Woo Park +2Text-To-Speech Large Language Model Adaptation
Curvature-Guided Mixing for MLLM Adaptation
Jun 23, 2026Jinglong Yang, Jiaxuan He, Wenjian Huang +2Large Language Model Adaptation Large Multimodal Models
IndicGuard: A Multilingual Safety Guard Model and Dataset for Indic Languages
Jun 22, 2026Parth Bramhecha, Smit Deshmukh, Sairaj Bodhale +2Multilingual Safety Large Language Model Safety
Enhancing LLMs for Graph Tasks via Graph-aware LoRA Generation
Jun 21, 2026Junshu Sun, Wanxing Chang, Qingming Huang +1Graph Neural Networks Adaptive-Rank Low-Rank Adaptation Baselines
Bayesian Adaptation Gym: A Benchmark for the Bayesian Low-Rank Adaptation of Multi-Modal Language Models
Jun 20, 2026Colin Samplawski, Ramneet Kaur, Manoj Acharya +2Large Language Model Adaptation Large Language Model Benchmarks
Predicting Mergeability of Parameter-Efficient Fine-Tuning Updates
Jun 17, 2026Lin Tang, Wei Zhang, Jing Li +3Large Language Model Adaptation Parameter-Efficient Fine-Tuning Methods
Trade-offs in Medical LLM Adaptation: An Empirical Study in French QA
Jun 17, 2026Ikram Belmadani, Oumaima El Khettari, Carlos Ramisch +3Large Language Model Adaptation Unsupervised Domain Adaptation
Revisiting LLM Adaptation for 3D CT Report Generation: A Study of Scaling and Diagnostic Priors
Jun 15, 2026Vanshali Sharma, Andrea M. Bejar, Halil Ertugrul Aktas +4Medical Vision-Language Models Large Language Model Adaptation
Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling
Jun 9, 2026Guodong Lin, Ziqi Chen, Yuxiang Fu +2Multilingual Automatic Speech Recognition Automatic Speech Recognition
PermDoRA -- Understanding Adapter Interference in Language Models: Limits of Parameter-Space Geometry
Jun 9, 2026Gowtham Sivaramakrishnan, Sarvesha Kumar Kombaiah Seetha, Kishan Gupta Balaji +1Large Language Model Adaptation Adapters
Data Synthesis and Parameter-Efficient Fine-Tuning for Low-Resource NMT: A Case Study on Q'eqchi' Mayan
Jun 8, 2026Alexander Chulzhanov, Soeren Eberhardt, Arjun MukherjeeMachine Translation Quality Low-Resource Languages

Sep 16, 2026 · eess.ASJ/K move · Enter open · S save

Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs

Mohan Shi, Zilai Wang, Natarajan Balaji Shankar, Kaiyuan Zhang+2

Speech Large Language Models (Speech-LLMs), typically built from a pre-trained speech encoder, a modality projector, and an LLM fine-tuned with Low-Rank Adapters (LoRA), have shown strong Automatic Speech Recognition (ASR) performance on general-domain speech. However, adapting them to domain-shifted speech, such as child or dialectal speech, remains challenging under limited target-domain data. Given the dominant role of the LLM in Speech-LLMs, with cross-entropy loss applied only at the LLM output, the speech encoder may receive insufficient adaptation to new acoustic conditions. In this paper, we propose Encoder Awakening via Adapters (EAVA), a simple yet effective domain-adaptive fine-tuning method for Speech-LLM-based ASR. First, lightweight adapters are inserted into each encoder layer and trained exclusively, enabling target-domain acoustic knowledge to be incorporated into the encoder while preserving its pre-trained knowledge. Second, the full model is jointly fine-tuned on the target domain with LoRA applied to the LLM. Experiments on three domain-shifted ASR datasets, covering child and dialectal speech, show that EAVA consistently outperforms vanilla fine-tuning and other baselines, achieving new state-of-the-art performance.

Speech Encoder Large Language Model Adaptation

Open paper Ask about it PDF