LLM Fine-Tuning

LLM: Large Language Model

Ask about this topic

Overview

LLM fine-tuning studies how additional training can adapt a pretrained model to new tasks, specialized knowledge, languages, or desired behaviors. Common approaches include supervised fine-tuning on curated or synthetic examples, preference optimization and reinforcement learning, and parameter-efficient methods such as LoRA and QLoRA that update only a small part of the model. Researchers also develop data-selection methods and selective layer or neuron updates to reduce training cost, and evaluate results on settings such as reasoning, code generation, multilingual tasks, and domain-specific question answering. A central challenge is gaining reliable task performance without losing general abilities or safety; results depend on the data, model, and evaluation, and retrieval can sometimes be a better alternative for adding knowledge.

Latest papers

CardsList

758 papers76 papers in the last four weeks, up 15% on the four weeks before. 0.4% of all new papers.

  1. Fine-Tuning Small Reasoning Models for Quantum Field Theory

    Apr 21, 2026Nathaniel S. Woodward, Zhiqi Gao, Yurii Kvasiuk +3Physical ReasoningLLM Fine-Tuning

    Department of Physics, University of Wisconsin-Madison · Department of Computer Science, University of Wisconsin-Madison · Perimeter Institute for Theoretical Physics

  2. Universally Empowering Zeroth-Order Optimization via Adaptive Layer-wise Sampling

    Apr 20, 2026Fei Wang, Li Shen, Liang Ding +3Zeroth-Order OptimizationLLM Fine-Tuning

    South China University of Technology · Shenzhen Campus of Sun Yat-sen University · University of Sydney +2

  3. LeGo-Code: Can Modular Curriculum Learning Advance Complex Code Generation? Insights from Text-to-SQL

    Apr 20, 2026Salmane Chafik, Saad Ezzini, Ismail BerradaLLM Fine-TuningCode Generation

    Mohammed VI Polytechnic University Morocco · King Fahd University of Petroleum and Minerals Saudi Arabia

  4. TLoRA: Task-aware Low Rank Adaptation of Large Language Models

    Apr 20, 2026Weicheng Lin, Yi Zhang, Jiawei Dang +1LLM Fine-TuningLow-Rank Adaptation

    College of Computer Science and Software Engineering, Shenzhen University, China

  5. JudgeMeNot: Personalizing Large Language Models to Emulate Judicial Reasoning in Hebrew

    Apr 20, 2026Itay Razumenko, Arnon Sturm, Nir GrinbergLegal NLPLLM Personalization

    Computer and Information Science Ben-Gurion University of the Negev Beer-Sheva, Israel

  6. CodePivot: Bootstrapping Multilingual Transpilation in LLMs via Reinforcement Learning without Parallel Corpora

    Apr 20, 2026Shangyu Li, Juyong Jiang, Meibo Ren +7Code TranslationRL for Language Models

    The Hong Kong University of Science and Technology · The Hong Kong University of Science and Technology (Guangzhou) · Monash University +1

  7. SafeAnchor: Preventing Cumulative Safety Erosion in Continual Domain Adaptation of Large Language Models

    Apr 20, 2026Dongxin Guo, Jikun Wu, Siu Ming YiuContinual Learning for LLMsLLM Fine-Tuning

    The University of Hong Kong, Hong Kong, China · Brain Investing Limited, Hong Kong, China

  8. Evaluating Hallucinations in Domain-Adapted Large Language Models

    Apr 19, 2026Sanchita Porwal, Sai Prasath S, Xingjian Bi +1LLM EvaluationDomain Adaptation

    College of Computing Georgia Institute of Technology Atlanta, GA 30318, USA

  9. Rethinking Data Curation in LLM Training: Online Reweighting Offers Better Generalization than Offline Methods

    Apr 19, 2026Wanru Zhao, Yihong Chen, Yuzhi Tang +6Language Model PretrainingLLM Fine-Tuning

    University of Cambridge · OATML, University of Oxford · University of Toronto +2

  10. REALM: Reliable Expertise-Aware Language Model Fine-Tuning from Noisy Annotations

    Apr 19, 2026Sajjad Ghiasvand, Mark Beliaev, Mahnoosh Alizadeh +1Supervised Fine-TuningLLM Fine-Tuning

    Department of Electrical and Computer Engineering UC Santa Barbara Santa Barbara, CA 93106, USA

  11. Continual Safety Alignment via Gradient-Based Sample Selection

    Apr 19, 2026Thong Bach, Dung Nguyen, Thao Minh Le +1Continual Learning for LLMsLLM Fine-Tuning

    Applied Artificial Intelligence Initiative (A2I2), Deakin University · Pennsylvania State University

  12. Beyond the Basics: Leveraging Large Language Model for Fine-Grained Medical Entity Recognition

    Apr 19, 2026Nwe Ni Win, Jim Basilakis, Steven Thomas +6Named Entity RecognitionHealthcare

    Western Sydney University, Sydney, Australia · Western Sydney University, Australia · South Western Emergency Research Institute, Sydney, Australia +7

  13. Guardrails in Logit Space: Safety Token Regularization for LLM Alignment

    Apr 19, 2026Thong Bach, Truyen TranLLM Fine-TuningLLM Safety Alignment

    Applied Artificial Intelligence Initiative (A2I2), Deakin University

  14. How Tokenization Limits Phonological Knowledge Representation in Language Models and How to Improve Them

    Apr 18, 2026Disen Liao, Freda ShiLLM Fine-TuningLanguage Modeling

    University of Waterloo · Vector Institute

  15. Efficient Task Adaptation in Large Language Models via Selective Parameter Optimization

    Apr 18, 2026Weijie Wan, Jiangjiang ZhaoContinual Learning for LLMsLLM Fine-Tuning

    Shortest Path Technology · China Mobile Communications Group Co.,Ltd

  16. Learning to Trade Like an Expert: Cognitive Fine-Tuning for Stable Financial Reasoning in Language Models

    Apr 18, 2026Yuchen Pan, Soung Chang LiewLLM EvaluationFinancial Reasoning in Language Models

    Department of Information Engineering, The Chinese University of Hong Kong

  17. Benign Fine-Tuning Breaks Safety Alignment in Audio LLMs

    Apr 17, 2026Jaechul Roh, Virat Shejwalkar, Amir HoumansadrLanguage Model Safety EvaluationLLM Fine-Tuning

    University of Massachusetts Amherst

  18. LLM attribution analysis across different fine-tuning strategies and model scales for automated code compliance

    Apr 16, 2026Jack Wei Lun Shi, Minghao Dang, Wawan Solihin +1Feature AttributionLLM Interpretability

    Department of Civil and Environmental Engineering, National University of Singapore, 117576, Singapore · School of Transportation Science and Engineering, Harbin Institute of Technology, Harbin 150090, China · Research and Innovation, NovaCITYNETS Pte.Ltd., 348615, Singapore

  19. Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switch

    Apr 16, 2026Eleanor M. Lin, David JurgensMultilingual Language ModelsCode-Switching

    University of Michigan

  20. Exploring LLM-based Verilog Code Generation with Data-Efficient Fine-Tuning and Testbench Automation

    Apr 16, 2026Mu-Chi Chen, Po-Hsuan Huang, Yu-Hung Kao +6LLM Fine-TuningCode Generation

    Academia Sinica, Taipei, Taiwan · National Taiwan University, Taipei, Taiwan · National Cheng Kung University, Tainan, Taiwan

  21. Fact4ac at the Financial Misinformation Detection Challenge Task: Reference-Free Financial Misinformation Detection via Fine-Tuning and Few-Shot Prompting of Large Language Models

    Apr 16, 2026Cuong Hoang, Le-Minh NguyenLLM Fine-TuningAutomated Fact-Checking

    Japan Advanced Institute of Science and Technology

  22. TREX: Automating LLM Fine-tuning via Agent-Driven Tree-based Exploration

    Apr 15, 2026Zerun Ma, Guoqiang Wang, Xinchen Xie +7LLM Fine-TuningLLM Agent Training

    Shanghai AI Laboratory · Fudan University

  23. TLoRA+: A Low-Rank Parameter-Efficient Fine-Tuning Method for Large Language Models

    Apr 15, 2026Yarui Cao, Kai LiuLLM Fine-TuningParameter-Efficient Fine-Tuning

    Department of Computer Science, Clemson University, Clemson, SC 29634, USA

  24. Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuning

    Apr 14, 2026Shanyong Wang, Shuhang Lin, Yining Zhao +2LLM Fine-TuningPersonalized Language Model Alignment

    Rutgers University—New Brunswick · University of Illinois at Urbana-Champaign

  25. Analyzing the Effect of Noise in LLM Fine-tuning

    Apr 14, 2026Lingfang Li, Procheta SenLLM Fine-TuningLanguage Model Robustness

  26. CLSGen: A Dual-Head Fine-Tuning Framework for Joint Probabilistic Classification and Verbalized Explanation

    Apr 13, 2026WonJin Yoon, Kangyu Zhu, Ian Bulovic +5LLM Fine-TuningConfidence Estimation in Language Models

    Boston Children’s Hospital · Harvard Medical School · University of Colorado Anschutz Medical Campus +2

  27. Enhancing Multimodal Large Language Models for Ancient Chinese Character Evolution Analysis via Glyph-Driven Fine-Tuning

    Apr 13, 2026Rui Song, Lida Shi, Ruihua Qi +2Multimodal Large Language ModelsLLM Fine-Tuning

    College of Computer Science and Technology, Jilin University, China · Key Laboratory of Ancient Chinese Script, Culture Relics and Artificial Intelligence, Jilin University, China · School of Artificial Intelligence, Jilin University, China +1

  28. Advancing Polish Language Modeling through Tokenizer Optimization in the Bielik v3 7B and 11B Series

    Apr 12, 2026Krzysztof Ociepa, Łukasz Flis, Remigiusz Kinas +2Language ModelingSubword Tokenization

    SpeakLeash · Azurro · ACK Cyfronet AGH +2

  29. Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions

    Apr 12, 2026Wenhao Zhang, Lin Mu, Li Ni +2Nonlinear LoRALLM Fine-Tuning

    Anhui University · University of Science and Technology of China

  30. Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models

    Apr 11, 2026Chao Xue, Yao Wang, Mengqiao Liu +11LLM Fine-TuningSupervised Fine-Tuning

    University of New South Wales, Australia · Tencent Hunyuan, China · Tencent Yuanbao, China +2