LLM Fine-Tuning

LLM: Large Language Model

Overview

LLM fine-tuning studies how additional training can adapt a pretrained model to new tasks, specialized knowledge, languages, or desired behaviors. Common approaches include supervised fine-tuning on curated or synthetic examples, preference optimization and reinforcement learning, and parameter-efficient methods such as LoRA and QLoRA that update only a small part of the model. Researchers also develop data-selection methods and selective layer or neuron updates to reduce training cost, and evaluate results on settings such as reasoning, code generation, multilingual tasks, and domain-specific question answering. A central challenge is gaining reliable task performance without losing general abilities or safety; results depend on the data, model, and evaluation, and retrieval can sometimes be a better alternative for adding knowledge.

Latest papers

CardsList

794 papers35 papers in the last four weeks, down 58% on the four weeks before. 0.3% of all new papers.

  1. MoE--LoRA Methods for Multilingual Adaptation: A Systematic Empirical Study

    Nov 17, 2026Nikit Srivastava, Joel Dag, René Speck +1Low-Rank AdaptationLLM Fine-Tuning

  2. RSI-Prime: Training Models to Train Models

    Nov 17, 2026Dewu Zheng, Yang Ye, Hongyu Zhang +2Language Model Self-ImprovementLLM Post-Training

  3. VRLLM: Turning LLMs into Powerful Tabular Classifiers

    Nov 17, 2026Yingtong Dou, Shubham Jain, Junpeng Wang +5Tabular ClassificationTabular Prediction

  4. MarineSparkLM-4B: A Lightweight Language Model for Marine and Offshore Engineering Built by Parameter-Efficient Adaptation

    Nov 14, 2026Cheng Siong ChinLLM Fine-TuningDomain Adaptation for LLMs

  5. Direction or Magnitude? Learning Scalars over Task-Calibrated Directions

    Nov 13, 2026Ziqing Wen, Xiaohui Song, Jiahuan Wang +5LLM Fine-TuningParameter-Efficient Fine-Tuning

  6. Wanda-Guided Sparse Perturbations for Efficient Zeroth-Order Optimization

    Nov 12, 2026Ziqing Wen, Xiaohui Song, Jiahuan Wang +4Zeroth-Order OptimizationLLM Fine-Tuning

  7. Is Persona Generalization Predictable?

    Nov 9, 2026Olina Mukherjee, Arnav Goel, Aditi Raghunathan +1LLM Fine-TuningSafety-Preserving Fine-Tuning of Language Models

  8. Slim Foundation Models for Latency-Critical Recommendation Serving

    Nov 7, 2026Danyal Aftab, Anas Zafar, Assadig Abakr +1CTR PredictionLarge Language Model-Based Recommendation

  9. Enhancing Mathematical Reasoning in Turkish Large Language Models with Search-Based Inference and Model Merging

    Nov 7, 2026Ahmed Zeer, Osama Shbib, Muzaffer Kaan Yuce +2LLM ReasoningLLM Fine-Tuning

  10. Adapting Large Language Models via Multi-Task Learning for Mental Health Problem, Emotion, and Sentiment Detection

    Nov 7, 2026Amir Rafiq Bhat, Rahim Dehkharghani, Zeki ErdemLLM Fine-TuningMulti-Task Learning

  11. Zeroth-Order Riemannian Optimization on Fixed-Rank Manifolds for LLM Fine-Tuning

    Nov 7, 2026Xinjue Wang, Xiuheng Wang, Yejun Zhang +2Zeroth-Order OptimizationRiemannian Optimization

  12. Efficient LLM Adaptation with Forward-Only Passes

    Nov 7, 2026Baichuan Huang, Ananth Balashankar, Amir AminifarInference-Time Adaptation of Language ModelsLLM Fine-Tuning

  13. FedLoVA: Value-Only Aggregation for Federated LoRA Fine-Tuning of Large Language Models

    Nov 6, 2026Ensieh Khazaei, Baturalp Buyukates, Dimitrios HatzinakosLLM Fine-TuningFederated Fine-Tuning

  14. Guardrail Erosion in Domain Fine-Tuned Large Language Models: A Paired Audit of Knowledge-Centric Abstention in Biomedical LLMs

    Nov 5, 2026Stephen Peng, Vineet Jagadeesan Nair, Noah Broestl +3LLM Fine-TuningMedical LLMs

  15. SAFTAC: Simulation-Augmented Fine-Tuning of Open-Source LLMs for Analog Circuit Design

    Nov 5, 2026Junsheng Huang, Yifan Sun, Zhuoer Zhang +7LLM Fine-TuningElectronic Design Automation

  16. Rethinking Data Selection: The Importance of Coverage over Difficulty in LLM Fine-Tuning

    Nov 5, 2026Lalchand Pandia, Kanishka Misra, Allyson EttingerData SelectionData Selection for Language Model Fine-Tuning

  17. Adapting Qwen3 to Tajik from 0.6B to 8B: Lower Text Loss Did Not Mean Better Understanding

    Nov 4, 2026Tohir Saidzoda, Madina Abdusalomzoda, Nasimjon Rajabov +7LLM Fine-TuningLanguage Model Pretraining

  18. Shared Context Candidate Scoring with Jointly Adapted Readout Networks

    Nov 3, 2026Jingyang Du, Yiben Fu, Yang ShenMultiple-Choice Question AnsweringLLM Fine-Tuning

  19. Follow the Features: SAE Feature-Guided Data-Efficient Instruction-Tuning of Large Language Models

    Nov 2, 2026Ryan Swift, Konstantinos PsounisData Selection for Language Model Fine-TuningInstruction-Tuning Data Selection

  20. Pretraining Data Scale Reverses the Muon-AdamW Fine-Tuning Gap

    Nov 2, 2026Catherine Li, Jingchu Gai, Andrej Risteski +2Muon OptimizerLLM Fine-Tuning

  21. ENGINE: Endogenous Variational MultiScale Optimization for Zeroth-Order LLM Fine-Tuning

    Nov 2, 2026Zhuoli Ouyang, Changxi Chi, Siyuan Li +1Zeroth-Order OptimizationLLM Fine-Tuning

  22. ProLand: A New Infeasible Manifold Optimization Method for LoRA Fine-Tuning

    Oct 30, 2026Chenyu Zhou, Yuxuan Zeng, Qi Deng +2LLM Fine-TuningLow-Rank Adaptation

  23. Merge and Branch: Efficient Tree-Structured Supervised Fine-Tuning of LLMs for Recommendation

    Oct 27, 2026Yunqin Zhu, Liyang Shu, Yusi Zhang +4Large Language Model-Based RecommendationLLM Fine-Tuning

  24. Hierarchical Low-Rank Reparameterization for Parameter-Efficient Fine-Tuning

    Oct 27, 2026Rong Huang, Yi Xiong, Yuan-Yuan Cheng +1LLM Fine-TuningParameter-Efficient Fine-Tuning

  25. Satellite Intelligence: Distributed Training, Collaborative Inference,and LLM Adaptation in LEO Constellation

    Oct 26, 2026Zheng Lin, Zhanwei Wang, Yuxin Zhang +9LEO Satellite NetworksLLM Inference

  26. Large Language Models: A Plain-Language Overview for Engineers

    Oct 25, 2026Bahaeddin TürkoğluLLM TrainingLLM Prompting