LLM Fine-Tuning

LLM: Large Language Model

Overview

LLM fine-tuning studies how additional training can adapt a pretrained model to new tasks, specialized knowledge, languages, or desired behaviors. Common approaches include supervised fine-tuning on curated or synthetic examples, preference optimization and reinforcement learning, and parameter-efficient methods such as LoRA and QLoRA that update only a small part of the model. Researchers also develop data-selection methods and selective layer or neuron updates to reduce training cost, and evaluate results on settings such as reasoning, code generation, multilingual tasks, and domain-specific question answering. A central challenge is gaining reliable task performance without losing general abilities or safety; results depend on the data, model, and evaluation, and retrieval can sometimes be a better alternative for adding knowledge.

Latest papers

CardsList

794 papers35 papers in the last four weeks, down 58% on the four weeks before. 0.3% of all new papers.

  1. Batch Augmentation with Unimodal Fine-tuning for Multimodal Fusion of Large Language Models

    May 10, 2025H M Dipu Kabir, Subrota Kumar Mondal, Mohammad Ali MoniMultimodal FusionMultimodal Classification

  2. Evaluating the Scalability and Adversarial Generalization of GRPO-Trained NLI Models

    Apr 25, 2025Pablo Miralles-González, Javier Huertas-Tato, Alejandro Martín +1LLM Fine-TuningRL for Language Model Reasoning

  3. Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks

    Apr 24, 2025Yang Liu, Kejia Zhang, Bingjie Yan +11Privacy-Preserving Language ModelsLLM Fine-Tuning

  4. Boosting Large Language Models with Mask Fine-Tuning

    Mar 27, 2025Mingyuan Zhang, Yue Bai, Huan Wang +4LLM Fine-Tuning

  5. Distributionally Robust Reinforcement Learning with Human Feedback

    Mar 1, 2025Debmalya Mandal, Paulius Sasnauskas, Goran RadanovicDirect Preference OptimizationLLM Fine-Tuning

  6. LIFT: A Novel Framework for Enhancing Long-Context Understanding of LLMs via Long Input Fine-Tuning

    Feb 20, 2025Yansheng Mao, Yufei Xu, Jiaqi Li +5Long-Context QALLM Fine-Tuning

  7. Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training

    Feb 5, 2025Reza Shirkavand, Peiran Yu, Qi He +1LLM Fine-TuningZeroth-Order Optimization

  8. Don't Pay Attention, PLANT It: Pretraining Attention via Learning-to-Rank

    Oct 30, 2024Debjyoti Saha Roy, Byron C. Wallace, Javed A. AslamMulti-Label ClassificationAttention Mechanisms

  9. Tuning Language Models by Mixture-of-Depths Ensemble

    Oct 16, 2024Haoyan Luo, Lucia SpeciaLLM Fine-TuningLanguage Model Ensembles

  10. Mitigating Memorization In Language Models

    Oct 3, 2024Mansi Sakarvadia, Aswathy Ajith, Arham Khan +6Memorization in Language ModelsLLM Fine-Tuning

  11. Vikhr: The Family of Open-Source Instruction-Tuned Large Language Models for Russian

    May 22, 2024Aleksandr Nikolich, Konstantin Korolev, Sergei Bratchikov +2Language Model PretrainingMultilingual Language Models

  12. Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models

    Jan 1, 2024Terry Yue Zhuo, Armel Zebaze, Nitchakarn Suppattarachai +4LLM Fine-TuningInstruction Tuning

  13. Amortizing intractable inference in large language models

    Oct 6, 2023Edward J. Hu, Moksh Jain, Eric Elmoznino +4Amortized InferenceLLM Fine-Tuning