LLM Fine-Tuning

LLM: Large Language Model

Ask about this topic

Momentum

42 papers in the last four weeks, up 83% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 509

All topics
CardsList

  1. A Unifying Lens on Supervised Fine-Tuning Through Target Distribution Design

    Jun 9, 2026Tong Xie, Yuanhao Ban, Yunqi Hong +3Supervised Fine-TuningFine-Tuning

    University of California, Los Angeles (UCLA) · Arena

  2. Instruction Finetuning DeepSeek-R1-8B Model Using LoRA and NEFTune

    Jun 9, 2026Wu Yuerong, Mingni LuoNamed Entity RecognitionFine-Tuning

    University of Hong Kong, Hong Kong, China · Northeastern University, Seattle, United States

  3. The Order Matters: Sequential Fine-Tuning of LLaMA for Coherent Automated Essay Scoring

    Jun 9, 2026Ali Keramati, Mark WarschauerFine-TuningLLM Fine-Tuning

    University of California, Irvine

  4. OpenRTLSet: A Fully Open-Source Dataset for Large Language Model-based Verilog Module Design

    Jun 9, 2026Jinghua Wang, Lily Jiaxin Wan, Sanjana Pingali +6LLM Fine-TuningElectronic Design Automation

    University of Illinois Urbana-Champaign

  5. Streaming Interventions: Can Video Large Language Models Correct Mistakes as They Occur?

    Jun 8, 2026Apratim Bhattacharyya, Shweta Mahajan, Sanjay Haresh +5LLM Fine-TuningSynthetic Data Generation

    Qualcomm AI Research · York University · Vector Institute for AI

  6. Emergence of Context Characteristics Sensitivity in Large Language Models

    Jun 8, 2026Nadya Yuki Wangsajaya, Haeun Yu, Isabelle AugensteinLLM Fine-TuningInstruction Tuning

    Nanyang Technological University · University of Copenhagen

  7. PriFT: Prior-Support Guided Supervised Fine-Tuning

    Jun 8, 2026Ke Wang, Shuangqi Li, Mathieu Salzmann +1Supervised Fine-TuningFine-Tuning

    EPFL, Lausanne, Switzerland

  8. Multilingual Fact-Checking at Scale: Fine-Tuned Compact Models vs LLMs

    Jun 7, 2026Pratuat Amatya, Vinay SettyMultilingual Language ModelsLLM Evaluation

    Factiverse AS and University of Stavanger Stavanger, Norway

  9. AlignFed: Alignment-Aware Asynchronous Federated Fine-Tuning for Large Language Models in Heterogeneous Edge Environments

    Jun 6, 2026Yan Wang, Ziyi Gao, Rui WangLLM Fine-TuningAsynchronous Federated Learning

    Department of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China

  10. How Small Can You Go? LoRA Fine-Tuning 270M-8B Models for Merchant Information Extraction in Financial Transactions

    Jun 6, 2026Donghao Huang, Tomas Drietomsky, Benjamin Barrett +1Financial ServicesMemory-Efficient Fine-Tuning

    Research and Development, Mastercard, Arlington, VA, USA · School of Computing and Information Systems, Singapore Management University, Singapore · Economic Intelligence, Mastercard, Prague, Czech Republic

  11. Minibatch Selection for Language Models via Partition Matroid Constrained Gradient Matching

    Jun 6, 2026Prayas Agrawal, Prateek Chanda, Ishita Khatri +3Submodular OptimizationLLM Fine-Tuning

    Department of Computer Science and Engineering, Indian Institute of Technology Bombay · Microsoft Research India · Centre for Machine Intelligence and Data Science, Indian Institute of Technology Bombay +1

  12. HARP: Efficient Data Selection for Finetuning Large Language Models

    Jun 5, 2026Ning Wang, Zhengxin Zhang, Maosen Tang +3LLM Fine-TuningActive Learning

    Cornell University · The Hong Kong University of Science and Technology

  13. SpectCount: Spectrotemporal Counting via Synthetic Signals Improves Large Audio Language Models

    Jun 5, 2026Seonuk Kim, Yonghyeon Jun, Ju Yeon Kang +3LLM Fine-TuningAudio Understanding

    Department of Electrical and Computer Engineering and INMC, Seoul National University, Seoul, South Korea

  14. Korean Culture into LLM Alignment: Toward Cultural Coherence

    Jun 5, 2026MinJae Jung, Minwoo KimLLM Fine-TuningLLM Safety Alignment

    DATUMO Inc.

  15. The Piggyback Hypothesis of Generalization: Explaining and Mitigating Emergent Misalignment

    Jun 4, 2026Jiachen Zhao, Zhengxuan Wu, Aryaman Arora +3LLM AlignmentLLM Fine-Tuning

    Northeastern University · University of California, Berkeley

  16. Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution

    Jun 4, 2026Liliana Hotsko, Yinxi Li, Yuntian Deng +1Software EngineeringLLM Fine-Tuning

    University of Waterloo

  17. Improving Answer Extraction in Context-based Question Answering Systems Using LLMs

    Jun 4, 2026Hafez Abdelghaffar, Ahmed Alansary, Ali HamdiLLM Fine-TuningQuestion Answering

    Faculty of Computer Science MSA University Giza, Egypt

  18. RedditPersona: A Modular Framework for Community-Conditioned LLM Adaptation from Reddit

    Jun 4, 2026Amirhossein Ghaffari, Ali Goodarzi, Huong Nguyen +3LLM EvaluationLLM Fine-Tuning

    Future Computing Group University of Oulu Oulu, Finland · Centre for Applied Computing University of Oulu Oulu, Finland

  19. Multilingual Fine-Tuning via Localized Gradient Conflict Resolution

    Jun 4, 2026Long P. Hoang, Yiran Zhao, Wei Lu +1Multilingual Language ModelsLLM Fine-Tuning

    Singapore University of Technology and Design · Salesforce AI Research · Nanyang Technological University

  20. Dominant-Layer ZO: A Single Layer Dominates Zeroth-Order Fine-Tuning of LLMs

    Jun 3, 2026Wanhao Yu, Ziyan Wang, Zheng Wang +7Fine-TuningMemory-Efficient Fine-Tuning

    University of North Carolina at Charlotte · University of Houston · State University of New York at Binghamton +2

  21. Long Live Fine-Tuning: Task-Specific Transformers Outperform Zero-Shot LLMs for Misinformation Response Classification on Reddit

    Jun 2, 2026JooYoung Lee, Lin Tian, Angela Brillantes +2LLM EvaluationZero-Shot Text Classification

    University of Technology Sydney, Sydney, Australia.

  22. SafeGene: Reusable Adapters for Transferable Safety Alignment

    Jun 2, 2026Yanghan Wang, Zhiqiang Kou, Fu Feng +2LLM Fine-TuningLLM Safety Alignment

    Southeast University · The Hong Kong Polytechnic University

  23. NovelAPIBench: Diagnosing How A Code LLM Learns to Use Novel APIs

    Jun 2, 2026Jinnuo Liu, Yue Peng, Jinhan Niu +1Knowledge Augmentation for Language ModelsLLM Fine-Tuning

    NYU Shanghai

  24. Safety Measurements for Fine-tuned LLMs Should be Grounded in Capability

    Jun 2, 2026Krishnapriya Vishnubhotla, Hillary Dawkins, Isar Nejadgholi +1Language Model Safety EvaluationLLM Fine-Tuning

    National Research Council, Canada

  25. Large Language Models Are Overconfident in Their Own Responses

    Jun 2, 2026Mario Sanz-Guerrero, Manuel Mager, Katharina von der WenseConfidence Estimation in Language ModelsLLM Prompting

    ∇Johannes Gutenberg University Mainz, Germany · ♠University of Colorado Boulder, USA

  26. DECA: Decentralizing Block-Wise Adam for Efficient LLM Full-Parameter Fine-Tuning on Non-IID Data

    Jun 2, 2026Yunsheng Yuan, Shaowei Li, Kai Wang +5Fine-TuningLLM Fine-Tuning

    School of Computer Science and Technology, Shandong University, Qingdao China · School of Mathematical Science, Peking University, China · IEIT SYSTEM, China +2

  27. GRZO: Group-Relative Zeroth-Order Optimization for Large Language Model Fine-Tuning

    Jun 1, 2026Liyan Tan, Yequan Zhao, Yifan Yang +3Fine-TuningMemory-Efficient Fine-Tuning

    University of California, Santa Barbara

  28. Towards Multidisciplinary Summarization of Hospital Stays: Efficient Sentence-Level Clinical Provenance Categorization

    Jun 1, 2026Baris Karacan, Vaibhav Bhargava, Barbara Di Eugenio +21Data ProvenanceLLM Fine-Tuning

    University of Illinois Chicago · University of Iowa · University of Missouri-Columbia

  29. On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters

    Jun 1, 2026Mind Lab, :, Vin Bo +64LLM Fine-TuningAdapter Tuning

  30. Training Prompt Matters: State-Adaptive Optimization for Robust Fine-Tuning

    Jun 1, 2026Wenhang Shi, Yiren Chen, Shuqing Bian +5Continual Learning for LLMsPrompt Learning

    School of Information, Renmin University of China, Beijing, China · Peking University, Beijing, China · Tencent, Beijing, China