Overview

Instruction tuning studies how to turn pretrained models into systems that respond usefully to instructions, often through supervised fine-tuning on instruction-response pairs and sometimes preference optimization or reinforcement learning. Research develops ways to select, balance, and generate training data, including methods for multilingual, domain-specific, and multimodal tasks. Evaluations use instruction-following tests such as IFEval alongside reasoning, coding, dialogue, and specialized-domain benchmarks. A central challenge is that gains can depend on task and format: tuning may improve instruction compliance while harming other capabilities, and reliable generalization beyond training examples remains difficult.

Latest papers

CardsList

89 papers16 papers in the last four weeks, up 129% on the four weeks before. 0.1% of all new papers.

  1. Self-Indexing Latent Memories for Access-Aware Continual Instruction Tuning of LLMs

    Nov 8, 2026Dhruv Dixit, Paritosh Pandey, Snehalkumar 'Neil' S. GaikwadContinual Learning for LLMsInstruction Tuning

  2. Continual Instruction Tuning for LLM-based Management of Continuum Resources

    Nov 6, 2026Lanpei Li, Antonino Vaccarella, Vincenzo Lomonaco +1Language Model-Based ControlInstruction Tuning

  3. TrafficInstruct: A Multi-Task Network Traffic Dataset and Benchmark for Instruction Tuning

    Nov 2, 2026Zhengdao Li, Hui Wen, Zixuan Wan +6CybersecurityInstruction Tuning

  4. DocTalk: Enhancing Medical Knowledge Retrieval via Fine-tuned Large Language Models with Chain-of-Thought Reasoning for Robust Clinical Decision Support

    Oct 26, 2026Asad Gohar, Md Ariful Islam Mozumder, Moon-Il Joo +1Clinical QAEHR QA

  5. "High-Quality" Data for Early-Stage Instruction Tuning: An Empirical Study of Data Quality Metrics

    Oct 25, 2026Vladimir Necula, David Gvadzabia, Sofia SerranoInstruction-Tuning Data SelectionInstruction Tuning

  6. The Language of Instruction: Genre and Generative AI

    Oct 23, 2026James E. DobsonLLM PromptingInstruction Tuning

  7. Task-Preserving Multilingual Instruction Tuning for Open-Ended QA in WMT 2026 MIST

    Oct 21, 2026Aleix Sant, Jordi Luque, Carlos EscolanoMultilingual QAFine-Tuning Language Models

  8. AutoSFT: An Agentic System for Automated Data Research in Supervised Fine-Tuning

    Oct 15, 2026Bingxiang He, Pengqi Sun, Shihao Peng +18Supervised Fine-TuningInstruction-Tuning Data Selection

  9. Multi-SFT: Permissively-Licensed Multilingual Instruction-Following

    Oct 15, 2026Daniela Baiamonte, Kamyar Zeinalipour, Elena Fano +2Instruction TuningMultilingual Language Models

  10. The Format is the Filter: Scoring Format Fixes What an LLM Judge Can Express

    Oct 12, 2026Lovedeep Gondara, Jekaterina Novikova, Sagarika Suresh +2LLM-as-a-JudgeBias in LLM-as-a-Judge

  11. PitchIn: Natural-Language Vocal Coaching from Unstructured Community Feedback

    Oct 12, 2026Hayeon Bang, Hounsu Kim, Joonyong Park +2Audio-Language ModelsAudio Understanding

  12. Enhancing Biomedical Named Entity Recognition via Multiple Programming Languages Instruction Tuning and Ensemble Method

    Oct 2, 2026Songtao Li, Yijia Zhang, Jianyuan Yuan +3Named Entity RecognitionLLM Fine-Tuning

  13. Coverage Before Control: Route-Instruction Grounding and Steering for Controllable Retrosynthesis

    Sep 30, 2026Xuemin Chen, Xiaozhuang Song, Xinjian Zhao +2Instruction FollowingInstruction Tuning

  14. A helps B while B hurts A: directed transfer in instruction-tuning mixture

    Sep 30, 2026Nima H. Siboni, Vahid RostamiLLM Fine-TuningInstruction-Tuning Data Selection

  15. CompOrca: Corpus-Scale Compliance Labelling of Instruction-Tuning Data

    Sep 29, 2026Philipp E. Glass, Alina MironLLM AuditingInstruction Tuning

  16. ScopeIF: Improving Scope-Aware Precise Instruction-Following in Large Language Models via Graded Reward Modeling

    Sep 26, 2026Bosi Wen, Yilin Niu, Xiaoying Ning +3Instruction FollowingInstruction Tuning

  17. TemporalGraphLLM: Temporal Graph Neural Networks with Large Language Models for Dynamic Text-Attributed Graphs

    Sep 25, 2026Moran Beladev, Or Eitan, Gilad Katz +1Text-Attributed Graph LearningLLMs for Graph Learning

  18. Stabilizing Instruction Supervision for Instruct-TTS via Controllable Diversification and Drift Filtering

    Sep 8, 2026Yizhong Geng, Kecan Mao, Qifei Li +6TTS EvaluationTraining Data Curation

  19. EuroAlpaca: Task-Preserving Localisation of Instruction Data for European Languages

    Sep 4, 2026Aleix Sant, Jordi Luque, Carlos EscolanoInstruction TuningMachine Translation

  20. How Output Format Confounds Data Quality and Capability in Instruction Tuning

    Sep 2, 2026Chengguang Gan, Hanjun Wei, Yunhao Liang +3LLM EvaluationInstruction Tuning

  21. From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation

    Aug 26, 2026Lukas Edman, Daryna Dementieva, Alexander FraserContent ModerationHate Speech Detection

  22. Industrial-Instruction: An End-to-End Framework for Building Instruction-Tuning and Benchmark Datasets from Industrial Technical Reports

    Aug 24, 2026Parsa Bakhtiari, Hassan Bashiri, Alireza Khalilipour +2Synthetic Benchmark GenerationTraining Data Extraction

  23. Are You Sure You're Sure? On the Impact of Instruction Tuning on Confidence and Lexical Diversity

    Aug 13, 2026Irina Proskurina, Mayank Kumar, Oyindolapo O. KomolafeConfidence Estimation in Language ModelsQuestion Answering