Overview

Instruction-following research asks whether language models and agents can carry out what users request, including exact formats, multiple constraints, changing requirements, and rules that override other instructions. Researchers test these abilities with automatically checked benchmarks and realistic settings such as long conversations, tool use, coding, speech, and embodied tasks. To improve performance, they use supervised fine-tuning, preference learning and reinforcement learning with verifiable or rubric-based rewards, as well as prompt compilation, model steering, and inference-time checks. Models can handle many simple instructions, but reliability often falls when constraints interact or accumulate, and improving compliance without harming reasoning, task quality, or general capabilities remains a central challenge.

Latest papers

CardsList

135 papers22 papers in the last four weeks, up 57% on the four weeks before. 0.1% of all new papers.

  1. Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervision

    Mar 7, 2026Shreyas Gopal, Donghang Wu, Ashutosh Anshul +5Speech Language ModelsLanguage Model Distillation

  2. FireBench: Evaluating Instruction Following in Enterprise and API-Driven LLM Applications

    Mar 5, 2026Yunfan Zhang, Yijie Bei, Jetashree Ravi +1LLM EvaluationInstruction Following

  3. IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation

    Mar 5, 2026Bosi Wen, Yilin Niu, Cunxiang Wang +5LLM-as-a-JudgeInstruction Following

  4. DARE-bench: Evaluating Modeling and Instruction Fidelity of LLMs in Data Science

    Feb 27, 2026Fan Shu, Yite Wang, Ruofan Wu +4LLM EvaluationInstruction Following

  5. From Leaky Thoughts to Private Reasoning: Controlling What LRMs Say to Themselves

    Feb 27, 2026Haritz Puerto, Haonan Li, Xudong Han +2Large Reasoning ModelsPrivacy Leakage in Language Models

  6. RAIN-Merging: A Gradient-Free Method to Enhance Instruction Following in Large Reasoning Models with Preserved Thinking Format

    Feb 26, 2026Zhehao Huang, Yuhang Liu, Baijiong Lin +5Instruction FollowingLanguage Model Merging

  7. IndicIFEval: A Benchmark for Verifiable Instruction-Following Evaluation in 14 Indic Languages

    Feb 25, 2026Thanmay Jayakumar, Mohammed Safi Ur Rahman Khan, Raj Dabre +2Instruction FollowingMultilingual Language Model Evaluation

  8. LARFT: Closing the Cognition-Action Gap for Length Instruction Following in Large Language Models

    Feb 25, 2026Wei Zhang, Lintong Du, Yuanhe Zhang +4Instruction FollowingLLM Fine-Tuning

  9. Measuring Pragmatic Influence in Large Language Model Instructions

    Feb 2, 2026Yilin Geng, Omri Abend, Eduard Hovy +1LLM EvaluationLLM Prompting

  10. Role-aware Heuristic Episodic Attention for Conversational LLMs

    Dec 7, 2025Wanyang Hong, Zhaoning Zhang, Yi Chen +5LLM Context ManagementMemory-Augmented Language Models

  11. Reasoning Up the Instruction Ladder for Controllable Language Models

    Oct 30, 2025Zishuo Zheng, Vidhisha Balachandran, Chan Young Park +2LLM Safety AlignmentInstruction Following

  12. COCORELI: Enforcing Execution Preconditions for Reliable Collaborative Instruction Following

    Aug 29, 2025Swarnadeep Bhar, Omar Naim, Eleni Metheniti +4Instruction FollowingLLM Agent Planning

  13. RECAST: Expanding the Boundaries of LLMs' Complex Instruction Following with Multi-Constraint Data

    May 25, 2025Zhengkang Guo, Wenhao Liu, Mingchen Xie +13LLM Fine-TuningSynthetic Data Generation