Instruction Following

Ask about this topic

Momentum

11 papers in the last four weeks, down 8% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 85

All topics
CardsList

  1. You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue

    Oct 5, 2026Junle Chen, Wei Chen, Zhengjun Huang +5Intent ClassificationInstruction Following

    HKUST · Tencent

  2. When Verifiable Counts Depend on Wording: Auditing Wording Robustness in Instruction Following

    Oct 4, 2026Qishi Zhan, Seoyeon Jang, Zihan Dong +3LLM EvaluationInstruction Following

    Marquette University · University of California, San Diego · Georgia Tech +3

  3. Beyond Leaderboards: Tokenomics of Agentic Small Language Model Ensembles

    Oct 1, 2026Alexei N. Skurikhin, Emily M. Taylor, Nathan A. DeBardelebenLLM Inference EfficiencyLanguage Model Generation Evaluation

    Los Alamos National Laboratory Los Alamos, New Mexico, USA

  4. Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness

    Sep 30, 2026Pardis Sadat Zahraei, Janvijay Singh, Gokhan Tur +1LLM AlignmentInstruction Following

    University of Illinois Urbana-Champaign

  5. Coverage Before Control: Route-Instruction Grounding and Steering for Controllable Retrosynthesis

    Sep 30, 2026Xuemin Chen, Xiaozhuang Song, Xinjian Zhao +2Instruction FollowingInstruction Tuning

    The Chinese University of Hong Kong, Shenzhen

  6. A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?

    Sep 30, 2026Seonho Lee, Wonryeol Jeong, Alberto Cereser +4AI Coding AgentsAI Agent Benchmarks

    KRAFTON · KAIST · Korea National University of Arts

  7. Counterfactual Constraint-Conditioned On-Policy Distillation for Multi-Constraint Instruction Following

    Sep 23, 2026Yanzhao Zheng, Yuanqiang Yu, Tianze Xu +6Reward ShapingInstruction Following

    Alibaba Group, Hangzhou, China

  8. IBBench-Light: A Paired Evaluation of Task-Conditioned Responses to External Directives

    Sep 12, 2026Kainan Zhou, Zhaoyi Li, Janet Sung +2LLM EvaluationBenchmark Design

    Google LLC Mountain View, CA, USA

  9. ContractEval: Query-Conditioned Execution Matching for Procedural Instruction Conformance

    Sep 10, 2026Praphul Singh, Shanu Kumar, Akshat Agarwal +1LLM Agent EvaluationInstruction Following

    Oracle Health AI · MBZUAI

  10. LANTERN: Language Model Assessment on Noisy and Transformed Tasks for Understanding Error and Robustness Nuances

    Sep 7, 2026Vamsi Krishna Kodavali, Rituraj SinghLLM EvaluationInstruction Following

    Samsung

  11. In-Place Instruction Following in Diffusion Language Models

    Sep 7, 2026Zheng Nie, Zherui Li, Jiaming Zhang +3Instruction FollowingDiffusion Language Models

    National University of Singapore · Nanyang Technological University · Peking University

  12. ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults

    Sep 7, 2026Weide Zhan, Qumu Shaqu, Yuanqing Liu +6Mobile GUI AutomationComputer-Use Agent Benchmarks

    Fudan University Shanghai, China

  13. Instruction Duplication as an Inference-Time Control Primitive

    Sep 3, 2026Victor LavrenkoInstruction FollowingInference-Time Language Model Alignment

    PeaceTech VC, Israel

  14. DuplexSpeechBench-IFEval: Evaluating Implicit Instruction Following in Full-Duplex Voice Agents

    Sep 3, 2026Puneet Mathur, Dinesh ManochaAI Agent BenchmarksInstruction Following

    University of Maryland College Park, USA

  15. DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models

    Sep 2, 2026Kushagra Bhushan, Meghanadh Pulivarthi, Sai Krishna Reddy Sathi +7Knowledge Augmentation for Language ModelsRetrieval-Augmented Generation

    1IBM · 2Indian Institute of Technology, Madras

  16. CivBench: A Long-Horizon Benchmark for Tool-Mediated Agents in Civilization VI

    Sep 2, 2026Austin Tudor David Andrews, Liam Wilkinson, Jamie Heagerty +3LLM Agent EvaluationLLM Tool Use

    University of Oxford · Tony Blair Institute for Global Change · Google DeepMind +1

  17. From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix

    Sep 1, 2026Olga Tsymboi, Dmitrii Stoianov, Ramil Latypov +11LLM ServingInstruction Following

    T-Tech

  18. Compile, Don't Memorize: A Context Compilation Architecture (CCA) for In-Context Learning

    Sep 1, 2026Jinhu Qi, Minda Hu, Wentao Zhang +4Instruction FollowingIn-Context Learning

    The Chinese University of Hong Kong · Macao Polytechnic University · Xi’an Jiaotong University +1

  19. Dead text or binding clause? Measuring and restoring constraint influence in black-box LLM dialogues

    Aug 12, 2026Haoyuan ZhuInstruction FollowingLLM Reliability

    Department of Electronic and Electrical Engineering University of Sheffield

  20. Large Language Models Can Follow Instructions, But Not Many at Once: Phase Transitions in Compositional Constraint Satisfaction

    Aug 12, 2026Mariya I. VasilevaLLM EvaluationInstruction Following

    Work done while at Meta Superintelligence Labs.

  21. Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agents

    Aug 12, 2026Zining Huang, Haoran Que, Hong Zeng +8AI Coding AgentsLLM Agent Evaluation

    ByteDance Seed · Tsinghua University · Peking University

  22. EnterpriseRAG: Benchmarking LLM Instruction Adherence and Robustness under Non-Ideal Enterprise Retrieval

    Aug 12, 2026Huiqi Miao, Xinbao Sun, Bo Wang +6Retrieval-Augmented GenerationInstruction Following

    Jiutian Research, China Mobile, Beijing, China

  23. Why Does CLAUDE.md Keep Growing? Catastrophic Remembering in Agentic Coding

    Aug 11, 2026Kushal ChakrabartiLLM PromptingAgentic Code Generation

    South Park Commons

  24. UNSPECIFIC: General Constraint Synthesis for Breaking Copy-and-Paste Shortcut in LLM Instruction Following

    Aug 10, 2026Jeet Sharma, Balpreet Kaur, Jeremiah Hong +2Instruction FollowingConstraint Satisfaction

    University of Massachusetts, Amherst, USA

  25. LLM within MCP Matters: Measuring Inefficient Resource Utilization Driven by LLMs

    Aug 9, 2026Minhan Cho, Soyoung Park, Kihyeon Jeong +3LLM Inference EfficiencyInstruction Following

    Remember & Company AI Lab · Sungkyunkwan University · National Assembly Research Service +2

  26. Your Prompt Is Not the Only Prompt: How Much Do LLMs Weight Structured-Output Schema Descriptions?

    Aug 8, 2026Sin-Ying LinPrompt SensitivityStructured Prompting

    Independent Researcher

  27. Lost in Compaction: Evaluating Side-Constraint Loss under Context Compaction

    Jul 31, 2026Zhiqi Wang, Yichi Zhang, Dongwon Lee +1Persistent Memory for Language ModelsInstruction Following

    The Pennsylvania State University

  28. Instruction Stacking Collapse: A Benchmark and the Capability-Dependent Value of Prompt Compilation

    Jul 31, 2026Atul Anand, Sourav ChattarajLLM EvaluationLLM Prompting

  29. IFHierBench: Hierarchical Instruction Following for Large Language Models

    Jul 30, 2026Yuetian Mao, Chunyang ChenLLM EvaluationLanguage Model Generation Evaluation

    Technical University of Munich

  30. HANDBOOK.md: A Benchmark for Long-Context Agentic Instruction Following

    Jul 28, 2026Liudas Panavas, Sebastian Minus, Bradley Monton +4Computer-Use Agent BenchmarksAI Agent Reliability

    Surge AI*

  31. SyRuP: Enhancing System-Prompt Following via Reward-Guided Prediction in LLM Decoding

    Jul 27, 2026Seoyeon Kim, Minjae Kang, Jaehyung KimLanguage Model DecodingLanguage Model Steering

    Yonsei University

  32. Task Competence Is Not Instruction Following: Evaluating Instruction-Conflicting Behavior in Small Language Models

    Jul 21, 2026Mahdiyeh Farajidizaji, Vatsal RainaLLM EvaluationInstruction Following

    Khajeh Nasir Toosi University of Technology · Apta AI, Spark AI Research

  33. Prompt Design at Scale: How Format, Instruction Count, and Context Length Shape Instruction Adherence and Hallucination in Large Language Models

    Jul 21, 2026Netanel EliavLLM EvaluationLanguage Model Generation Evaluation

    Machine Human Intelligence Lab (MHIL)

  34. Compile, Then Page: Executable SOP Programs and a Capability-Gated Runtime for Procedural LLM Agents

    Jul 13, 2026Chenglin Yu, Li Yin, Ying Yu +4Instruction FollowingRuntime Enforcement for AI Agents

    Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University · Department of Data and Systems Engineering, The University of Hong Kong · College of Economics and Management, Zhejiang Normal University +3

  35. Unlocking Speech-Text Compositional Powers: Instruction-Following Speech Language Models without Instruction Tuning

    Jul 2, 2026Congrui Du, Yang Zhang, Kaizhi Qian +1Language Model PretrainingInstruction Following

    University of California, Santa Barbara, USA · MIT-IBM Computing Research Lab, IBM Research, USA

  36. Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexity

    Jun 30, 2026Bytedance SeedLLM EvaluationInstruction Following

    Bytedance Seed

  37. CDR-Bench: Evaluating Faithful Execution of Compositional, Order-Sensitive Data Refinement Recipes

    Jun 30, 2026Yuchen Huang, Xiang Li, Zhenqing Ling +5LLM EvaluationInstruction Following

    1HKUST · 2NUS · 3Tongyi Lab , Alibaba Group

  38. Indi-RomCoM: Code-Mixed Benchmark for Evaluating LLMs on Romanized Indic-English Instructions

    Jun 29, 2026Avisha Das, Mihir Parmar, Mohana Ramnath +1Multilingual Language Model EvaluationInstruction Following

    Shiv Nadar University Chennai · Google Cloud AI Research · IIT Madras

  39. IHDec: Divergence-Steered Contrastive Decoding for Securing Multi-Turn Instruction Hierarchies

    Jun 29, 2026Nicole Geumheon Liu, Haeun Jang, Yonghyun Jun +1Instruction FollowingPrompt Injection Defense

    Chung-Ang University, Seoul, Korea

  40. Are Humans Evolved Instruction Followers? An Underlying Inductive Bias Enables Rapid Instructed Task Learning

    Jun 29, 2026Anjishnu KumarInstruction FollowingInductive Bias

    Amazon Alexa AI Seattle, USA

  41. Masked Language Flow Models

    Jun 26, 2026Iskander Azangulov, Kianoosh Ashouritaklimi, Leo Zhang +2Masked Diffusion ModelsInstruction Following

    Department of Statistics, University of Oxford

  42. FBK's Long-form SpeechLLMs for IWSLT 2026 Instruction Following

    Jun 25, 2026Zhihang Xie, Marco Gaido, Sara Papi +2Audio-Language Model EvaluationSpeech Processing

    Fondazione Bruno Kessler · University of Trento

  43. A Framework for Evaluating Agentic Skills at Scale

    Jun 16, 2026Maksim Shaposhnikov, Nicolas Fortuin, Simon Stipcich +3LLM Agent EvaluationInstruction Following

    Tessl London, United Kingdom

  44. Beyond English: Uncovering the Multilingual Gap in Vision-Language-Action Models

    Jun 14, 2026Hanyang Chen, Hongliang Li, Jiarui Cao +6Cross-Lingual Representation AlignmentInstruction Following

    Beijing Jiaotong University

  45. Soft-Prompt Tuning for Fair and Efficient LLM Benchmark Evaluation

    Jun 10, 2026Selen Erkan, Bastian Boll, Kristian Kersting +2LLM EvaluationInstruction Following

    Aleph Alpha Research Lab1141 · TU Darmstadt Hessian.AI Lab1141

  46. When Built-in Thinking Helps and Hurts: Constraint-Level Error Shifts in Instruction Following

    Jun 8, 2026Sai Adith Senthil KumarLLM EvaluationInstruction Following

    George Mason University

  47. ComplexConstraints and Beyond: Expert Rubrics for RLVR

    Jun 8, 2026Sushant Mehta, Liudas Panavas, Suhaas Garre +1LLM-as-a-JudgeRubric-Based RL

    Surge AI

  48. Where Instruction Hierarchy Breaks: Diagnosing and Repairing Failures in Reasoning Language Models

    Jun 5, 2026Sanjay Kariyappa, G. Edward SuhLLM AuditingInstruction Following

    NVIDIA

  49. RECAP: Regression Evaluation for Continual Adaptation of Prompts

    Jun 4, 2026Harsh Deshpande, Kushal Chawla, Sangwoo Cho +2Continual Learning for LLMsLLM Evaluation

    Capital One

  50. MDP-GRPO: Stabilized Group Relative Policy Optimization for Multi-Constraint Instruction Following

    Jun 4, 2026Mohammad Mahdi Salmani-Zarchi, Zahra Rahimi, Heshaam Faili +1Group Relative Policy OptimizationInstruction Following

    Department of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran · Department of Statistics, Mathematics and Computer Science, Allameh Tabataba’i University, Tehran, Iran

  51. Multilingual Long-Form Speech Instruction Following: KIT's Submission to IWSLT 2026

    Jun 3, 2026Enes Yavuz Ugan, Maike Züfle, Yuka Ko +5MBR DecodingInstruction Following

    1Karlsruhe Institute of Technology · 2Carnegie Mellon University

  52. Bridging Auxiliary Constraints to Resolve Instruction Following in Large Reasoning Models

    Jun 2, 2026Zhengyi Zhao, Shubo Zhang, Huimin Wang +7LLM PromptingInstruction Following

    The Chinese University of Hong Kong · Tencent Jarvis Lab · Westlake University +2

  53. AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Following

    Jun 2, 2026Haitao Li, Tian Tan, Yuguang Yang +2Audio-Language Model EvaluationLLM-as-a-Judge

    Zhejiang University · Shanghai Innovation Institute · Shanghai Jiao Tong University +1

  54. Label-Free Reinforcement Learning via Cross-Model Entropy

    May 27, 2026Matt Gorbett, Hossein ShiraziReinforcement LearningInstruction Following

    Independent Researcher · San Diego State University

  55. Soft-SVeRL: Self-Verified Reinforcement Learning with Soft Rewards

    May 27, 2026Saurabh Dash, Pierre Clavier, John Dang +4Reinforcement LearningInstruction Following

    Cohere Labs · Cohere · Adaption Labs +1

  56. The Missing Piece in Pre-trained Model Evaluation: Reward-Guided Decoding Unlocks Task-Oriented Behavior Without Parameter Updates

    May 27, 2026Shaobo Wang, Guo Chen, Ziyue Wang +5LLM EvaluationLanguage Model Decoding

    Shanghai Jiao Tong University · Qwen Team, Alibaba Group · The Chinese University of Hong Kong, Shenzhen

  57. Disentangling Language Roles in Multilingual LLM Task Execution

    May 26, 2026Qishi Zhan, Minxuan Hu, Seoyeon Jang +7Multilingual Language ModelsMultilingual Language Model Evaluation

    Marquette · Cornell · UC San Diego +7

  58. MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation

    May 26, 2026Haoyu Zheng, Yun Zhu, Shu Yuan +5Instruction FollowingData Contamination in Language Models

    1Zhejiang University · 2Shanghai AI Laboratory · 3Huazhong University of Science and Technology +2

  59. ContextGuard: Structured Self-Auditing for Context Learning in Language Models

    May 26, 2026Hongbo Jin, Chi Wang, Haoran Tang +5LLM AuditingInstruction Following

    Peking University · SCUT · Tsinghua University

  60. Do as I Say, Not as I Do: Instruction-Induction Conflict in LLMs

    May 19, 2026Carolina Camassa, Derek ShillerLLM EvaluationLanguage Model Self-Assessment

    Future Impact Group · Rethink Priorities