cs.AIAug 23, 2026

Small Reasoning Models are Instruction Followers in Function Calling

Authors: Yalda Taheri, Mohammad Hassan Heydari, Erfan Naaman, Afsaneh Fatemi

Organizations: Department of Engineering Islamic Azad University · Department of Computer Engineering University of Isfahan

Abstract

Function calling represents the core capability of agentic large language models (LLMs). Existing research has focused on enhancing LLMs function-calling accuracy through fine-tuning, reinforcement learning (RL), and multi-agent frameworks, particularly for native function-calling LLMs. This work demonstrates that LLMs achieve superior accuracy in function calling in instruction-following contexts (i.e., standard user-assistant interactions) rather than a tool calling context. We introduce Instruction-Followed Function Calling (IFFC), a novel framework that decouples function-calling logic from the primary LLM and delegates it to a dedicated smaller model operating within the instruction-following paradigm. Our method consistently outperforms both native function calling (NFC) and prompt-based function calling (PFC) baselines, with particularly strong gains on reasoning-oriented LLMs. Furthermore, we demonstrate that IFFC maintains robust performance under aggressive quantization, enabling efficient on-device deployment without significant accuracy degradation. This work establishes a new paradigm for reliable, resource-efficient function calling in edge-computing scenarios.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. R2IF: Aligning Reasoning with Decisions via Composite Rewards for Interpretable LLM Function Calling

    Apr 22, 2026Aijia Cheng, Kailong Wang, Ling Shi +1RL for Language ModelsLLM Interpretability

  2. Uncertainty Quantification for LLM Function-Calling

    Apr 24, 2026Zihuiwen Ye, Lukas Aichberger, Michael Kirchhof +5Uncertainty QuantificationLLM Tool Use

  3. Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs

    May 14, 2026Guangyu Feng, Huanzhi Mao, Prabal Dutta +1LLM Agent OrchestrationLLM Tool Use