Tool Use

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 63

All topics

SchemaFill: Efficient LLM Tool Calling via Slot-Parallel Speculative Decoding
Oct 5, 2026Zhi-Kai Chen, Song-Yan Li, De-Chuan Zhan +1Speculative Decoding LLM Inference Acceleration
School of Artificial Intelligence, Nanjing University, China · National Key Laboratory for Novel Software Technology, Nanjing University, China · Nanjing University, China
Turnslide: Scalable Multi-Turn Data Synthesis by Walking a Finite-State Machine
Oct 5, 2026Aaron Fainman, Gabriela Kadlecová, Maciej Gryka +7LLM Fine-Tuning Synthetic Data Generation
Imperial College London · distil labs · Agon +1
Rethinking Multi-Image Re-Representation in Multi-Image Understanding
Sep 30, 2026Gengyuan Zhang, Xiao Han, Xinyu Xie +2Visual Representation Learning Multimodal CoT Reasoning
LMU Munich · MCML
VISTA: Internalizing Collective Visual Experience via On-Policy Distillation for Active Multimodal Agents
Sep 29, 2026Zheng Jiang, Houde Qian, Yiming Chen +5On-Policy Distillation Multimodal Agents
Tsinghua University
Almost Human, Except When It Matters: VoxParity and the Decisions a Voice Should Change
Sep 28, 2026Bhavik ManglaSpoken Dialogue Systems Audio Reasoning
Independent Research
ParaAgent: Reinforcing Parallel Acting in Open-World Tool Environments
Sep 27, 2026Shengbin Yue, Hongru Wang, Siyuan Wang +3LLM Agent Training Tool Use
Fudan University · University of Edinburgh · Chinese University of Hong Kong +3
A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents
Sep 24, 2026Yichun Feng, Jiawei Wang, Haozhe SunLLM Agent Self-Improvement LLM Agent Skill Learning
University of Chinese Academy of Sciences · University of Science and Technology of China · Meituan
Toolcompass: Guiding Tool Trialing, Not Suppressing It
Sep 22, 2026Junlin Fang, Chong Zhang, Do Nguyen-Thanh +3Representation Learning Tool-Augmented Language Model Agents
College of Computing and Data Science, Nanyang Technological University · Zhejiang University · Australian Artificial Intelligence Institute, University of Technology Sydney +1
MTVA-Bench: Evaluating the Language Model Inside Cascaded Voice Agents
Sep 17, 2026Pritish Mishra, Ishaan Kumar, Akshat Mandoli +1Voice Agent Evaluation Multilingual Language Model Evaluation
Smallest AI
MATCH: Model-Aware Tool Learning with Curriculum Scheduling and Hierarchically Gated Rewards
Sep 17, 2026Shihao Liu, Hao Yin, Lijun Liu +3Reward Modeling Curriculum RL
School of Cyber Security, University of the Chinese Academy of Sciences · Honor Device Co., Ltd · University of the Chinese Academy of Sciences
Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read It
Sep 16, 2026Yipeng Liu, Yingqiang Zhang, Feifei Li +1LLM Inference Efficiency KV Caching
Tsinghua University, China · Alibaba Cloud Computing, China · Zhejiang University, China
Selection Is Retrieval, Abstention Is Not: On-Device Tool Routing over 70 Korean-English Actions
Sep 16, 2026Janghoon LeeTool-Augmented Language Model Agents On-Device Language Model Inference
Redrob
From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix
Sep 1, 2026Olga Tsymboi, Dmitrii Stoianov, Ramil Latypov +11LLM Serving Instruction Following
T-Tech
CoBRA: Learning Tool-Use Boundaries via Counterfactual Margins
Sep 1, 2026Wenhao Zou, Xianglong Liu, Wendong Bi +3Tool Use RL for Tool Use
WeChat, Tencent Inc, Beijing, China · University of Chinese Academy of Sciences, Beijing, China · Wuhan University, Wuhan, China
One Policy Is Enough: Single-Agent Reinforcement Learning Outperforms Tree Search for Chemistry Tool Learning
Aug 31, 2026Armin Dariani, Sifan Wu, Bang Liu +1LLM Tool Use Tool Use
1DIRO, Université de Montréal · 2Mila - Quebec Artificial Intelligence Institute · 3Innovation Campus Delaware, Air Liquide
Retry, Switch, or Abstain? Learning Strategy-Aware Tool-Use Policies via Controlled Error Injection
Aug 12, 2026Chaoran Chen, Vy Nguyen, Ziji Zhang +7Curriculum RL AI Agent Benchmarks
Amazon
SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information
Aug 11, 2026Junjie Ye, Zhuohui Sheng, Shaofan Liu +12LLM Evaluation AI Agent Benchmarks
1Fudan University · 2Tencent Hunyuan Team
VTO: Visual Tool Orchestration for Video Anomaly Detection
Aug 8, 2026Rui Wang, Yeteng Wu, Xianling Zhang +1Reinforcement Learning Video Anomaly Detection
State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications Beijing, China
Which Decisions Low-Bit Quantization Breaks, and How to Predict Them
Aug 6, 2026Zekun Wu, Swati Dhiman, Adriano KoshiyamaPost-Training Quantization Low-Bit Quantization
Holistic AI · UCL Centre for Artificial Intelligence, University College London
A Master-Slave Robot Manipulator for Needle-Based Teleoperation in MRI Chamber
Aug 6, 2026Omar Curiel, Jing-Yuan Huang, Po-Chih Chen +6Robot Teleoperation Robotics
Department of Mechanical and Aerospace Engineering, Samueli School of Engineering, University of California, Los Angeles, CA 900095 USA · Horizon Surgical Systems Inc.,Malibu, CA 90265 · Department of Radiological Sciences, University of California, Los Angeles, CA 90095 USA
ToolLIFT: Lifting Tool-Specific Trajectories into Function-Level Graphs for Generalizable Tool Planning
Aug 4, 2026Xiuhui You, Jiayi Luo, Zichao Shen +2Tool-Use Planning Tool Use
School of Computer Science and Engineering · Beihang University
Towards Robust Tool Use in Agents via Experience-Driven Adaptive Guidance
Aug 4, 2026Can Wang, Haoran Chen, Li Yu +4Tool-Using Agents LLM Tool Use
1Shandong Key Laboratory of Digital Service Computing Technology and Systems · 2Alibaba Token Hub · Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University
Screenshots or Tools? Eliciting Tool Use and Managing Multimodal Context in Hybrid GUI-MCP Computer-Use Agents
Aug 4, 2026Siqi Fan, Minghao Li, Xiaoqian Ma +6Computer-Use Agents RL for LLM Agents
University of Electronic Science and Technology of China · AI Platform, Xiaohongshu Inc. · Gaoling School of Artificial Intelligence, Renmin University of China +1
Getting the Parameters Right: A Difficulty-Graded Benchmark and Probe-Guided Training for LLM Tool Calls
Aug 4, 2026Guoyao Yu, Xiaoqing Sun, Ziqi Huang +13Tool-Augmented Language Model Agents AI Agent Benchmarks
ScrambleToolBench: Agents Search Exhaustively Even When Their Own Map Points to the Next Step
Aug 3, 2026Vernon Toh, Navonil Majumder, Zhengyuan Liu +2LLM Agent Evaluation AI Agent Benchmarks
DeCLaRe Lab, Nanyang Technological University, Singapore · Agency for Science, Technology, and Research (A*STAR), Singapore
Verified Tool Calls Improve LLM Agent Reliability Under Non-Atomic Failures
Jul 31, 2026Isham Kalappurackal Mansoor, Abhishek Phadke, Pratip RanaAI Agent Reliability LLM Tool Use
Department of Computer Science Old Dominion University Norfolk, VA 23529 · School of Engineering and Computing Christopher Newport University Newport News, VA 23606
Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation
Jul 31, 2026Goutham Ramakrishnan, Megha SharmaTool-Augmented Language Model Agents Small Language Models
Amazon AGI Bengaluru, India
E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarios
Jul 26, 2026Weihuang Zheng, Tianyuan Zou, Eileen Ye +5Computer-Use Agent Benchmarks Tool-Use Evaluation
Hunyuan Team, Tencent · Institute for AI Industry Research, Tsinghua University · School of Computer Science and Engineering, Southeast University
Diagnosing and Calibrating Tool-Call Boundary Drift in Multi-Teacher On-Policy Distillation
Jul 8, 2026Jiabin Shen, Guang Chen, Chengjun MaoLLM Tool Use Multi-Teacher Knowledge Distillation
FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoning
Jul 7, 2026Chuhao Zhou, Liquan Wang, Shuxin Cao +5Robot Skill Learning Generalization in Robotic Manipulation
MARS Lab, Nanyang Technological University · Georgia Institute of Technology
Toward Trustworthy Large Language Model Agents in Healthcare
Jul 6, 2026Hadi Hasan, Safaa Salman, Adam Tai Abou Dargham +2Healthcare LLM Agent Safety
Department of Electrical and Computer Engineering / American University of Beirut / Beirut, Lebanon
Why Multi-Step Tool-Use Reinforcement Learning Collapses and How Supervisory Signals Fix It
Jun 24, 2026Yupu Hao, Zhuoran Jin, Huanxuan Liao +2Supervised Fine-Tuning LLM Reliability
1The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artiﬁcial Intelligence, University of Chinese Academy of Sciences, Beijing, China
Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability
Jun 24, 2026Yang Tian, Zhengpeng Shi, Yu Zhou +1AI Agent Reliability AI Agent Benchmarks
School of AI, Shanghai Jiao Tong University1 · School of Cyber Science and Engineering, Southeast University2
PACT: Privileged Trace Co-Training for Multi-Turn Tool-Use Agents
Jun 15, 2026Zhenbang Du, Jun Luo, Zhiwei Zheng +8Learning from Demonstration LLM Agent Training
Georgia Institute of Technology · Ohio State University · University of Pennsylvania +1
HyperTool: Beyond Step-Wise Tool Calls for Tool-Augmented Agents
Jun 11, 2026Yaxin Du, Yifan Zhou, Yujie Ge +7Tool-Augmented Language Model Agents LLM Agent Workflow Optimization
Shanghai Jiao Tong University · IQuest Research · Beijing University of Aeronautics and Astronautics
Beyond APIs: Probing the Limits of MLLMs in Physical Tool Use
Jun 9, 2026Zhixin Ma, Yutong Zhou, Yongqi Li +2Tool Use in VLMs Tool-Use Planning
Singapore Management University · The Hong Kong Polytechnic University
Capability-Aligned Hierarchical Learning for Tool-Augmented LLMs
Jun 8, 2026Haotong Yang, Ting Long, Yi ChangHierarchical RL LLM Agent Planning
Jilin University
Synthesize and Reward -- Reinforcement Learning for Multi-Step Tool Use in Live Environments
Jun 2, 2026Ibrahim Abdelaziz, Asim Munawar, Kinjal Basu +4Synthetic Data Generation Reinforcement Learning with Verifiable Rewards
IBM Research
SCOPE: Real-Time Natural Language Camera Agent at the Edge
Jun 1, 2026Nikolaj Hindsbo, Sina Ehsani, Pragyana MishraEfficient VLM Inference AI Control
Armada AI Bellevue, Washington, USA
Ghost Tool Calls: Issue-Time Privacy for Speculative Agent Tools
Jun 1, 2026Bardia Mohammadi, Lars Klein, Akhil Arora +1Data Leakage LLM Agent Security
Max Planck Institute for Software Systems · EPFL · Aarhus University
Learning When Not to Act: Mitigating Tool Abuse in Agentic Reinforcement Learning
Jun 1, 2026Liuji Chen, Dianxing Tang, Xing Shi +4Agentic RL RL for Language Model Reasoning
1NLPR, Institute of Automation, Chinese Academy of Sciences · 3Zhejiang University · 2ByteDance
unix-ctf: Procedural Environments for Unix-Competence Reinforcement Learning
May 27, 2026Geoffrey Bradway, Roger Creus Castanyer, Lorenz Wolf +3AI Agent Benchmarks LLM Agent Training
Vmax
DeltaMCP: Incremental Regeneration via Spec-Aware Transformation for MCP servers
May 27, 2026Aditya Pujara, Xiaogang Zhu, Hsiang-Ting ChenCode Generation LLM Tool Use
Microsoft · University of Adelaide
Efficient Agentic Reinforcement Learning with On-Policy Intrinsic Knowledge Boundary Enhancement
May 26, 2026Dingwei Chen, Zefang Zong, Zhipeng Ma +5Agentic RL LLM Agent Training
Tencent Inc · The Chinese University of Hong Kong · Shenzhen MSU-BIT University
Mind the Tool Failures: Achieving Synergistic Tool Gains for Medical Agents
May 26, 2026Yunhui Gan, Tan Pan, Kaiyu Guo +5Tool Use RL for Tool Use
Fudan University · Shanghai Academy of Artificial Intelligence for Science · Shanghai Innovation Institute +2
Enabling Extensible Embodied Capabilities with Tools
May 26, 2026Xueyang Zhou, Zijia Wang, Qianjiang Li +7Robotic Tool Use Embodied AI
1Huazhong University of Science and Technology · 2Hebei University of Technology · 3Tianjin University +2
Advancing Creative Physical Intelligence in Large Multimodal Models
May 25, 2026Cheng Qian, Hyeonjeong Ha, Jiayu Liu +10Multimodal Grounding Object Hallucination in VLMs
1UIUC · 2Amazon
Diversity Over Frequency: Rethinking Tool Use in Visual Chain-of-Thought Agents
May 25, 2026Dong-Hee Kim, Reuben Tan, Donghyun KimTool Use in VLMs Agentic Reasoning
Department of Artificial Intelligence, Korea University, Seoul, South Korea · 2Microsoft Research, Redmond, USA.
AgroTools: A Benchmark for Tool-Augmented Multimodal Agents in Agriculture
May 21, 2026Zi Ye, Yibin Wen, Xiaoya Fan +10AI Agent Benchmarks Tool-Using Vision-Language Agents
1Sun Yat-Sen University · 2Southwest University · 3Northeastern University +4
ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning
May 19, 2026Zuhao Yang, Kaichen Zhang, Sudong Wang +7Tool Use in VLMs Agentic RL
2NTU · 6LMMs-Lab · Work largely done during Z.Y., K.Z., S.W., and K.W.’s internship at MiroMind. +4
Are Tools Always Beneficial? Learning to Invoke Tools Adaptively for Dual-Mode Multimodal LLM Reasoning
May 19, 2026Qinghe Ma, Zhen Zhao, Yiming Wu +3Multimodal Large Language Models Multimodal Reasoning
The State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China · Shanghai Artificial Intelligence Laboratory +2
TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents
May 16, 2026Zhiqiang Liu, Wenhui Dong, Yilang Tan +3Tool-Use Evaluation AI Agent Benchmarks
Nanjing University · Huazhong University of Science and Technology · Southwest Jiaotong University +1
TIER: Trajectory-Invariant Execution Rewards for Multi-Step Tool Composition
May 16, 2026Anay Kulkarni, ChiaEn Lu, Dheeraj Mekala +3Reward Modeling Reinforcement Learning with Verifiable Rewards
UC San Diego · Cisco Research
Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs
May 14, 2026Guangyu Feng, Huanzhi Mao, Prabal Dutta +1LLM Agent Orchestration LLM Tool Use
University of California, Berkeley
It's not the Language Model, it's the Tool: Deterministic Mediation for Scientific Workflows
May 13, 2026Marios Adamidis, Danae Katrisioti, Yannis Tzitzikas +1LLM Tool Use Scientific Reproducibility
Department of Materials Science and Technology, University of Crete, Heraklion, Greece · Institute of Electronic Structure and Laser, FORTH, Heraklion, Greece · Computer Science Department, University of Crete, Heraklion, Greece +2
ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding
May 13, 2026Xiao Liu, Nayu Liu, Junnan Zhu +6Video QA Tool-Using Vision-Language Agents
Chongqing University · Tianjin University · MAIS, Institute of Automation, Chinese Academy of Sciences +2
The Semantic Training Gap: Ontology-Grounded Tool Architectures for Industrial AI Agent Systems
May 11, 2026Grama ChethanLLM Grounding LLM Hallucination Mitigation
Siemens Digital Industries Software, Plano, TX, United States
Trajectory Supervision for Continual Tool-Use Learning in LLMs
May 10, 2026Vishnu Vardhan Reddy, Sagnik Chatterjee, Soumik BhattaContinual Learning for LLMs LLM Tool Use
CS 590NN UMass Amherst
AutomationBench
Apr 21, 2026Daniel Shepard, Robin SalimansLLM Agent Evaluation Business Process Automation
RaTA-Tool: Retrieval-based Tool Selection with Multimodal Large Language Models
Apr 16, 2026Gabriele Mattioli, Evelyn Turri, Sara Sarto +4Multimodal Foundation Models Tool Selection
University of Modena and Reggio Emilia, Italy · University of Pisa, Italy

Oct 5, 2026, cs.LGJ/K move · Enter open · S save

SchemaFill: Efficient LLM Tool Calling via Slot-Parallel Speculative Decoding

Zhi-Kai Chen, Song-Yan Li, De-Chuan Zhan, Han-Jia Ye

School of Artificial Intelligence, Nanjing University, China · National Key Laboratory for Novel Software Technology, Nanjing University, China · Nanjing University, China

Speculative Decoding LLM Inference Acceleration LLM Tool Use Tool Use

Open paper AskPDF arXiv

LLM agents interact with external systems by generating structured tool calls. Given a user request, conversational context, and a catalog of tool schemas, a tool-calling model must select tools and generate their arguments, potentially producing multiple calls in a single response. Standard autoregressive decoding generates these calls token by token, incurring substantial latency for requests involving multiple calls or many argument fields. The explicit argument structure offers opportunities for parallel generation, but later argument values may depend on preceding fields and calls, so independently generated values can differ from the target model's output. We present SchemaFill, a framework for efficient LLM tool calling through slot-parallel speculative decoding. SchemaFill generates future slot values concurrently as candidates, without requiring advance knowledge of the actual call sequence or argument values. Candidates spanning multiple fields and calls are concatenated for verification by the target model under the actual output prefix. Only verified tokens are committed, and the target supplies corrections when candidates disagree. This applies target verification while exploiting parallelism across slots and calls. On Glaive and BFCL, SchemaFill achieves up to a 4.05

\times

improvement in end-to-end throughput over autoregressive decoding. Code is available at https://github.com/Czzzk/SchemaFill.

Momentum

Related topics

Latest papers 63