Tool-Use Evaluation

Ask about this topic

Momentum

12 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 67

All topics
CardsList

  1. GeoNatureAgent (GNA): A Framework and Benchmark for Pre-Production Evaluation of Tool-Using Agents on Geospatial and Environmental Tasks

    Oct 6, 2026Gabriel Diaz-Ireland, Diego Prieto-Herráez, Mario García Peces +3Tool-Use EvaluationLLM Agent Evaluation

    Universidad Católica de Ávila (UCAV) Ávila, Spain · Independent Researcher Madrid, Spain · Department of Earth and Planetary Sciences, Johns Hopkins University Baltimore, MD, USA +1

  2. Keyword Harnesses Fail Open: A Cheap Diagnostic Ladder for Tool-Use Claims in Small Language Models

    Oct 1, 2026Juan S. SantillanaSupervised Fine-TuningTool-Use Evaluation

    Independent Researcher

  3. Continuous Process-Level Evaluation for Evolving Enterprise AI Agent Skills

    Oct 1, 2026Ngoc Phuoc An Vo, Aarya Doshi, Vadim SheininTool-Use EvaluationAI Agent Evaluation

    IBM · Georgia Institute of Technology · IBM Research

  4. EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos

    Sep 30, 2026Shulin Tian, Junsu Kim, Shuai Liu +17Tool-Use EvaluationTool Use in VLMs

    S-Lab, Nanyang Technological University · A*STAR · KAIST +4

  5. Do Agent Benchmarks Do What They Say? An Executable-Contract Audit of Tool-Using Agent Environments

    Sep 29, 2026Rohith Reddy Bellibatlu, Zichong Wang, Wenbin ZhangTool-Use EvaluationAutomated Software Testing

    Florida International University, Miami, FL, USA

  6. When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agents

    Sep 29, 2026Zifu Tao, Changqing YinAI Agent ReliabilityTool-Use Evaluation

    Tongji University

  7. What Does a Skill Actually Do? Estimands and Evaluation Validity for Tool and Skill Use in LLM Agents: A Critical Review

    Sep 27, 2026Shuyang ZhangTool-Use EvaluationLLM Agent Evaluation

    The Hong Kong Polytechnic University, Hong Kong, China

  8. Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation

    Sep 22, 2026Lijuan Tang, Yuemeng ZhengLLM EvaluationTool-Use Evaluation

    Northeastern University, Seattle

  9. RideWay: Benchmarking Efficient Task Completion for Tool-Using Language Agents

    Sep 16, 2026Qingnuan Han, Boli Fang, Mingzhi Hou +1Tool-Use EvaluationAI Agent Benchmarks

    Didi Global

  10. Beyond AI Literacy: A Structured Review and Exploratory Meta-Analysis of Measures for Competent Generative-AI Use

    Sep 14, 2026Daniele Veri'Tool-Use EvaluationGenerative AI Evaluation

  11. Evaluating Open-Weight E-Commerce Agents with Environment-Grounded Verification

    Sep 14, 2026Nimit Shah, Haitz Sáez de Ocáriz BordeTool-Use EvaluationLLM Agent Evaluation

    AION

  12. What a Random Draw from the MCP Registry Contains, and What Tool-Use Benchmarks Contain Instead

    Sep 12, 2026Haseeb Mohammed AfsarTool-Use EvaluationModel Context Protocol

    Independent researcher

  13. The Era by Eon Benchmark: A Generated Enterprise Estate with Exact Ground Truth for Benchmarking LLM Agents

    Sep 9, 2026Benjamin Gruenbaum, Doron Porat, Assaf Natanzon +3Tool-Use EvaluationLLM Agent Evaluation

    Eon

  14. Interface-Induced Trajectory Censoring

    Sep 3, 2026Wenbo WangTool-Use EvaluationAI Agent Evaluation

    City University of Hong Kong

  15. ToolGate: An Executable Acceptance Pipeline for Tool-Dependent Scientific Benchmark Construction

    Sep 2, 2026Ke Zhang, Yankang Liu, Roya Zandi +1Tool-Use EvaluationBenchmark Construction

    University of California, Riverside

  16. Calibration is the Bottleneck: An Action-Class Diagnostic of Multi-Turn Tool-Calling

    Sep 1, 2026Kangjia Zhao, Jiajun Li, Haozhan Shen +8Tool-Use EvaluationLLM Agent Evaluation

    Zhejiang University · Shanghai Jiao Tong University · National University of Singapore +3

  17. Skill Following: Evaluating Actual Skill Use in Retrieval-Enabled LLM Agents

    Sep 1, 2026Seonghyeon Cho, Chanjun ParkTool-Use EvaluationTool-Augmented Language Model Agents

    Soongsil University

  18. ATLAS: Dual-Horizon Diagnostic Evaluation for Industrial Tool-Use Agents

    Aug 31, 2026Wei Chen, Peilun Zhou, Zhaoyu Hu +8Tool-Use EvaluationLLM Agent Evaluation

    University of Science and Technology of China, Meituan · Meituan

  19. Source-Dependent Deference in Medical Imaging Agents Under Falsified Findings: A Pilot Audit

    Aug 30, 2026Ridam Roy, Md Shahriar Rashid, Md. Rajib MiaTool-Use EvaluationMedical VQA

    Daffodil International University Savar, Dhaka, Bangladesh · Boise State University Boise, Idaho, USA

  20. VAKRA: Evaluating Multi-Hop Reasoning Across APIs and Retrieval Under Tool-Use Policies

    Aug 12, 2026Ankita Rajaram Naik, Anupama Murthi, Benjamin Elder +6Tool-Use EvaluationAI Agent Benchmarks

    IBM, Yorktown Heights, NY, USA

  21. UserToolBench: A User-Profile-Hidden Benchmark for Personalized Decision Making in Tool-Use LLMs

    Aug 10, 2026Xuexiong Yin, Zechuan Chen, Yongsen Zheng +5Tool-Use EvaluationTool-Augmented Language Model Agents

    Sun Yat-Sen University · Nanyang Technological University · Huawei Noah’s Ark Lab

  22. Epistemic Transfer in AI-Assisted Verification: A Framework and Evaluation Protocol

    Aug 9, 2026Christoph TrattnerTool-Use EvaluationHuman-in-the-Loop Evaluation

    SFI MediaFutures, Research Centre for Responsible Media Technology and Innovation · Department of Information Science and Media Studies, University of Bergen, Norway

  23. PluginEval: A Diagnostic Benchmark for Fine-Grained Error Attribution in Function Calling

    Aug 9, 2026Dongjie Xu, Julius, Hanchi Dong +6LLM EvaluationTool-Use Evaluation

    Soochow University · Tencent Inc. · Beijing University of Posts and Telecommunications +4

  24. OpenVisTool: An Open Recipe for Synthesizing Instructive Visual Tool-Use Trajectories

    Aug 9, 2026Changhao Xiang, Shilin Zhang, Zheng Ma +8Tool-Use EvaluationTool Use in VLMs

    1Nanjing University · 2SenseTime Research

  25. A2EA^2E : An End-to-End Agent Auditing Engine

    Aug 7, 2026Haoning Wang, Mingxun Zhang, Chenyue Yu +4Tool-Use EvaluationAI Agent Auditing

    Shanghai Artificial Intelligence Laboratory

  26. When History Lies: Evaluating and Improving Tool Use under Misleading Multi-Turn Histories

    Aug 6, 2026Xiaoqing Wu, Xingyu Fan, Feifei Li +1Tool-Use EvaluationLLM Tool Use

    WeChat, Tencent Inc., Beijing, China

  27. EcoAgent-Bench: Evaluating Economic Decision-Making in Budget-Constrained LLM Agents

    Aug 6, 2026Jie Wu, Ming Gong, Feixiang Cheng +1Computer-Use Agent BenchmarksTool-Use Evaluation

    Atlassian

  28. Hallucinations on the Board: Tool-Augmented Evaluation of LLM Chess Commentary

    Aug 4, 2026S. Ashwin Hebbar, Peiyao Sheng, Sewoong Oh +1LLM EvaluationTool-Use Evaluation

    Princeton University · Sentient Labs · University of Washington

  29. TREK: A Travel Reasoning and Evaluation Kit for LLM Agents in Complex Trip Planning

    Jul 29, 2026Jinhu Qi, Wentao Zhang, Siu Man Ng +4Tool-Use EvaluationLLM Agent Evaluation

    The Chinese University of Hong Kong Hong Kong, China · Macao Polytechnic University Macau, China

  30. E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarios

    Jul 26, 2026Weihuang Zheng, Tianyuan Zou, Eileen Ye +5Computer-Use Agent BenchmarksTool-Use Evaluation

    Hunyuan Team, Tencent · Institute for AI Industry Research, Tsinghua University · School of Computer Science and Engineering, Southeast University