Tool-Augmented Language Model Agents

Follow this topic Ask about this topic

Momentum

17 papers in the last four weeks, up 42% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 132

All topics

GroundEval: A Deterministic Replacement for LLM-as-Judge in Stateful Agent Evaluation
Jun 22, 2026Jeffrey FlyntAI Agent Reliability Tool-Use Evaluation
Independent Researcher
LedgerAgent: Structured State for Policy-Adherent Tool-Calling Agents
Jun 18, 2026Md Nayem Uddin, Amir Saeidi, Eduardo Blanco +1Tool-Augmented Language Model Agents Customer Support Automation
♠Arizona State University · ♢University of Arizona
Decoupling Search from Reasoning: A Vendor-Agnostic Grounding Architecture for LLM Agents
Jun 17, 2026Emmanuel Aboah Boateng, Kyle MacDonald, Amardeep Kumar +2LLM Grounding Tool-Augmented Language Model Agents
DoorDash, Inc.
Compositional Skill Routing for LLM Agents: Decompose, Retrieve, and Compose
Jun 16, 2026Xueping GaoTool-Augmented Language Model Agents LLM Planning
Alibaba Cloud Hangzhou, China
Beyond Domains: Reusing Web Skills via Transferable Interaction Patterns
Jun 16, 2026Shiqi He, Yue Cui, Feijie Wu +5Tool-Augmented Language Model Agents LLM Agent Skill Learning
University of Michigan · Alibaba Group · Purdue University +2
MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agents
Jun 15, 2026Lawrence Keunho Jang, Andrew Keunwoo Jang, Jing Yu Koh +1Computer-Use Agent Benchmarks Tool-Augmented Language Model Agents
Carnegie Mellon University
ACCORD: Action-Conditioned Contextual Grounding for Language Agents
Jun 15, 2026Lai Jiang, Cheng Qian, Zhenhailong Wang +3LLM Grounding Tool-Augmented Language Model Agents
University of Illinois Urbana-Champaign · Stanford University
Looking Is Not Picking: An Attention-Segment Account of Tool-Selection Failures in LLM Agents
Jun 15, 2026Shiyang ChenAI Agent Reliability Tool-Augmented Language Model Agents
Beijing Institute of Technology
State-Grounded Multi-Agent Synthetic Data Generation for Tool-Augmented LLMs
Jun 15, 2026Rahul Khedar, Eshita, Sneha Teja Sree Reddy Thondapu +10Multi-Agent LLM Systems Tool-Augmented Language Model Agents
PayPal AI
ToolMenuBench: Benchmarking Tool-Menu Filtering Strategies for Reliable and Efficient LLM Agents
Jun 13, 2026Rahul Suresh Babu, Laxmipriya Ganesh IyerAI Agent Reliability Tool-Use Evaluation
Independent Researcher United States of America
EChO-Agent: Evidence Chain Orchestration Agent for Audio Reasoning
Jun 13, 2026Siyuan Zhang, Jian Zong, Junyu Wang +7Audio QA Tool-Augmented Language Model Agents
School of Artificial Intelligence, Tianjin University, Tianjin, China
HyperTool: Beyond Step-Wise Tool Calls for Tool-Augmented Agents
Jun 11, 2026Yaxin Du, Yifan Zhou, Yujie Ge +7Tool-Augmented Language Model Agents LLM Agent Workflow Optimization
Shanghai Jiao Tong University · IQuest Research · Beijing University of Aeronautics and Astronautics
Recursive Agent Harnesses
Jun 11, 2026Elias Lumer, Sahil Sen, Kevin Paul +1Tool-Augmented Language Model Agents LLM Agent Orchestration
PricewaterhouseCoopers, U.S.
Less Context, Better Agents: Efficient Context Engineering for Long-Horizon Tool-Using LLM Agents
Jun 8, 2026Abhilasha Lodha, Mahsa Pahlavikhah Varnosfaderani, Abir Chakraborty +1LLM Inference Efficiency Tool-Augmented Language Model Agents
Microsoft
QueryWeaver: Reliable Multi-Tool Query Execution Planning via LLM-Based Graph Generation
Jun 6, 2026Aishwarya Chakravarthy, Vidhi Kulkarni, Duen Horng ChauTool-Augmented Language Model Agents Tool-Use Planning
School of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
Customer-Agent: Overcoming Context Limitations in Ultra-Long Shopping Trajectories via Tool-Augmented Agents and RLVR
Jun 6, 2026Hongye Liu, Rongmei Lin, Anurag Kashyap +4Tool-Augmented Language Model Agents Long-Context Modeling
Amazon · Duke University
ToolChoiceConfusion: Causal Minimal Tool Filtering for Reliable LLM Agents
Jun 4, 2026Rahul Suresh Babu, Laxmipriya Ganesh IyerAI Agent Reliability Tool-Use Evaluation
Independent Researcher United States of America
ToolSense: A Diagnostic Framework for Auditing Parametric Tool Knowledge in LLMs
Jun 4, 2026Ashutosh Hathidara, Sai Shruthi Sistla, Sebastian Schreiber +1Tool-Augmented Language Model Agents LLM Auditing
SAP Labs
Reducing Hallucinations in Complex Question Answering using Simple Graph-based Retrieval-Augmented Generation (long version)
Jun 4, 2026Christopher J. Wedge, Joshua Stutter, Danny Dixon +1Multi-Hop QA Tool-Augmented Language Model Agents
National Innovation Centre for Data, Newcastle University
Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents
Jun 3, 2026Haoyu Sun, Wenxuan Wang, Mingyang Song +5Tool-Augmented Language Model Agents LLM Agent Evaluation
Tongji University · Shanghai AI Laboratory · Harbin Institute of Technology +5
ToolGate: Token-Efficient Pre-Call Control for Tool-Augmented Vision-Language Agents
Jun 2, 2026Anjie Liu, Yan Song, Zhixun Chen +3Tool Use in VLMs Tool-Augmented Language Model Agents
The Hong Kong University of Science and Technology (Guangzhou) · University College London · AI Lab, The Yangtze River Delta
WRIT: Write-Read Intensive Trajectory Synthesis for Multi-Turn User-Facing Agents
Jun 1, 2026Hengrui Gu, Xiaotian Han, Kaixiong ZhouTool-Augmented Language Model Agents Tool-Using Agents
North Carolina State University · Case Western Reserve University
SkillsInjector: Dynamic Skill Context Construction for LLM Agents
May 28, 2026Yanchao Li, Wanhao Liu, Ben Gao +5Tool-Augmented Language Model Agents LLM Agent Skill Learning
1Nanjing University · 2Shanghai AI Lab
Notation Matters: A Benchmark Study of Token-Optimized Formats in Agentic AI Systems
May 28, 2026Lorenz Kutschka, Bernhard GeigerTool-Augmented Language Model Agents AI Agent Evaluation
Know Center Research GmbH / Sandgasse 34, A-8010 Graz · Signal Processing and Speech Communication, Graz University of Technology / Inffeldgasse 16c, A-8010 Graz · Graz Center for Machine Learning // A-8010 Graz
VitalAgent: A Tool-Augmented Agent for Reactive and Proactive Physiological Monitoring over Wearable Health Data
May 28, 2026Di Zhu, Yu Yvonne Wu, Hong Jia +3Tool-Augmented Language Model Agents LLM Agents
The University of Melbourne, Australia · Dartmouth College, US · University of Auckland, New Zealand +1
GrepSeek: Training Search Agents for Direct Corpus Interaction
May 28, 2026Alireza Salemi, Chang Zeng, Atharva Nijasure +4Tool-Augmented Language Model Agents Agentic Search
University of Massachusetts Amherst · Princeton University · Carnegie Mellon University
A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks
May 27, 2026Tomer Keren, Nitay Calderon, Asaf Yehudai +3Computer-Use Agent Benchmarks Tool-Use Evaluation
Faculty of Data and Decision Science Technion · IBM Research
Plan Before Search: Search Agents Need Plan
May 27, 2026Zhipeng Qian, Zihan Liang, Yufei Ma +7Multi-Hop QA Tool-Augmented Language Model Agents
1Kuaishou Technology · 2Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China · 3VCIP, CS, Nankai University
Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agents
May 27, 2026Xinze Li, Yuhang Zang, Yixin Cao +1Tool-Augmented Language Model Agents LLM Agent Skill Retrieval
Nanyang Technological University · Shanghai AI Laboratory · Fudan University
Knowing When to Ask: Segment-Level Credit Assignment for LLM Tool Use
May 27, 2026Abhijit Kumar, Zoey Wu, Mohit SuleyTool-Augmented Language Model Agents Learning to Defer
Microsoft AI Redmond, WA
TADDLE: A Tool-Augmented Agent for Detecting Deficient LLM-Generated Peer Reviews
May 26, 2026Hanqi Duan, Xiang LiTool-Augmented Language Model Agents LLM Agents
East China Normal University
Stateful Inference for Low-Latency Multi-Agent Tool Calling
May 25, 2026Victor NorgrenLLM Inference Efficiency Multi-Agent LLM Systems
LayerScale, Inc.
SPEAR: Code-Augmented Agentic Prompt Optimization
May 25, 2026Mengyin Lu, Cong Feng, Huimin Han +6Tool-Augmented Language Model Agents Automatic Prompt Optimization
LinkedIn Corporation
Retrieval as Reasoning: Self-Evolving Agent-Native Retrieval via LLM-Wiki
May 25, 2026Haoliang Ming, Feifei Li, Xiaoqing Wu +1Multi-Hop QA Retrieval-Augmented Generation
WeChat, Tencent Inc., Beijing, China
Tool-Schema Compression Enables Agentic RAG Under Constrained Context Budgets
May 24, 2026Furkan SakizliTool-Augmented Language Model Agents Agentic RAG
Independent Researcher
How Many Tools Should an LLM Agent See? A Chance-Corrected Answer
May 23, 2026Vyzantinos Repantis, Ameya Gawde, Harshvardhan Singh +1Tool-Use Evaluation Tool-Augmented Language Model Agents
Meta Platforms
ContextEcho: A Benchmark for Persona Drift in Long Agentic-Coding Sessions
May 22, 2026Xianzhong Ding, Yangyang Yu, Changwei Liu +1Tool-Augmented Language Model Agents AI Coding Agents
Center for Advanced AI, Accenture
Boiling the Frog: A Multi-Turn Benchmark for Agentic Safety
May 21, 2026Piercosma Bisconti, Matteo Prandi, Federico Pierucci +11LLM Safety Benchmarks Computer-Use Agent Benchmarks
Icaro Foundation · Sapienza University of Rome · Sant’Anna School of Advanced Studies +6
Search-E1: Self-Distillation Drives Self-Evolution in Search-Augmented Reasoning
May 21, 2026Zihan Liang, Yufei Ma, Ben Chen +4Tool-Augmented Language Model Agents On-Policy Self-Distillation
SpecHop: Continuous Speculation for Accelerating Multi-Hop Retrieval Agents
May 21, 2026Mehrdad Saberi, Keivan Rezaei, Soheil FeiziMulti-Hop QA Tool-Augmented Language Model Agents
University of Maryland, College Park
Terminal-World: Scaling Terminal-Agent Environments via Agent Skills
May 20, 2026Zihao Cheng, Hongru Wang, Zeming Liu +6Tool-Augmented Language Model Agents Terminal Agents
School of Computer Science and Engineering, Beihang University, Beijing, China · Independent Researcher · 3Beijing Institute of Technology +2
EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
May 18, 2026Minrui Xu, Zilin Wang, Mengyi DENG +12Tool-Augmented Language Model Agents Agentic RL
LARK, HKUST (GZ) · University of Cambridge · UCL +2
Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs
May 17, 2026Yuxuan Lu, Ziyi Wang, Yingzhou Lu +12Tool-Augmented Language Model Agents Synthetic Data Generation
Northeastern University · Independent Researcher
To Call or Not to Call: Diagnosing Intrinsic Over-Calling Bias in LLM Agents
May 16, 2026Wei Shi, Ziheng Peng, Sihang Li +4Tool-Augmented Language Model Agents Causal Interventions in Language Models
Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Renmin University of China +2
R2V Agent: Teaching SLMs When to Ask for Help
May 15, 2026Raghu Vamshi Hemadri, Humaira Firdowse Mohammed, Rishabh Maheshwary +5AI Agent Reliability Tool-Augmented Language Model Agents
New York University Tandon School of Engineering · University of California, San Diego · ServiceNow Research +3
Argus: Evidence Assembly for Scalable Deep Research Agents
May 15, 2026Zhen Zhang, Liangcai Su, Zhuo Chen +7Multi-Agent LLM Systems Tool-Augmented Language Model Agents
MiroMind AI
From Text to Voice: A Reproducible and Verifiable Framework for Evaluating Tool Calling LLM Agents
May 14, 2026Md Tahmid Rahman Laskar, Xue-Yong Fu, Seyyed Saeed Sarfjoo +3Audio-Language Model Evaluation Voice Agent Evaluation
Dialpad Inc.
Latency-Quality Routing for Functionally Equivalent Tools in LLM Agents
May 14, 2026Kexin Chu, Dawei Xiang, Wei ZhangTool-Augmented Language Model Agents LLM Tool Use
University of Connecticut
WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
May 11, 2026Shuangrui Ding, Xuanlang Dai, Long Xing +14Computer-Use Agent Benchmarks Tool-Augmented Language Model Agents
1Shanghai AI Laboratory, 2The Chinese University of Hong Kong · 1Shanghai AI Laboratory, 3Fudan University · 1Shanghai AI Laboratory, 4University of Science and Technology of China +8
Rethinking Agentic Search with Pi-Serini: Is Lexical Retrieval Sufficient?
May 11, 2026Tz-Huan Hsu, Jheng-Hong Yang, Jimmy LinTool-Augmented Language Model Agents Agentic Search
University of Waterloo · Stencilzeit
LLM Agents Already Know When to Call Tools -- Even Without Reasoning
May 10, 2026Chung-En Sun, Linbo Liu, Ge Yan +2Tool-Augmented Language Model Agents AI Agent Benchmarks
University of California, San Diego
SearchSkill: Teaching LLMs to Use Search Tools with Evolving Skill Banks
May 9, 2026Jinchao Hu, Meizhi Zhong, Kehai Chen +1Tool-Augmented Language Model Agents Agentic Search
School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen · Independent Researcher Shenzhen / Beijing, China
Tool Calling is Linearly Readable and Steerable in Language Models
May 8, 2026Zekun Wu, Ze Wang, Seonglae Cho +4AI Agent Reliability Tool-Augmented Language Model Agents
University College London · Holistic AI · Imperial College London
Switchcraft: AI Model Router for Agentic Tool Calling
May 8, 2026Sharad Agarwal, Pooria Namyar, Alec Wolman +3Tool-Augmented Language Model Agents Cost-Aware Inference
Microsoft Research · Microsoft · Stanford
MIST: Multimodal Interactive Speech-based Tool-calling Conversational Assistants for Smart Homes
May 7, 2026Maximillian Chen, Xuanming Zhang, Michael Peng +3Tool-Augmented Language Model Agents Multimodal Large Language Models
Columbia University · Seoul National University
AgenticRAG: Agentic Retrieval for Enterprise Knowledge Bases
May 7, 2026Susheel Suresh, Hazel Mak, Shangpo Chou +2Tool-Augmented Language Model Agents Agentic Search
Microsoft Corporation
OpenSeeker-v2: Pushing the Limits of Search Agents with Informative and High-Difficulty Trajectories
May 5, 2026Yuwen Du, Rui Ye, Shuo Tang +4Supervised Fine-Tuning Tool-Augmented Language Model Agents
1Shanghai Jiao Tong University
TSCG: Deterministic Tool-Schema Compilation for Agentic LLM Deployments
May 4, 2026Furkan SakizliTool-Augmented Language Model Agents LLM Tool Use
Independent Researcher
FitText: Evolving Agent Tool Ecologies via Memetic Retrieval
May 4, 2026Kyle Zheng, Han Zhang, Renliang Sun +2Tool-Use Evaluation Tool-Augmented Language Model Agents
UCLA
Are Tools All We Need? Unveiling the Tool-Use Tax in LLM Agents
Apr 30, 2026Kaituo Zhang, Zhen Xiong, Mingyu Zhong +4Tool-Augmented Language Model Agents Agentic Reasoning
University of Houston · University of Southern California · 3New York University +2

Jun 22, 2026, cs.AIJ/K move · Enter open · S save

GroundEval: A Deterministic Replacement for LLM-as-Judge in Stateful Agent Evaluation

Jeffrey Flynt

Independent Researcher

AI Agent Reliability Tool-Use Evaluation LLM Grounding Tool-Augmented Language Model Agents LLM-as-a-Judge Language Model Generation Evaluation+4

Open paper AskPDF arXiv

Before letting an agent operate over real context, can you prove it used the right evidence? GroundEval turns that question into a deterministic test of what the agent searched, fetched, cited, and was permitted to access. In one case study, two frontier LLM judges scored a plausible agent response 0.85 and higher. But the trace told a different story: the agent had never retrieved the artifact its answer depended on, yielding a GroundEval score of 0.000. We introduce GroundEval, a judge-free framework for evaluating agents against grounded, time-bounded, and access-controlled evidence. GroundEval uses a domain configuration to generate questions, lets the agent choose how to answer, and then scores both the final answer and the recorded trajectory that produced it. The benchmark targets three failures that LLM-as-judge evaluation struggles to detect: whether an agent checked before claiming absence, reasoned only from evidence available to the actor at the relevant time, and used the correct causal mechanism rather than a plausible one. These correspond to three tracks: Silence, Perspective, and Counterfactual. GroundEval exposes when plausible answers rest on invalid evidence paths, and produces structured per-question diagnostics that pair tool activity with the agent's turn-level narration, making each score inspectable rather than merely reported. Our case studies suggest this failure mode is common rather than exceptional, one that final-answer and judge-based evaluation cannot detect by construction.

Momentum

Related topics

Latest papers 132