Beyond Clumsy Agentic Tool Calling: How Cueing and Spotting Make the Difference
Organizations: School of Computer Science and Technology, Tongji University, Shanghai, China · Shanghai Highly Electrical Appliance Co., Ltd, Shanghai, China
Abstract
LLM-based task-oriented agents depend on tools to interact with their environments, but may overlook execution feedback, repeat ineffective calls, or persist with unproductive strategies. These behaviors can hinder agents' ability to use tools autonomously and sustain task progress. We characterize tool-use symptoms at two temporal granularities: local clumsy tool-use behaviors and tool-use detours spanning multiple interactions. Towards greater autonomy in tool use, we present ToolPulse, an online middleware supporting autonomous tool use through cueing and spotting. ToolPulse tracks execution state and temporal interaction patterns, monitoring proposed calls before dispatch and inspecting execution feedback prior to the agent resumes reasoning. It combines state-based rules, semantic sequence analysis, and interaction-feature similarity to identify intervention opportunities and provide verbal reminders, structured feedback, or context-specific advice from auxiliary models. Our process-oriented evaluation distinguishes trigger validity, behavioral cessation, and substantive correction alongside task outcomes and resource costs. Using SWE-agent with three backbone models, we evaluate 1,350 trajectories on 90 Python, C++, and Java bug-fix tasks, comparing unassisted execution with four assistance strategies. Substantive responses follow 61.6-90.9% of valid triggers for tool-use detours. Concise reminders achieve the highest observed aggregate substantive-response rate; more elaborate assistance offers symptom-dependent benefits and can be less effective. Aggregate repair outcomes remain close to baseline, with token savings in selected settings. These findings support proactive runtime assistance for autonomous tool use. The gap between behavioral adjustment and aggregate repair gains calls for careful decisions on intervention timing and assistance strategy in autonomous agents.
Figures & tables
| Group | Trajectory Representation | Sequence Detection |
| G1 | A sequence of discrete symbols, each representing a tool name. | Sequitur identifies recurring and nested tool-name sequences through incremental hierarchical grammar induction ( Nevill-Manning and Witten, 1997 ) . |
| G2 | A sequence of bug-fix-oriented labels assigned to interactions according to their function and execution result. | Sequitur identifies recurring functional patterns, allowing calls with different tool names or arguments to share the same symbolic representation. |
| G3 | A sequence of numerical feature vectors describing model behavior and task state. | Matrix Profile identifies approximately recurring trajectory segments through nearest-neighbor distances between fixed-length subsequences ( Yeh et al., 2016 ) . |
| Functional Level | Label | Meaning |
| Retrieve | Ls | search |
| Lt | targeted read | |
| Lb | browse whole file | |
| Operate | E | environment setup |
| P | edit | |
| Ps | edit with syntax error |
| LLM | Task | Baseline | Intervention Strategy | ||
| Sequitur | Semantic Sequitur | Matrix Profile | |||
| DeepSeek-V4-Pro | 30 | 21 | 21 (2/2) | 22 (1/0) | 21 (2/2) |
| Qwen3-Coder-Plus | 30 | 19 | 18 (1/2) | 18 (0/1) | 17 (0/2) |
| Model | Group | Duplicate Action (%) | Loop Action (%) | Failed Action | |||
| Escape | Recurrence | Any-pattern | Same-pattern | Mean | Max | ||
| DeepSeek-V4-Pro | Baseline | 100.00 (3/3) | 0.00 (0/3) | 33.33 (1/3) 0.00 (0/1) 88.89 (32/36) | 0.00 (0/3) 0.00 (0/1) 61.11 (22/36) | 8.66 | 22 |
| Sequitur | 80.00 (4/5) | 0.00 (0/5) | 0.00 (0/2) | 0.00 (0/2) | 8.17 | 46 | |
| Semantic Sequitur | 58.33 (7/12) | 11.11 (1/9) | 0.00 (0/3) | 0.00 (0/3) | 7.76 | 33 | |
| Matrix Profile | 88.89 (8/9) | 12.50 (1/8) | 75.00 (21/28) | 50.00 (14/28) | 7.55 | 24 | |
| Qwen3-Coder-Plus | Baseline | N/A | N/A | 25.00 (1/4) 0.00 (0/1) 84.21 (16/19) | 0.00 (0/4) 0.00 (0/1) 63.16 (12/19) | 7.30 | 11 |
| Dimension | Symptom | Category | Description |
| Exploration | Wandering Flood | Clumsy tool-use behavior | Excessive exploration whose scope is insufficiently constrained and may incur substantial hidden costs. |
| Progress | Calling Repetition | Clumsy tool-use behavior | Consecutive calls with identical tool names and arguments. |
| Progress | Functional Cycle | Tool-use detour | Periodic repetition of an ordered sequence of actions with the same semantic functions. |
| Progress | Strategic Fixation | Tool-use detour | Sustained similarity in multistep interaction features within a short sliding window. |
| Grounding | Blind Command | Clumsy tool-use behavior | A potentially risky action taken before the relevant environment state has been established through observation. |
| Recovery | Failure Inertia | Tool-use detour | Repeated tool failures without a substantive recovery action. |
| Symptom | Affected Trajectory | Event | Valid | Ceased | Substantive Response |
| Calling Repetition | 34 / 1,080 | 164 | Rule-defined | 80 / 164 (84 persists) | 20 / 80 (60 non-substantive) |
| Functional Cycle | 42 / 1,080 | 48 | 29 / 48 (19 invalid) | 19 / 29 (10 persists) | 19 / 19 (0 non-substantive) |
| Strategic Fixation | 570 / 1,080 | 1,841 | 1,134 / 1,841 (700 invalid) | 715 / 1,134 (417 persists) | 699 / 715 (16 non-substantive) |
| Blind Command | 36 / 1,080 | 86 | Rule-defined | 67 / 86 (19 persists) | 41 / 67 (26 non-substantive) |
| Failure Inertia | 101 / 1,080 | 154 | 110 / 154 (42 invalid) | 100 / 110 (10 persists) | 100 / 100 (0 non-substantive) |
| Symptom | Candidate Trajectory | Event | Verdict | Positive Trajectory |
| Wandering Flood | 935 / 1,350 | 3,191 candidates judged | 799 / 3,191 (2,391 no) | 400 / 1,350 |
| Symptom | Reminder-Only Verbal Cueing | Guided Verbal Cueing | Visual Cueing | Tactile Spotting |
| Calling Repetition | 16, [0.09]; 4/16 | 27, [0.15]; 6/27 | 68, [0.38]; 4/68 | 53, [0.30]; 6/53 |
| Functional Cycle | 12, [0.07]; 7/9 | 15, [0.09]; 6/11 | 15, [0.08]; 6/7 | 6, [0.03]; 0/2 |
| Strategic Fixation | 236, [1.35]; 118/169 | 236, [1.35]; 96/162 | 245, [1.39]; 106/171 | 1,124, [6.40]; 379/632 |
| Blind Command | 16, [0.09]; 9/16 | 14, [0.08]; 11/14 | 16, [0.09]; 10/16 | 40, [0.23]; 11/40 |
| Failure Inertia | 32, [0.18]; 20/23 | 43, [0.25]; 22/24 | 36, [0.20]; 26/27 | 43, [0.24]; 32/36 |
| Condition | Trajectory with Run | Trigger in Runs | Run Length |
| Reminder-Only | 0 / 140 | 0 / 236 | N/A |
| Guided Verbal Cueing | 0 / 140 | 0 / 236 | N/A |
| Visual Cueing | 0 / 146 | 0 / 245 | N/A |
| Tactile Spotting | 107 / 144 | 974 / 1,124 | 3 [2, 5], 30 |
| Language | LLM | Task | Baseline | Assistance Strategy | |||
| Reminder-Only Verbal Cueing | Guided Verbal Cueing | Visual Cueing | Tactile Spotting | ||||
| Python | DeepSeek-V4-Pro | 30 | 21 | 22 (2/1) | 22 (2/1) | 22 (1/0) | 23 (2/0) |
| Qwen3-Coder-Plus | 30 | 19 | 18 (1/2) | 18 (2/3) | 17 (0/2) | 17 (0/2) | |
| Qwen3.6-27B | 30 | 21 | 20 (1/2) | 21 (1/1) | 21 (2/2) | 22 (2/1) | |
| C++ | DeepSeek-V4-Pro | 30 | 12 | 12 (1/1) | 12 (0/0) | 11 (0/1) | 12 (1/1) |
| Qwen3-Coder-Plus | 30 | 5 | 6 (2/1) | 7 (2/0) | 5 (1/1) | 6 (3/2) | |
| Related work | Main approach | ToolPulse’s advantage |
| ACE ( Zhang et al., 2026 ) | Supplies accumulated playbook strategies as context for new tasks, refining reusable guidance through reflection and curation of execution experience. | Activates guidance when a tool-use symptom is detected, matching the cue and its delivery point to current execution evidence. |
| Wink ( Nanda et al., 2026 ) | Inspects trajectories asynchronously at fixed step intervals, providing corrective guidance when an observer’s assessment becomes available to the agent. | Inspects every tool interaction before and after execution, enabling call interception and feedback-grounded assistance at the corresponding decision point. |
| LivePlan ( Liu et al., 2026 ) | Detects drift through graph revisits, repeated cycles, and prolonged or missing problem-solving phases, then supplies corresponding corrective advice. | Combines semantic sequence detection with continuous interaction-feature similarity, adding approximate multistep recurrence to the conditions that can trigger assistance. |
| Outcome Monitors ( Panthi and Abdelfattah, 2026 ) | Checks individual tool results against outcome contracts and appends violation receipts that identify diagnostic evidence and publicly available recovery tools. | Extends monitoring to relationships across calls, capturing functional cycles and strategic fixation even when individual tool results remain valid. |
| Sentry ( Ji et al., 2026 ) | Uses LLM-based failure diagnosis and an evolving playbook of verified recoveries to select guidance for the agent’s current difficulty. | Determines intervention triggers through executable state and temporal criteria, enabling direct replay of detection decisions from recorded tool interactions. |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| No. | Difficulty | Task instance ID |
| 1 | Easy | astropy__astropy-7166 |
| 2 | Easy | django__django-13516 |
| 3 | Easy | django__django-13794 |
| 4 | Easy | fastapi__fastapi-1524 |
| 5 | Easy | psf__requests-1921 |
| 6 | Easy | pytest-dev__pytest-7982 |
| No. | Difficulty | Task instance ID |
| 1 | Easy | catchorg__Catch2_2288 |
| 2 | Easy | fmtlib__fmt_1390 |
| 3 | Easy | fmtlib__fmt_1407 |
| 4 | Easy | fmtlib__fmt_2070 |
| 5 | Easy | fmtlib__fmt_2310 |
| 6 | Easy | fmtlib__fmt_2940 |
| No. | Difficulty | Task instance ID |
| 1 | Easy | alibaba__fastjson2_2559 |
| 2 | Easy | apache__dubbo_11781 |
| 3 | Easy | elastic__logstash_15697 |
| 4 | Easy | fasterxml__jackson-core_1142 |
| 5 | Easy | fasterxml__jackson-core_1208 |
| 6 | Easy | fasterxml__jackson-databind_4050 |
| Assessment field | Agreement | Expert revisions or evidence check |
| trigger_validity | 87/100 (87%) | 12 valid invalid ; 1 unclear invalid . |
| behavior_after_trigger | 97/100 (97%) | 2 ceases persists ; 1 persists unclear . |
| corrective_response | 98/100 (98%) | 1 substantive non_substantive ; 1 unclear non_substantive . |
Tool-Using Agents
Tool-using agents plan and act through external tools, APIs, software interfaces, and environments to complete tasks beyond language generation.
See all 306 papers