Ares: Adaptive Reasoning Effort Selection for Efficient LLM Agents
Organizations: Department of Computer Science, University of California, Santa Barbara · Center for Advanced AI, Accenture
Abstract
Modern agents powered by thinking LLMs achieve high accuracy through long chain-of-thought reasoning but incur substantial inference costs. While many LLMs now support configurable reasoning levels (e.g., high/medium/low), static strategies are often ineffective: using low-effort modes at every step leads to significant performance degradation, while random selection fails to preserve accuracy or provide meaningful cost reduction. However, agents should reserve high reasoning effort for difficult steps like navigating complex website structures, while using lower-effort modes for simpler steps like opening a target URL. In this paper, we propose Ares, a framework for per-step dynamic reasoning effort selection tailored for multi-step agent tasks. Ares employs a lightweight router to predict the lowest appropriate reasoning level for each step based on the interaction history. To train this router, we develop a data generation pipeline that identifies the minimum reasoning effort required for successful step completion. We then fine-tune the router to predict these levels, enabling plug-and-play integration for any LLM agents. We evaluate Ares on a diverse set of agent tasks, including TAU-Bench for tool use agents, BrowseComp-Plus for deep-research agents, and WebArena for web agents. Experimental results show that Ares reduces reasoning token usage by up to 52.7% compared to fixed high-effort reasoning, while introducing minimal degradation in task success rates.
Figures & tables
| Performance | Efficiency (Token Consumption) | |||||||||
| Method | Acc. (%) | |||||||||
| TAU-Bench Retail | ||||||||||
| Rule -based | Low | 35.0 | {\color[rgb]{1,0.23,0.13}\uparrow 19.8} | 13.5 | 25k | {\color[rgb]{0.15,1,0.67}\uparrow 627k} | 223 | {\color[rgb]{0.15,1,0.67}\uparrow 5454} | 15 | {\color[rgb]{0.15,1,0.67}\uparrow 373} |
| Medium | 47.3 | {\color[rgb]{1,0.23,0.13}\uparrow 7.5} | 14.5 | 137k | {\color[rgb]{0.15,1,0.67}\uparrow 515k} | 1198 | {\color[rgb]{0.15,1,0.67}\uparrow 4479} | 82 | {\color[rgb]{0.15,1,0.67}\uparrow 306} | |
| High | 54.8 | {\color[rgb]{0.15,1,0.67}\downarrow 0.0} | 13.8 | 1007k | {\color[rgb]{1,0.23,0.13}\downarrow 355k} | 8756 | {\color[rgb]{1,0.23,0.13}\downarrow 3079} | 634 | {\color[rgb]{1,0.23,0.13}\downarrow 246} | |
| Random | 43.5 | {\color[rgb]{1,0.23,0.13}\uparrow 11.3} | 14.5 | 359k | {\color[rgb]{0.15,1,0.67}\uparrow 293k} | 3126 | {\color[rgb]{0.15,1,0.67}\uparrow 2550} | 215 | {\color[rgb]{0.15,1,0.67}\uparrow 172} | |
| Performance | Efficiency (Token Consumption) | |||||||||
| Method | Acc. (%) | |||||||||
| TAU-Bench Retail | ||||||||||
| Rule -based | Low | 35.0 | {\color[rgb]{1,0.23,0.13}\uparrow 23.5} | 13.5 | 25k | {\color[rgb]{0.15,1,0.67}\uparrow 451k} | 223 | {\color[rgb]{0.15,1,0.67}\uparrow 3918} | 15 | {\color[rgb]{0.15,1,0.67}\uparrow 271} |
| Medium | 47.3 | {\color[rgb]{1,0.23,0.13}\uparrow 11.2} | 14.5 | 137k | {\color[rgb]{0.15,1,0.67}\uparrow 339k} | 1198 | {\color[rgb]{0.15,1,0.67}\uparrow 2943} | 82 | {\color[rgb]{0.15,1,0.67}\uparrow 204} | |
| High | 54.8 | {\color[rgb]{1,0.23,0.13}\uparrow 3.7} | 13.8 | 1007k | {\color[rgb]{1,0.23,0.13}\downarrow 531k} | 8756 | {\color[rgb]{1,0.23,0.13}\downarrow 4615} | 634 | {\color[rgb]{1,0.23,0.13}\downarrow 348} | |
| Random | 43.5 | {\color[rgb]{1,0.23,0.13}\uparrow 15.0} | 14.5 | 359k | {\color[rgb]{0.15,1,0.67}\uparrow 117k} | 3126 | {\color[rgb]{0.15,1,0.67}\uparrow 1015} | 215 | {\color[rgb]{0.15,1,0.67}\uparrow 71} | |
| Setting | Acc. (%) | ||||
| Low | 35.0 | {\color[rgb]{1,0.23,0.13}\uparrow 19.8} | 25k | 223 | 15 |
| Medium | 47.3 | {\color[rgb]{1,0.23,0.13}\uparrow 7.5} | 137k | 1198 | 82 |
| High | 54.8 | {\color[rgb]{0.15,1,0.67}\downarrow 0.0} | 1007k | 8756 | 634 |
| – SFT | 41.7 | {\color[rgb]{1,0.23,0.13}\uparrow 13.1} | 128k | 1113 | 74 |
| – Rationale | 51.3 | {\color[rgb]{1,0.23,0.13}\uparrow 3.5} | 474k | 4128 | 285 |
| Ares (SFT) | 54.8 | - | 652k | 5677 | 388 |
| Setting | Acc. (%) | ||||
| Low | 32.0 | {\color[rgb]{1,0.23,0.13}\uparrow 10.0} | 12k | 250 | 23 |
| Medium | 42.0 | {\color[rgb]{0.15,1,0.67}\downarrow 0.0} | 98k | 1961 | 148 |
| High | 36.0 | {\color[rgb]{1,0.23,0.13}\uparrow 6.0} | 873k | 17472 | 1654 |
| w/o normalization | 41.3 | {\color[rgb]{1,0.23,0.13}\uparrow 0.7} | 157k | 3140 | 312 |
| normalization | 42.0 | – | 133k | 2653 | 231 |
| Setting | Acc. (%) | ||||
| Low | 49.4 | {\color[rgb]{1,0.23,0.13}\uparrow 15.8} | 26k | 231 | 17 |
| Medium | 62.0 | {\color[rgb]{1,0.23,0.13}\uparrow 3.2} | 111k | 972 | 74 |
| High | 67.8 | {\color[rgb]{0.15,1,0.67}\downarrow 2.6} | 558k | 4856 | 380 |
| Ares | 65.2 | - | 428k | 3729 | 293 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Total | High | Medium | Low |
| TAU-Bench | 43,358 | 12,261 | 6,222 | 24,875 |
| BrowseComp-Plus | 12,366 | 6,184 | 3,091 | 3,091 |
| WebArena | 1,718 | 1,095 | 72 | 551 |
Efficient Language Model Reasoning
Efficient language model reasoning studies how to improve problem-solving accuracy while reducing inference, memory, latency, and training costs.
See all 370 papers