TACIT-Switch: Cost-Aware Model Escalation for LLM Agents from Censored Supervision
Organizations: School of Statistics Beijing Normal University Beijing 100875, China · Department of Applied Mathematics The Hong Kong Polytechnic University Hung Hom, Kowloon, Hong Kong SAR, China
Abstract
Agents with smaller language-model backbones are less expensive but can drift into persistent failure modes, whereas those with larger backbones are generally more reliable but more costly. This reliability-cost trade-off motivates routing methods that decide when to invoke an agent with a larger backbone: before execution, after a fixed trajectory prefix, or locally at individual steps. Our method, TACIT-SWITCH, learns permanent handoff policies from accumulated trajectory evidence and Teacher-Annotated Censored Intervention Times (TACIT). It represents each annotation as an interval-censored observation on a cumulative-risk scale. The resulting mixture-cure threshold model estimates the probability that the paired Strong rollout succeeds and, conditional on success, the handoff threshold; no teacher is required at deployment. In a mechanism-based multi-step simulation, TACIT-SWITCH improves success by 7.4-11.1 percentage points over task-level, step-level, and fixed-prefix routing baselines at comparable cost. Within that controlled simulation, ablations show that task features and cumulative trajectory risk provide complementary information. With operating points selected on development data, TACIT-SWITCH achieves the highest held-out success among learned policies on both ALFWorld (48.5% with 4B Cheap; 45.5% with 9B Cheap) and DABench (73.1%).
Figures & tables
| Type | Paired outcomes | Likelihood evidence |
|---|---|---|
| 01 | cheap fails, strong succeeds | paired-Strong success; interval (or time missing) |
| 11 | both succeed | paired-Strong success; right censoring |
| 10 | cheap succeeds, strong fails | operational cure component |
| 00 | both fail | operational cure component |
| Benchmark | Policy | Success | Avg. cost | Strong share |
|---|---|---|---|---|
| DABench Test67 | Pure 9B | 40/67 (59.7%) | 13.23 | 0.0% |
| Task router | 45/67 (67.2%) | 30.12 | 68.3% | |
| Step deferral | 45/67 (67.2%) | 24.15 | 22.9% | |
| SWE-Router ( ) | 45/67 (67.2%) | 27.55 | 47.3% | |
| TACIT-Switch † | 49/67 (73.1%) | 19.81 | 33.3% | |
| Pure 27B | 46/67 (68.7%) | 38.59 | 100.0% |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Pair | Policy | Success | Avg. cost | Strong share | Intervention |
|---|---|---|---|---|---|
| 4B–27B | Pure 4B | 14/274 (5.1%) | 48.32 | 0.0% | 0.0% |
| Task Router | 113/274 (41.2%) | 184.69 | 70.0% | 75.5% | |
| Step Deferral | 119/274 (43.4%) | 168.05 | 35.0% | 100.0% | |
| SWE-Router ( ) | 134/274 (48.9%) | 192.75 | 70.5% | 81.8% | |
| TACIT-Switch † | 151/274 (55.1%) | 176.87 | 79.1% | 95.6% | |
| Pure 27B | 163/274 (59.5%) | 208.02 | 100.0% | 100.0% |
LLM Agent Routing
LLM agent routing selects models, tools, skills, or collaboration workflows for each task or step to balance capability, cost, latency, and reliability.
See all 96 papers