cs.AINov 19, 2026

ADAPT: Adaptive Decision and Abstention with Pool-Size-Aware Thresholds for Service Routing

Authors: Manile Srun, Muntasir Adnan, Arslan Shaukat, Carlos C. N. Kuhn

Organizations: Open Source Institute, Faculty of Science and Technology, University of Canberra, Canberra, Australia.

Abstract

Retrieval-based classifiers efficiently route queries to specialised services, but they typically select a candidate even when no suitable service exists. We introduce Adaptive Decision and Abstention with Pool-Size-Aware Thresholds for Service Routing (ADAPT), a lightweight routing architecture with an explicit fallback option that enables queries to abstain from specialist selection. ADAPT uses the separation between the highest relevance score and the candidate score distribution as routing confidence. Experiments across retrieval models and increasing numbers of services reveal a consistent empirical behaviour: the confidence distribution changes systematically with candidate-pool size K, making fixed abstention thresholds increasingly miscalibrated. ADAPT addresses this effect with a K-aware threshold that adapts as services are added without classifier retraining. Evaluation across two specialist datasets shows that this simple mechanism provides an effective accuracy-cost trade-off compared with generative LLM routing, supporting lightweight and dynamically extensible service-routing architectures.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. VDAR-Router: Adaptive LLMs Routing via Verbalized Query Difficulty Analysis Retrieval

    Jul 20, 2026Yu-Chien Tang, Jun-Chen Hung, Wen-Chih Peng +1LLM Inference EfficiencyAdaptive Model Routing

  2. Flexible Routing via Uncertainty Decomposition

    May 8, 2026Charlotte Peale, Siddartha Devic, Parikshit Gopalan +2Uncertainty QuantificationAdaptive Model Routing