LLM Agent Routing

LLM: Large Language Model

Ask about this topic

Overview

LLM agent routing studies how to match tasks and changing execution states with suitable models, tools, skills, or groups of agents. Common approaches include retrieval and reranking over capability descriptions, learned classifiers and contextual bandits, reinforcement-learning orchestrators, and confidence- or progress-based escalation; some systems also impose workflow, budget, or safety constraints. Evaluation spans tool use, coding, question answering, and long-horizon interactive tasks, with growing attention to end-to-end success, latency, token cost, and recovery from failures. The central challenge is showing that routing reliably beats a strong fixed choice: gains can be sensitive to noisy feedback, changing task distributions, large or deceptive capability catalogs, and the difficulty of evaluating stateful handoffs.

Latest papers

CardsList

99 papers16 papers in the last four weeks, up 14% on the four weeks before. 0.1% of all new papers.

  1. Cascade-Aware Multi-Agent Routing: Spatio-Temporal Sidecars and Geometry-Switching

    Mar 17, 2026Davide Di GioiaLLM Agent Routing

  2. The Provenance Paradox in Multi-Agent LLM Routing: Delegation Contracts and Attested Identity in LDP

    Mar 15, 2026Sunil PrakashLLM Agent RoutingAI Agent Governance

    Indian School of Business, Hyderabad, India

  3. Efficient and Interpretable Multi-Agent LLM Routing via Ant Colony Optimization

    Mar 13, 2026Xudong Wang, Chaoning Zhang, Jiaquan Zhang +8LLM Agent RoutingLLM Routing

    School of Computing, Kyung Hee University, Yongin-si 17104, South Korea · School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China · School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China +1

  4. Adaptive Vision-Language Model Routing for Computer Use Agents

    Mar 13, 2026Xunzhuo Liu, Bowei He, Xue Liu +3LLM Agent RoutingComputer-Use Agents

    vLLM Semantic Router Project · MBZUAI · McGill University +2

  5. Did You Check the Right Pocket? Cost-Sensitive Store Routing for Memory-Augmented Agents

    Mar 8, 2026Madhava GaikwadMemory-Augmented AgentsAgent Memory Management

  6. Graph-Based Self-Healing Tool Routing for Cost-Efficient LLM Agents

    Mar 2, 2026Neeraj BholaniLLM Agent OrchestrationLLM Agent Routing

  7. Training-Free Agentic AI: Probabilistic Control and Coordination in Multi-Agent LLM Systems

    Feb 24, 2026Mohammad Parsa Hosseini, Ankit Shah, Saiyra Qureshi +3Multi-Agent LLM SystemsLLM Agent Orchestration

    Accenture.

  8. SkillOrchestra: Learning to Route Agents via Skill Transfer

    Feb 23, 2026Jiayu Wang, Yifei Ming, Zixuan Ke +3LLM Agent OrchestrationLLM Agent Routing

    University of Wisconsin-Madison · Salesforce AI Research

  9. Nalar: Workflow-Aware Management of Agentic Applications

    Jan 8, 2026Saurabh Agarwal, Marco Laju, Donghyun Son +4LLM Inference EfficiencyLLM Agent Orchestration

    UT-Austin · Cisco-Research