LLM Routing

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

30 papers in the last four weeks, up 88% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 224

All topics

SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks
Jun 30, 2026Seongho Son, Sangwoong Yoon, Jiahua Tang +3Software Engineering Agents LLM Agent Workflow Optimization
University College London, United Kingdom · Ulsan National Institute of Science and Technology, South Korea · PSL Research University, France +1
SemJoin: Semantic Join Optimization
Jun 28, 2026Christopher Gou, Aditya Banerjee, Jiaxuan Wang +1Large Language Model-Guided Optimization Cost-Aware Inference
Purdue University
EntroRouter: Learning Efficient Model Routing via Entropy Regulation
Jun 28, 2026Kaiyi Zhang, Xueliang Zhao, Zhuocheng Gong +2Adaptive Model Routing Cost-Aware Inference
Gaoling School of Artificial Intelligence, Renmin University of China · Ant International · The University of Hong Kong +1
TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs
Jun 28, 2026Shucan Ji, Yining Huang, Hongliang GuoLow-Rank Adaptation Medical QA
College of Computer Science, Sichuan University, Chengdu, China · Meta Emergence Laboratory
When LLMs Develop Languages: Symbolic Communication for Efficient Multi-Agent Reasoning
Jun 28, 2026Zhengqi Pei, Qingming Huang, Shuhui WangMulti-Agent LLM Systems Efficient Language Model Reasoning
State Key Lab of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China. · School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China.
Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving
Jun 25, 2026Yasmin Moslem, Magdalena Kacmajor, Vasudevan Nedumpozhimana +11LLM Serving Cost-Aware Inference
1ADAPT Centre, Trinity College Dublin · 2Huawei Research
When Does Combining Language Models Help? A Co-Failure Ceiling on Routing, Voting, and Mixture-of-Agents Across 67 Frontier Models
Jun 25, 2026Josef ChenLLM Evaluation LLM Routing
KAIKAKU
The Capability Frontier: Benchmarks Miss 82% of Model Performance
Jun 25, 2026Bradley Fowler, Ryan Smith, Daniel Thi Graviet +8LLM Evaluation Language Model Generation Evaluation
1Martian · 3ThoughtWorks · University of Oxford
Efficient and Trainable Language Model Test-Time Scaling via Local Branch Routing
Jun 24, 2026Yutong Yin, Mingyu Jin, Jin Pan +12RL for Language Model Reasoning Test-Time Scaling
1Northwestern University · 2Rutgers University · University of Wisconsin–Madison +7
DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models
Jun 22, 2026Jungseob Lee, Seongtae Hong, Seungjun Lee +7LLM Routing Efficient Language Model Inference
Korea University · 242dot · Konkuk University +3
Agent-as-a-Router: Agentic Model Routing for Coding Tasks
Jun 22, 2026Pengfei Zhou, Zhiwei Tang, Yixing Ma +8AI Coding Agents AI Agent Benchmarks
1National University of Singapore · 2DAMO Academy, Alibaba Group · 3Hupan Lab +3
RLM-Cascade: Response-Level Speculative Decoding for Cost-Efficient LLM API Serving
Jun 22, 2026Haifeng Wu, Srinivasan Manoharan, Fangbo Tu +2LLM Inference Serving Speculative Decoding
PayPal
Does the Same Token Mean the Same State? MoE Routing as Signal for Reasoning Control
Jun 22, 2026Kang Chen, Minshen Yu, Junjie Nian +3Mixture-of-Experts Language Models LLM Routing
Fudan University · Shanghai Innovation Institute
Is Our Benchmark Enough? An Analysis of Continual Learning for MLLMs
Jun 18, 2026Van-Tuan Tran, Shruthi Gowda, Merim Dzaferagic +1Continual Learning LLM Routing
School of Computer Science and Statistics, Trinity College Dublin, Ireland · Department of Mathematics and Computer Science, Eindhoven University of Technology, The Netherlands
ARIADNE: Agnostic Routing for Inference-time Adapter DyNamic sElection
Jun 17, 2026Enrico Cassano, Michał Brzozowski, Zuzanna Dubanowska +2LLM Routing
University of Turin · Samsung AI Center, Warsaw, Poland
RouteJudge: An Open Platform for Reproducible and Preference-Aware LLM Routing
Jun 17, 2026Guannan Lai, Haoran Hu, Han-Jia YeLLM Evaluation Pairwise Preference Evaluation
School of Artificial Intelligence, Nanjing University, China · 2National Key Laboratory for Novel Software Technology, Nanjing University, 210023, China · 3SinapisAI
SoftMoE: Soft Differentiable Routing for Mixture-of-Experts in LLMs
Jun 16, 2026Mikołaj Zasada, Łukasz Struski, Jacek Tabor +1Mixture-of-Experts Language Models Sparse Mixture-of-Experts
AGH University of Krakow, Poland · Faculty of Mathematics and Computer Science, Jagiellonian University, Poland · Jagiellonian University, Poland +1
FairTutor: Equity-Aware Pedagogical LLM Routing for Budget-Constrained AI Tutoring
Jun 16, 2026Qingyang XuIntelligent Tutoring Systems AI in Education
Independent researcher, Shanghai, China
DecoSearch: Complexity-Aware Routing and Plan-Level Repair for Text-to-SQL
Jun 16, 2026Esteban Schafir, Xu Zheng, Hojat Allah Salehi +4Schema Linking Question Decomposition
Florida International University · NEC-Labs · Singapore Management University
Online LLM Selection via Constrained Bandits with Time-Varying Demand
Jun 16, 2026Yin Huang, Qingsong Liu, Jie XuMulti-Armed Bandits Cost-Aware Inference
Department of Electrical and Computer Engineering, University of Florida · Manning College of Information and Computer Sciences, University of Massachusetts Amherst
Conversational Query Engine for Mixed-Modality Heterogeneous Enterprise Data Sources
Jun 15, 2026Darshita Rathore, Vineet Kumar, Vaibhav Singal +2LLM Routing
PayPal Artificial Intelligence Bengaluru, India
ChatPlanner: A Large Language Model Framework for Personalized Public Transit Routing
Jun 13, 2026Tingting Yang, Chenhao Xue, Jun ChenIntelligent Transportation Systems LLM Routing
School of Engineering and Materials Science, Queen Mary University of London Mile End Road, London, E1 4NS, United Kingdom · Department of Engineering Science, University of Oxford Parks Road, Oxford, OX1 3PJ, United Kingdom
Forced Deferral: Manipulating Routing Decisions in Multimodal LLM Cascades
Jun 13, 2026Zhongye Liu, Yaopei Zeng, Yurui Chang +1Adversarial Attacks on VLMs Multimodal Robustness
Pennsylvania State University
When to Write and When to Suppress: Route-Specialized Dual Adapters for Memory-Assisted Knowledge Editing
Jun 12, 2026Baijia Zhang, Yining HuangKnowledge Editing Factual Knowledge in Language Models
Xinjiang University · Meta Emergence Laboratory
A theoretical model for task routing in mixture-of-expert transformers
Jun 12, 2026Vinoth Nandakumar, Yongli Xiang, Yunzhi Yao +2Transformer Expressivity Mixture of Experts
University of Sydney · Zhejiang University · Google Research
Cost-Optimal LLM Routing with Limited User Feedback under User Satisfaction Guarantees
Jun 12, 2026Herbert Woisetschläger, Arastun Mammadli, Ryan Zhang +1Cost-Aware Inference LLM Routing
Technical University of Munich Germany · University of Exeter United Kingdom · Horace Greeley High School United States
STREAM: Multi-Tier LLM Inference Middleware with Dual-Channel HPC Token Streaming
Jun 11, 2026Anas Nassar, Steve Mohr, Leonard Apanasevich +1LLM Serving LLM Inference
Advanced Cyberinfrastructure for Education and Research (ACER) University of Illinois Chicago Chicago, Illinois, USA
Brick: Spatial Capability Routing for the Mixture-of-Models (MoM) Paradigm
Jun 11, 2026Francesco Massa, Marco CristofanilliAdaptive Model Routing Cost-Aware Inference
ARMOR-MAD: Adaptive Routing for Heterogeneous Multi-Agent Debate in Large Language Model Reasoning
Jun 11, 2026Fuqiang Niu, Bowen ZhangMulti-Agent Debate Multi-Agent Consensus
School of Cyber Science and Technology, University of Science and Technology of China, Hefei, China · School of Artificial Intelligence, Shenzhen Technology University, Shenzhen, China
When Does Routing Become Interpretable? Causal Probes on Block Attention Residuals
Jun 11, 2026Aydin JavadovTransformer Interpretability Attention Residual Connections
ETH Zurich

Jun 30, 2026, cs.SEJ/K move · Enter open · S save

SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks

Seongho Son, Sangwoong Yoon, Jiahua Tang, Shuhan Wang+2

University College London, United Kingdom · Ulsan National Institute of Science and Technology, South Korea · PSL Research University, France+1

Software Engineering Agents LLM Agent Workflow Optimization LLM Routing LLM Agent Harnesses LLM Agent Routing

Open paper AskPDF arXiv

Large language models (LLMs) embedded in multi-turn agentic harnesses are reshaping software engineering (SWE), but routing every task to a frontier model is wasteful when many issues admit cheap fixes. Existing LLM routers operate on the task description alone, which inherits an information-theoretic Bayes-error floor in agentic settings: a similar issue can hide either a localized typo or a multi-module refactor, and the prompt does not separate the two. We introduce SWE-Router, a value-based temporal approach that lets a cheap model run for a few exploratory turns and reads the resulting partial trajectory before deciding whether to continue cheaply or to escalate to an expensive model. We provide a Bayes-optimality theorem showing that conditioning on the partial trajectory never harms routing and is strictly better whenever exploration is informative. Across the LLM pairs of weak and strong models spanning the contemporary cost--capability frontier, we show that SWE-Router greatly improves the cost efficiency of SWE tasks, while maintaining the majority of the performances of the stronger model. We additionally release a multi-LLM trajectory dataset which allows reproduction of our trajectory-level routing.

Momentum

Related topics

Latest papers 224