cs.MAMar 20, 2026

When Agents Disagree: The Selection Bottleneck in Multi-Agent LLM Pipelines

Authors: Artem Maryanskyy, Dmitry Budnikov, Alibek T. Kaliyev

Organizations: Uber Technologies, Sunnyvale, CA 94085, USA · Laboratories of Electrical, Thermal Technologies and Energy Saving, Federal Scientific Agroengineering Center VIM, 109428 Moscow, Russia · Department of Computer Science, University of Texas at Austin, Austin, TX 78712, USA

Abstract

Multi-agent LLM pipelines produce contradictory evidence on whether team diversity improves output quality: heterogeneous Mixture-of-Agents teams outperform single models, yet homogeneous Self-MoA teams consistently win under synthesis-based aggregation. We propose a resolution by identifying the selection bottleneck -- a crossover threshold in aggregation quality that determines whether diversity helps or hurts. Under this model, we obtain a closed-form crossover threshold s∗s^* (Proposition 1) that separates the regimes where diversity helps and hurts. In a targeted experiment spanning 42 tasks across 7 categories (N=210N=210), a diverse team with judge-based selection achieves a win rate of 0.810 against a single-model baseline, while a homogeneous team scores 0.512 -- near chance (Glass's Δ=2.07Δ= 2.07). Judge-based selection outperforms MoA-style synthesis by ΔWR=+0.631Δ_{\mathrm{WR}} = +0.631 -- the synthesis approach is preferred over the baseline in zero of 42 tasks by the judge panel. A decoupled evaluation with independent judges confirms all directional findings (Spearman ρ=0.90ρ= 0.90). Exploratory evidence suggests that including a weaker model improves performance while reducing cost (p<10−4p < 10^{-4}, not pre-registered). Our results suggest that selector quality may be a more impactful design lever than generator diversity in single-round generate-then-select pipelines.

Figures & tables

Explore similar work

CardsList
  1. The Interaction Tax: When Communication Erases Diversity in Multi-Agent Teams

    Aug 24, 2026Summer Eunhyung Ann, Haokun Liu, Chenhao TanMulti-Agent LLM SystemsMulti-Agent Collaboration

  2. Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection

    Sep 29, 2026Liangyu Teng, Hengsong Liu, Juncen Guo +4Language Model EnsemblesEnsemble Diversity

  3. Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models

    Sep 26, 2026Leonardo Ferreira, Gardenia Liu, Kaden ZhengMulti-Agent DebateMulti-Agent Systems