Language Model Ensembles

Follow this topic Ask about this topic

Momentum

15 papers in the last four weeks, up 400% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 93

All topics

Beyond Consensus: Trace-Level Synthesis in Mixture of Agents
May 27, 2026Shreyas Fadnavis, Praitayini Kanakaraj, Felix WyssLanguage Model Ensembles Multi-Agent Reasoning
Bioscope AI
Soft Specialists: $α$ -Rényi Ensembles for Uncertainty-Aware LLM Post-Training
May 26, 2026Paula Cordero-Encinar, Georgy Tyukin, Andrew B. DuncanLLM Uncertainty Estimation Language Model Ensembles
Department of Mathematics, Imperial College London · Bessemer AI
DEI: Diversity in Evolutionary Inference for Quality-Diversity Search
May 26, 2026John Donaghy, Shikhar RastogiDistributed Optimization Large Language Model-Guided Optimization
Gensyn
Double Triangle Annotation: A Scalable Human-in-the-Loop Framework for High-Precision Historical Document Annotation
May 25, 2026Yi RenHistorical Document Analysis LLM-Assisted Annotation
École Polytechnique Fédérale de Lausanne
Limited Marginal Benefit of Reasoning-Heavy LLM Deployment in ESG Narrative Scoring: A 4-Model Consensus Study on Japanese Listed Firms
May 22, 2026Hiroyuki KokubuLLM Evaluation Language Model Ensembles
Kansai University
Mixture of Complementary Agents for Robust LLM Ensemble
May 21, 2026Yichi Zhang, Kevin Lu, Yuang Zhang +3Language Model Ensembles Multi-LLM Collaboration
DIMACS, Rutgers University · Department of Mathematics, Rutgers University · Department of Computer Science, George Mason University +1
Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles
May 21, 2026Jinyang Wu, Guocheng Zhai, Ruihan Jin +7LLM Agent Orchestration Language Model Ensembles
1Tsinghua University · 2Zhejiang University · 3The Chinese University of Hong Kong +2
Residual Skill Optimization for Text-to-SQL Ensembles
May 20, 2026Jiongli Zhu, Haoquan Guan, Parjanya Prajakta Prashant +8Text-to-SQL Agent Skill Learning
University of California, San Diego · 2Snowflake AI Research
Ensemble Monitoring for AI Control: Diverse Signals Outweigh More Compute
May 14, 2026Eugene Koran, Yejun Yun, Samantha Tetef +2AI Agent Monitoring AI Control
SPAR · Yale University
Calibrate, Don't Curate: Label-Efficient Estimation from Noisy LLM Judges
May 10, 2026Yanran LiLLM Evaluation LLM-as-a-Judge
Department of Biostatistics Columbia University
POETS: Uncertainty-Aware LLM Optimization via Compute-Efficient Policy Ensembles
May 8, 2026Nicolas Menet, Andreas Krause, Abbas RahimiThompson Sampling Black-Box Optimization
IBM Research – Zurich · Department of Computer Science, ETH Zürich
Nürnberg NLP at PsyDefDetect: Multi-Axis Voter Ensembles for Psychological Defence Mechanism Classification
May 8, 2026Philipp Steigerwald, Eric Rudolph, Jens AlbrechtLanguage Model Ensembles Clinical NLP
Technische Hochschule Nürnberg Georg Simon Ohm
MIPIAD: Multilingual Indirect Prompt Injection Attack Defense with Qwen -- TF-IDF Hybrid and Meta-Ensemble Learning
May 8, 2026Al Muhit Muhtadi, Mostafa Rifat TazwarPrompt Injection Defense Prompt Injection Attacks on LLMs
Bangladesh University of Engineering and Technology
YEZE at SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization via Heterogeneous Ensembling
May 7, 2026Fengze Guo, Yue ChangSocial Media Analysis Text Classification
University of Tübingen
RaguTeam at SemEval-2026 Task 8: Meno and Friends in a Judge-Orchestrated LLM Ensemble for Faithful Multi-Turn Response Generation
May 6, 2026Ivan Bondarenko, Roman Derunets, Oleg Sedukhin +3Language Model Generation Evaluation RAG Evaluation
Novosibirsk State University
Adaptive Consensus in LLM Ensembles via Sequential Evidence Accumulation: Automatic Budget Identification and Calibrated Commit Signals
May 5, 2026Roberto E. MedinaLLM Inference Efficiency Multi-Agent Consensus
Independent Researcher
CLaC at SemEval-2026 Task 6: Response Clarity Detection in Political Discourse
May 4, 2026Nawar Turk, Lucas Miquet-Westphal, Leila KosseimLLM Evaluation Language Model Ensembles
Computational Linguistics at Concordia (CLaC) Lab · Dept. of Computer Science and Software Engineering · Concordia University, Montréal, Québec, Canada
Rethinking LLM Ensembling from the Perspective of Mixture Models
May 1, 2026Jiale Fu, Yuchu Jiang, Peijun Wu +3LLM Inference Acceleration LLM Routing
Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education · Southeast University · Qiyuan Tech +2
Ensembles of Large Language Models for Identifying EQ-5D Studies in PubMed Based on Their Abstracts
Apr 24, 2026Zhyar Rzgar K. Rostam, Márta Péntek, János Tibor Czere +3Evidence Selection Language Model Ensembles
Doctoral School of Applied Informatics and Applied Mathematics, Obuda University, Budapest, Hungary · John von Neumann Faculty of Informatics, Obuda University, Budapest, Hungary · HECON Health Economics Research Center, University Research and Innovation Center, Obuda University, Budapest, Hungary +3
Peer Identity Bias in Multi-Agent LLM Evaluation: An Empirical Study Using the TRUST Democratic Discourse Analysis Pipeline
Apr 24, 2026Juergen DietrichLLM Sycophancy Language Model Bias Evaluation
TRUST Project — democracy-intelligence.de
MKJ at SemEval-2026 Task 9: A Comparative Study of Generalist, Specialist, and Ensemble Strategies for Multilingual Polarization
Apr 23, 2026Maziar Kianimoghadam JouneghaniMultilingual Language Model Evaluation Language Model Ensembles
University of Turin
FUSE: Ensembling Verifiers with Zero Labeled Data
Apr 20, 2026Joonhyuk Lee, Virginia Ma, Sarah Zhao +4Neural Network Verification LLM Evaluation
Stanford University · Google
Efficient Low-Resource Language Adaptation via Multi-Source Dynamic Logit Fusion
Apr 20, 2026Chen Zhang, Jiuheng Lin, Zhiyuan Liao +1Language Model Ensembles Low-Resource Language Processing
Wangxuan Institute of Computer Technology, Peking University
Self-Consistency from Only Two Samples: CoT-PoT Ensembling for Efficient LLM Reasoning
Apr 19, 2026Raman Saparkhan, Majd Hawasly, Md Rizwan Parvez +1LLM Inference Efficiency Self-Consistency Decoding
Carnegie Mellon University Qatar · Qatar Computing Research Institute
StackingNet: Collective Inference Across Independent AI Foundation Models
Feb 14, 2026Siyang Li, Chenhao Liu, Dongrui Wu +2Ensemble Learning Language Model Ensembles
School of Artiﬁcial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China. · School of Civil and Hydraulic Engineering, Huazhong University of Science and Technology, Wuhan 430074, China.
CARE: Confounder-Aware Aggregation for Reliable LLM Evaluation
Feb 9, 2026Jitian Zhao, Changho Shin, Tzu-Heng Huang +2LLM Evaluation LLM-as-a-Judge
Department of Statistics, University of Wisconsin–Madison, Madison, WI, USA · Department of Computer Sciences, University of Wisconsin–Madison, Madison, WI, USA.
Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuum
Jan 20, 2026Víctor Yeste, Paolo RossoMulti-Label Classification Language Model Ensembles
PRHLT Research Center, Universitat Politècnica de València, Valencia, 46022, Spain · School of Science, Engineering and Design, Universidad Europea de Valencia, Valencia, 46010, Spain · Valencian Graduate School and Research Network of Artificial Intelligence (ValgrAI)
AdaFuse: Adaptive Ensemble Decoding with Test-Time Scaling for LLMs
Jan 9, 2026Chengming Cui, Tianxin Wei, Ziyi Chen +6Language Model Decoding Test-Time Scaling
University of Illinois Urbana-Champaign
FusionFactory: Fusing LLM Capabilities with Multi-LLM Log Data
Jul 14, 2025Tao Feng, Haozhen Zhang, Zijie Lei +5LLM Evaluation LLM Routing
University of Illinois Urbana-Champaign · Nanyang Technological University · Meta Monetization AI +2
Ensemble Learning for Large Language Models in Text and Code Generation: A Survey
Mar 13, 2025Mari Ashiga, Wei Jie, Fan Wu +5Mixture-of-Experts Language Models Language Model Ensembles
School of Computing and Engineering, University of West London, London W5 5RF, United Kingdom · Turing Intelligence Technology Limited, London EC2M 2PF, United Kingdom · School of Computer Science, University of Leeds, Leeds LS2 9JT, United Kingdom

May 27, 2026, cs.AIJ/K move · Enter open · S save

Beyond Consensus: Trace-Level Synthesis in Mixture of Agents

Shreyas Fadnavis, Praitayini Kanakaraj, Felix Wyss

Bioscope AI

Language Model Ensembles Multi-Agent Reasoning Multi-LLM Collaboration

Open paper AskPDF arXiv

When multiple LLM agents solve the same problem, standard practice compresses each agent's reasoning into a majority vote or layered synthesis, treating agreement as the finish line. We show this is unnecessarily lossy: an LLM aggregator that reads complete reasoning traces recovers correct solutions even when agents unanimously agree, with beneficial corrections consistently outweighing harmful ones -- the \emph{aggregation paradox}. Majority voting has a ceiling that perturbation diversity does not raise (error correlations are identical); the aggregator's gain comes from trace-level complementarity, assembling correct intermediate steps from minority chains that voting discards. These findings motivate Self-Consistent Mixture of Agents which generates trace diversity through semantic-preserving input perturbations, safeguards the majority via anchored refinement with provable non-degradation guarantees, and always synthesizes -- never gates on consensus. A single model with perturbation-induced trace variation outperforms heterogeneous model pools across structured reasoning, PhD-level science, competition mathematics, and competitive programming. The unit of aggregation should be the reasoning trace, not the answer.

Momentum

Related topics

Latest papers 93