Overview

Language model ensembles study how to combine multiple models so their complementary strengths can improve answers, predictions, or evaluations. Common approaches include majority and weighted voting, learned stacking and calibration, query-level routing, logit fusion, and deliberation or verification across agents. These methods are tested on tasks such as mathematical reasoning, question answering, forecasting, text classification, and evaluation by LLM judges, with attention to accuracy, uncertainty, and inference cost. A central tension is that ensembles help most when models make different errors, yet correlated failures are common and adding models or computation does not reliably outperform the strongest individual model.

Latest papers

CardsList

154 papers17 papers in the last four weeks, down 11% on the four weeks before. 0.1% of all new papers.

  1. FusionFactory: Fusing LLM Capabilities with Multi-LLM Log Data

    Jul 14, 2025Tao Feng, Haozhen Zhang, Zijie Lei +5LLM EvaluationLLM Routing

  2. Ensemble Learning for Large Language Models in Text and Code Generation: A Survey

    Mar 13, 2025Mari Ashiga, Wei Jie, Fan Wu +5Mixture-of-Experts Language ModelsLanguage Model Ensembles

  3. Dynamic Optimizations of LLM Ensembles with Two-Stage Reinforcement Learning Agents

    Feb 6, 2025Selim Furkan Tekin, Gaowen Liu, Ramana Rao Kompella +1Multi-Agent LLM SystemsLanguage Model Ensembles

  4. Tuning Language Models by Mixture-of-Depths Ensemble

    Oct 16, 2024Haoyan Luo, Lucia SpeciaLLM Fine-TuningLanguage Model Ensembles