cs.AIFeb 25, 2026

Epistemic Filtering and Collective Hallucination: A Jury Theorem for Confidence-Calibrated Agents

Authors: Jonas Karge

Organizations: Technische Universität Dresden

Abstract

We investigate the collective accuracy of heterogeneous agents who learn to estimate their own reliability over time and selectively abstain from voting. While classical epistemic voting results, such as the Condorcet Jury Theorem (CJT), assume fixed participation, real-world aggregation often benefits from allowing agents to say ``I don't know.'' We propose a probabilistic framework where agents engage in a calibration phase, updating beliefs about their own fixed competence, before facing a final confidence gate that determines whether to vote or abstain. We derive a non-asymptotic lower bound on the group's success probability and prove that this selective participation generalizes the asymptotic guarantees of the CJT to a sequential, confidence-gated setting. Empirically, we validate these bounds via Monte Carlo simulations. While our results are general, we discuss their potential application to AI safety, outlining how this framework can mitigate hallucinations in collective LLM decision-making.

Figures & tables

Explore similar work

CardsList
  1. Counterfactual Graph for Multi-Agent LLM Calibration

    May 28, 2026Jiatan Huang, Mingchen Li, Ziming Li +3AI Agent ReliabilityLanguage Model Calibration

  2. A latent dimension of Condorcet's jury theorem for multiple AI advisers

    Sep 13, 2026Kazutoshi Sasahara, Aoi Naito, Ryo FujieSocial Choice TheoryMulti-Agent Consensus