cs.AIOct 4, 2026

More Claims, Less Evidence: Bounded Verification of AI-Generated Digital Knowledge Artifacts

Authors: Feliks Bańka, Jarosław A. Chudziak

Organizations: Institute of Computer Science, Warsaw University of Technology, Warsaw, Poland

Abstract

Digital libraries, repositories, and AI-mediated knowledge services increasingly rely on generative systems to produce summaries, descriptions, and other multi-claim knowledge objects. Yet generation can scale far more easily than verification capacity: a reviewer may need to decide whether an object is suitable for publication or downstream use after checking only a small fraction of its claims. This creates a fundamental gap between claim-level verification and confidence in the object as a whole. The central question is therefore what a successful partial check implies about the reliability of the complete artifact when its size grows but the verification budget does not. This paper contributes a Bayesian model of bounded verification centered on the Predictive Value of Pass (PVP). The model predicts that evidentiary value decreases as artifacts grow under fixed verification capacity, improves with larger verification budgets, and is especially fragile when errors are sparse. Controlled experiments on FEVEROUS and FEVER support these predictions and show that adding supported claims around a fixed number of false or unsupported claims can make passing more likely while making a pass less informative. The model further yields the minimum verification budget required to maintain a target PVP, providing a practical component for AI-assisted quality-assurance workflows in which generated knowledge objects must be checked before publication or downstream use.

Figures & tables

Explore similar work

CardsList
  1. AI Evaluation Should Measure Verification Cost, Not Correctness Alone

    Aug 9, 2026Viviana Crescitelli, Generoso Immediato, Fabio Persia +1Artificial Intelligence EvaluationCorrectness

  2. Evidence-Ledger Adjudication for Claim-Evidence Traceability

    Jul 29, 2026Gengyu Chen, Yongjie Yu, Weiling WangCategory-Aware Atomic ClaimsAi-Assisted Writing

  3. Althea: The Fact-Checking--Metalearning Tradeoff in AI-Assisted Verification

    Dec 29, 2025Svetlana Churina, Kokil Jaidka, Anab Maulana Barik +5Fact-CheckingCategory-Aware Atomic Claims