stat.MESep 25, 2026

Two Conformal Constructions for Adaptive Within-Document AI-Text Screening

Authors: Marco Mandap, Jerahmeel Hipolito, Arcel Galvez, Charlie Margaret Balagtas, Michael Joshua Buluran, Jeff Roel Durmiendo, Rizzette E. Lopez

Organizations: Bulacan State University.

Abstract

We study false-alert control when screening for text generated by artificial intelligence (AI). The screening procedure selects document prefixes and detectors from observed evidence and may stop before exhausting its inspection budget. We give two finite-sample constructions under document-level exchangeability between human calibration documents and a new null document, with no restriction on dependence among tokens within a document. Construction A registers a finite family of prefix-detector scores and allocates a false-alert budget across their conformal ranks. A union bound protects any executed subset of that family. Construction B calibrates the complete-path maximum of a development-fixed adaptive policy. Each partial-path maximum is bounded by the complete maximum, so a terminal conformal rank protects early stopping without splitting the error budget. We prove marginal control of any false alert across the permitted inspection path and derive necessary calibration counts for rejection. We also state oracle testing, distribution-shift, and independent-audit bounds with their additional assumptions. Both constructions protect stopping within their specified scope; neither proof constructs an e-process or justifies multiplying conformal ranks. Detection power and computational savings remain questions for empirical evaluation.

Explore similar work

CardsList
  1. 'Your AI Text is not Mine': Redefining and Evaluating AI-generated Text Detection under Realistic Assumptions

    Jun 3, 2026Nils Dycke, Marina Sakharova, Nico Daheim +1AI-Generated Text DetectionGenerative AI Evaluation

  2. AI Detectors Fail Diverse Student Populations: A Mathematical Framing of Structural Detection Limits

    Mar 11, 2026Nathan GarlandAI-Generated Text DetectionRobustness of Machine-Generated Text Detection

  3. Rethinking AI-Generated Text Detection: A Strong Baseline and the Distribution-Shift Problem That Remains

    Jul 4, 2026Zhuoer Shen, Mingyi Wang, Shaofeng Zou +1Distribution Shift RobustnessAI-Generated Text Detection