cs.LGOct 30, 2026

NormDetect: Anchored Calibration for Low-False-Positive Detection of Machine-Generated Web Text

Authors: Hanshuai Cui, Fanshuai Meng, Zhiqing Tang

Organizations: School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China · Institute of Artificial Intelligence and Future Networks, Beijing Normal University, Zhuhai 519087, China

Abstract

Web platforms screen posts for text written by large language models, and every false flag hits a human writer. Detectors must therefore run at a very low false positive rate (FPR). Zero-shot detectors such as Binoculars score text with frozen language models, but invisible edits such as homoglyphs shatter tokenization and push machine text into the human range. Unicode normalization undoes these edits, yet the normalized score still misses half of the machine text at a strict FPR, under attacks that leave nothing to clean. We find that with the Falcon-7B scoring pair, heads on token statistics recall less than the normalized score at this FPR, and several flag too many human posts in some sections. We propose NormDetect, which anchors a learned per-section head to the normalized zero-shot score. A blend weight chosen on training folds under a human FPR cap combines the two scores, and one threshold is calibrated on human text only. On eight sections of the RAID benchmark with eleven attacks, NormDetect raises recall at a 0.1% calibrated FPR by 5.0 points over normalized Binoculars. Its human FPR bound stays at most 1% in every section, and no other detector within this bound recalls as much.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Log-Likelihood, Simpson's Paradox, and the Detection of Machine-Generated Text

    May 7, 2026Tom Kempton, Viktor Drobnyi, Maeve Madigan +1AI-Generated Text DetectionLanguage Model Calibration

  2. Measuring Artifact Reliance in Machine-Generated Text Detectors

    Oct 9, 2026Anastasia Voznyuk, Andrey GrabovoySpurious CorrelationAI-Generated Text Detection