cs.LGNov 6, 2026

Copies Are Not Confirmations: How News Duplication Fools LLM Judges and Continual Learners

Authors: Abdelkader Metales, Miriam Grabenheinrich, Aicha Metales

Organizations: caaise GmbH · Djilali Liabes University of Sidi Bel Abbes

Abstract

A language model that keeps learning from the news sees the same claim many times, but many reports are copies of one source: wire stories, content shared within a media group, syndication and press releases. We ask whether LLM judges and continual learners treat such copies as independent confirmations. In 200,000 English articles from CC-News, a near-duplicate detector identifies copy links to another outlet for 18.9% of the articles, a detector-based lower bound. In a controlled experiment with claims about invented people, three identical reprints instead of one report raised the lies accepted by Llama 3.2 from 0.06 to 0.71 and by phi4 from 0.21 to 0.90; Gemini 2.5 Flash already believed a single report, and Gemini 2.5 Pro followed provenance information most consistently. In a simulated continual-learning stream, showing the judge one report per detected copy chain cut the copied lies accepted by 0.10-0.24 across four judges, at a mean cost of at most 4.2 points of accepted truths. Text similarity links none of the copies reworded by three LLMs. An entity-novelty test, the share of a report's named entities absent from an earlier look-alike, separates these rewrites from 100 author-labelled independent reports of the same event (AUC 0.98-0.99), statistically indistinguishable from TF-IDF and the best tested embedding model, but recognises only 17% of natural same-source derivatives. With both detectors run on 15,084 real articles carrying inserted claims, one report per chain cut the lies accepted by phi4 from 0.57-0.67 to 0.09 (copies), 0.14 (rewrites) and 0.34 (rewrites with invented details), and by Llama 3.2 from 0.56-0.62 to 0.07, 0.09 and 0.25, at a cost of 2.4 and 10 points of accepted truths. Counting reports or chains without a judge is unreliable, and colluding sources that do not copy each other remain an open problem.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

Apr 4, 2026

Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News

Can humans tell whether a news article was written by a person or a large language model (LLM)? We investigate this question using JudgeGPT, a study platform that independently measures source attribution (human vs. machine) and authenticity judgment (legitimate vs. fake) on continuous scales. From 2,318 judgments collected from 1,054 participants across content generated by six LLMs, we report five findings: (1) participants cannot reliably distinguish machine-generated from human-written text (p > .05, Welch's t-test); (2) this inability holds across all tested models, including open-weight models with as few as 7B parameters; (3) self-reported domain expertise predicts judgment accuracy (r = .35, p < .001) whereas political orientation does not (r = -.10, n.s.); (4) clustering reveals distinct response strategies ("Skeptics" vs. "Believers"); and (5) accuracy degrades after approximately 30 sequential evaluations due to cognitive fatigue. The answer, in short, is no: humans cannot reliably tell. These results indicate that user-side detection is not a viable defense and motivate system-level countermeasures such as cryptographic content provenance.
Oct 24, 2026

When Generated Information Returns: Error Persistence in LLM-Mediated Information Ecosystems

Large language models (LLMs) increasingly produce online articles from material that later becomes input to other models. This circulation connects individual responses to the information available for subsequent generation. We study a consequential distinction: an article can avoid endorsing a false claim while preserving the concrete details that enable its reproduction. Our framework connects claim content, expressed stance, and downstream reuse to explain selective error persistence under a continuing supply of accurate and inaccurate information. We implement a controlled community writing process that varies whether published articles return as inputs, matching external supply, input capacity, and generation volume. Across twelve factual targets and four production models, recirculation increases the presence of complete false claims by 7.29 percentage points at the final round while reducing explicit endorsement by 8.33 points. Effects differ across facts and models. Paired interventions then abstract eligible error details within fixed histories while preserving correct content and the surrounding controversy. Error reproduction remains largely unchanged across the evaluation targets, while a development quotation target exhibits local reductions. These findings connect persistent errors to the information available throughout a writing process and motivate evaluation of both what models affirm and what their publications supply to future writers.
Oct 31, 2026

What Do LLM Judges Actually Verify? Matched Controls and Record Gaps for Document Currency

LLM judges often check, against an amendment record, whether the documents an answer cites are still in force. Such records are rarely complete. From a table of replacements, our test generates matched answers citing a replaced document, its successor, the replaced document before its replacement, and an older document that a newer one updated without replacing; it removes links from the record and scores each finding by its stated reason. On 48 replacements from the IETF RFC index, judges given a correct record caught nearly every replaced citation, as a lookup would. On the 24 faults whose link we removed, every judge caught more from the texts alone than with the record: Gemini 3.1 Pro 23/24 against 1/24, GPT-5.5 23/24 against 9/24, Claude Opus 4.5 17/24 against 9/24 and Gemma 4 26B 13/24 against 0/24. The drop recurred on a second draw of removed links. Most misses carried no finding; in an exploratory run with a conflict code, only Gemini used it often. Rewording the gap as "no replacement recorded" did not help; presenting the record as an unverified note, or warning that it was incomplete, restored most lost catches for Gemini, GPT-5.5 and Claude (significant after correction for the first two) but at most 5 of 13 for Gemma; where catches returned, so did false alarms on updates. With both texts, judges mostly told replacements from updates; every update flagged had a near-identical title. A descriptive case study on Indian rooftop-solar rules is appended; we release the harness.