cs.IRNov 1, 2026

Adversarial Robustness of Retrieval-Based Fact-Checking: Detecting and Mitigating Evidence Contamination

Authors: Alamgir Munir Qazi, John P. McCrae, Jamal Abdul Nasir

Organizations: School of Computer Science, University of Galway, Ireland · Research Ireland Insight Centre and ADAPT Centre, University of Galway, Ireland

Abstract

Retrieval-based fact-checking systems ground verification in large document collections, creating a critical vulnerability: adversarial evidence contamination. We demonstrate that factually inconsistent but contextually coherent evidence generated to satisfy both retrieval-similarity and linguistic-fluency constraints can systematically mislead verification models. Contaminating just 3.1-7.4% of training corpora with five label-specific strategies causes adversarial content to penetrate up to 35.2% of top-k retrievals, degrading verification accuracy by up to 46.9% relative F1. Existing retrieval-stage defenses, validated against gradient-optimized or syntactically anomalous attacks, transfer poorly to this threat model: detection rates collapse and F1 recovery exhibits high variance across seeds. We propose GLAD (Geometric-Lexical Adversarial Defense), which fuses dense embedding peer-coherence with lexical distributional isolation. Across two benchmarks, two embedding models, and five random seeds, GLAD achieves the highest detection rates (70-86%) and the most consistent F1 recovery, reclaiming 73-80% of contamination-induced degradation on LIAR-RAW while approaching clean baselines on RAWFC. Crucially, unlike defenses that trade clean performance for robustness, GLAD imposes negligible cost on uncontaminated corpora.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. R2VC: Modular Fact-Checking with Retrieval, Verification, and Confidence Calibration

    Sep 14, 2026Dhruv Dixit, Paritosh PandeyRetrieval-Augmented GenerationAutomated Fact-Checking

  2. GPE: Evaluating Robust Evidence Aggregation for Fact Verification under Controllable GEO-Style Poisoning

    Jul 22, 2026Zhaoqi Wang, Zijian Zhang, Xiaomei Yuan +4RAG Poisoning AttacksAutomated Fact-Checking

  3. How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation

    Aug 26, 2026Aida Usmanova, Zangir Iklassov, Markus Leippold +1Automated Fact-CheckingScientific Claim Verification