cs.LGOct 12, 2026

Comparing GenAI to Machine Learning and Manual Review for eDiscovery

Authors: Gordon V. Cormack, Maura R. Grossman

Organizations: University of Waterloo, ON, Canada

Abstract

Keeling et al. [Keeling2026Generative] report on a case study recently conducted by Redgrave LLP in which they assert that Relativity's Generative AI Review tool (aiR) achieved 88% recall while Relativity Assisted Learning (RAL), its machine-learning tool, achieved 64% recall. These results are not comparable because the methods employed have different objectives, because of inter-assessor disagreement, and because they represent different recall-precision and cost-benefit trade-offs. Our analysis of the Redgrave data indicates that, when these differences are taken into account, aiR and manual review are comparable. Furthermore, established machine-learning models employing Continuous Active Learning (CAL) and Scalable Continuous Active Learning (S-CAL) show state-of-the-art effectiveness, and superior efficiency, when trained only on a sample of 2,000 first-pass-reviewer responsiveness determinations.

Figures & tables

Explore similar work

CardsList
  1. Benchmarking Agentic Review Systems

    Jun 18, 2026Dang Nguyen, Wanqing Hao, Yanai Elazar +1LLM Agent EvaluationAI Agent Benchmarks

  2. Preliminary Guidelines for Using and Evaluating GenAI Tools to Support Systematic Literature Reviews

    Jul 27, 2026Barbara Kitchenham, Sebastián Pizard, Lech Madeyski +3LLM EvaluationSystematic Review Automation

  3. Sem-Detect: Semantic Level Detection of AI Generated Peer-Reviews

    May 20, 2026André V. Duarte, Brian Tufts, Aditya Oke +3AI-Generated Text DetectionScholarly Peer Review