RAG Citation Faithfulness

RAG: Retrieval-Augmented Generation

Follow this topic Ask about this topic

Latest papers

21 papers6 papers in the last four weeks, up 100% on the four weeks before. 0.0% of all new papers.

Real PMIDs, Wrong Papers: Harness Design for Biomedical Claim-Verification Agents
Oct 21, 2026Mohammed SaqlainLLM Agent Evaluation Scientific Claim Verification
Independent Researcher, Bangalore, India
EpiLens: Lightweight RAG for Epidemiological Knowledge Acquisition
Oct 19, 2026Vincenzo Perri, Ciro Cattuto, Daniela PaolottiLLM Information Extraction Evidence Selection
ISI Foundation, Turin, Italy.
One Fact, Many Places: Redundant Evidence in Long Visual Documents Breaks Single-Gold Evaluation of Retrieval, Citation and Attribution
Oct 19, 2026Xiaokang Yuan, Binhui Yao, Luwei Yang +2IR Evaluation Evidence Retrieval
Zhejiang University, Hangzhou, China · Zhejiang Geely Holding Group Co., Ltd, Hangzhou, China
The Bottleneck Is Retrieval, Not Reading: Diagnosing Evidence-Based Generation with RAG for Long Context Question Answering
Oct 18, 2026Debopriyo Banerjee, Owais Aijaz, Ahmer Tabassum +3RAG Evaluation Evidence-Grounded Generation
Inception42 · MBZUAI
MuninAI: A Self-Hosted Agentic Framework for Independent Research Groups
Oct 16, 2026Markus Fischer, Jens Meiler, Matthias ElgetiScientific QA Agentic RAG
Institute for Drug Discovery, Leipzig University Medical School, Leipzig, Germany · Institute for Medical Physics and Biophysics, Leipzig University Medical School, Leipzig, Germany · Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI), Dresden/Leipzig, Germany +3
Copying Is Not Grounding: Training Faithful Long-Form RAG with Authored-Sentence Credit
Oct 13, 2026Hoang Pham, Duc Anh Vu, Duy Tung Doan +2RL for RAG RAG Citation Faithfulness
Nanyang Technological University · Viettel AI, Viettel Group · VinUniversity
Attributable Post-Rationalization in RAG Citations: A Controlled Reproduction and an RLVR Comparison
Sep 19, 2026Mehedi Khan, Md. Shariful Islam BhuyanRAG Citation Faithfulness Retrieval-Augmented Generation
Department of Computer Science and Engineering Bangladesh University of Engineering and Technology
CiteGuard-RAG: A Validation-Centered AI System for Evidence-Grounded Question Answering
Sep 14, 2026Sumit Barua, Guan Hong, Halil Dursunoglu +2Retrieval-Augmented Generation Citation Verification
Department of Computer Science, Western Michigan University, Kalamazoo, MI, 49008, USA.
The Attribution-Compression Frontier in Retrieval-Augmented Generation
Sep 13, 2026Deepanshu ModyRAG Context Compression RAG Citation Faithfulness
Center for Data Science New York University
GADR: Gathering Architecture Decision Records from Meeting Transcriptions
Aug 18, 2026Lucas Daniel Costa da Silva, Kiev GamaRAG Citation Faithfulness Document Information Extraction
Universidade Federal de Pernambuco (UFPE) Recife, Brasil
When Context Misleads: Intent-Guided Decoding for Robust Retrieval-Augmented Generation
Aug 17, 2026Haolin Jin, Pengyue Yang, Huaming ChenRAG Citation Faithfulness Retrieval-Augmented Generation
School of Electrical and Computer Engineering The University of Sydney Sydney, NSW, Australia
CAGE: Cognitive Attribution Graphs for Faithful Inline Citation Generation in Long-Form Question Answering
Jul 27, 2026Zhichao Yan, Shizhao Li, Jiapu Wang +5Retrieval-Augmented Generation Question Answering
Shanxi University, Taiyuan, China · Nanjing University of Science and Technology, Nanjing, China · Nanyang Technological University, Singapore +3
DS@GT ARC at LongEval: Citation Integrity and Factual Grounding in Scientific QA
Jul 15, 2026Brandon Michaels, Brendon JohnsonRetrieval-Augmented Generation Citation Verification
Georgia Institute of Technology, North Ave NW, Atlanta, GA 30332
On-Device Deep Research at 4B: Exposure Bounds Faithfulness, Retrieval Bounds Coverage
Jul 14, 2026Vinay Kumar ChagantiContextual Faithfulness Citation Verification
Independent Researcher
5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control
Jun 27, 2026Thien-Qua-T-Nguyen, Chi Hoang, Nguyen Tran +3RAG Citation Faithfulness Retrieval-Augmented Generation
University of Information Technology, Ho Chi Minh City, Vietnam · 2Vietnam National University Ho Chi Minh City, Ho Chi Minh City, Vietnam
ProvenAI: Provenance-Native Traces of Evidence in Generated Answers
Jun 24, 2026Mohammad Faizan, Dalal AlharthiMulti-Hop QA Data Provenance
College of Information Science University of Arizona
How Do LLMs Cite? A Mechanistic Interpretation of Attribution in Retrieval-Augmented Generation
Jun 9, 2026Ian van Dort, Maria HeussRAG Citation Faithfulness Retrieval-Augmented Generation
University of Amsterdam
FIDES: Faithful Inference via Deep Evidence Signals for Retrieval-Memory Conflict in RAG
Jun 4, 2026Zhe Yu, Wenpeng Xing, Tiancheng Zhao +3RAG Citation Faithfulness Retrieval-Augmented Generation
Binjiang Institute of Zhejiang University · Zhejiang University · Guangzhou University
Why Neighborhoods Matter: Traversal Context and Provenance in Agentic GraphRAG
May 14, 2026Riccardo Terrenzi, Maximilian von Zastrow, Serkan AyvazRAG Citation Faithfulness Data Provenance
Centre for Industrial Software, University of Southern Denmark, Alsion 2, 6400 Sønderborg, Denmark
Reason and Verify: A Framework for Faithful Retrieval-Augmented Generation
Mar 10, 2026Eeham Khan, Luis Rodriguez, Marc QueudotRAG Citation Faithfulness Retrieval-Augmented Generation
Concordia University, Montréal, QC, Canada · Centre de recherche informatique de Montréal (CRIM), Montréal, QC, Canada
Even Small Reasoners Should Quote Their Sources: Introducing the Pleias-RAG Model Family
Apr 25, 2025Pierre-Carl Langlais, Pavel Chizhov, Mattia Nee +6Retrieval-Augmented Generation LLM Grounding
PleIAs, Paris, France

Oct 21, 2026J/K move · Enter open · S save

Real PMIDs, Wrong Papers: Harness Design for Biomedical Claim-Verification Agents

Mohammed Saqlain

Independent Researcher, Bangalore, India

LLM Agent Evaluation Scientific Claim Verification Biomedical IR RAG Citation Faithfulness

Open paper AskPDF arXiv

Literature-searching language agents are becoming a standard component of scientific assistants for the life sciences, yet there is little controlled evidence on which parts of their harness matter. We run a controlled ablation on biomedical claim verification (SciFact) with the live PubMed API as the only tool. Holding the backbone and output format fixed, we compare four harnesses: closed-book answering, single-shot retrieval using the claim as the query, a ReAct-style agent that writes its own PubMed queries, and an oracle given the gold abstracts, each with two efficient frontier backbones. Naive single-shot retrieval finds the gold paper for only 6% of claims and turns overconfident errors into abstentions without improving accuracy. Letting the model formulate its own queries triples gold recall and yields the best verdicts (62% accuracy vs. 49-59% for the other realistic harnesses), although these differences are not significant at our sample size and agents use fewer than half of their search budget. With gold abstracts, the same models reach 79-86% accuracy, a significant 17-24 point gap showing that retrieval, not reasoning, is the main bottleneck. Finally, a citation audit shows that closed-book models cite PubMed IDs that almost always exist (327/335) but are almost never relevant: a cross-family LLM judge rates only 3 of 327 existing citations as relevant to the claim, versus 67% for citations produced by the search agent. Existence checks are therefore insufficient safeguards for scientific agents. We release code, prompts, and all cached tool calls at https://github.com/saqlain2204/real-pmids-wrong-papers.