cs.CLNov 6, 2026

Where Did the Evidence Go? Diagnosing Proof-Set Loss in Long-Term Conversational Memory

Authors: Bogdan Roshchupkin, Maria Khodorchenko

Organizations: Sber · ITMO University

Abstract

Long-term conversational question answering can require several separated dialogue turns that support an answer only together. We introduce EviCover, a retrieval approach designed to retain this complementary evidence. It converts questions into observable evidence requirements, checks requirement coverage using retrieved source identifiers, and selects turns jointly. We track annotated support sets - the benchmark-labeled dialogue turns associated with each question - through retrieval, reranking, and final answer-generation context. We evaluate the baseline memory pipeline on generated, human-verified LoCoMo conversations and human-written REALTALK conversations, and examine EviCover on REALTALK's 108 multi-hop questions. Compared with the hybrid lexical/dense baseline, support-turn recall among 60 candidate turns rises from 0.526 to 0.575, and recall in the final ten-turn context rises from 0.349 to 0.379. The evidence funnel identifies separate discovery and selection failures, while paired answer evaluation shows that greater evidence recall does not yet establish a correctness gain. This analysis locates where complementary evidence is lost and distinguishes evidence retrieval from its use in answer generation.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. EviMem: Evidence-Gap-Driven Iterative Retrieval for Long-Term Conversational Memory

    Apr 30, 2026Yuyang Li, Yime He, Zeyu Zhang +1Temporal IREvidence Retrieval

  2. Learning to Retrieve Missing Evidence for Long-Term Memory QA

    Sep 29, 2026Yi-Xuan Deng, Yi Zhang, Wei Liu +2RL for IREvidence Retrieval