Long-term conversational question answering can require several separated dialogue turns that support an answer only together. We introduce EviCover, a retrieval approach designed to retain this complementary evidence. It converts questions into observable evidence requirements, checks requirement coverage using retrieved source identifiers, and selects turns jointly. We track annotated support sets - the benchmark-labeled dialogue turns associated with each question - through retrieval, reranking, and final answer-generation context. We evaluate the baseline memory pipeline on generated, human-verified LoCoMo conversations and human-written REALTALK conversations, and examine EviCover on REALTALK's 108 multi-hop questions. Compared with the hybrid lexical/dense baseline, support-turn recall among 60 candidate turns rises from 0.526 to 0.575, and recall in the final ten-turn context rises from 0.349 to 0.379. The evidence funnel identifies separate discovery and selection failures, while paired answer evaluation shows that greater evidence recall does not yet establish a correctness gain. This analysis locates where complementary evidence is lost and distinguishes evidence retrieval from its use in answer generation.
Figures & tables
Figure 1: EviCover overview: provenance-constrained proof-set retrieval. Requirement coverage is accepted only with a retrieved turn identifier. The pointwise and setwise top-10 contexts use the same discovered candidates and relevance scores; only final set selection changes. ER and PS are measured at every stored boundary.
Run
R@5
F1
CP
CR
Cit.-Gr.
LoCoMo initial
.772
.316
.463
.448
.493
LoCoMo revised
.771
.394
.558
.535
.593
REALTALK baseline
.579
.291
.477
.374
.511
Table 1: Baseline evaluation on both datasets. CP/CR are citation precision/recall; Cit.-Gr. is the mechanical citation-grounded answer rate defined in Sec. 3.2 .
Type ( n )
R@5
F1
J-C/P
J-Sup.
Cit.-Gr.
Factual (301)
.391
.381
.847
.787
.475
Temporal (319)
.814
.239
.777
.702
.611
Multi-hop (108)
.409
.191
.750
.556
.315
Table 2: REALTALK baseline by query type. J-C/P is judge correct-or-partial; J-Sup. is judge-supported; Cit.-Gr. is the mechanical metric.
Distance unit
Median
P90
Maximum
Turn positions
380
989
1574
Sessions
12
19
24
Days
12
21
23
Table 3: Distance from each of 327 support turns to the final observed turn.
System
Stage
Hits/327
ER
Full sets
Flat hybrid
top-60
172
.526
50/108
Flat hybrid
final top-10
114
.349
36/108
Req. discovery
accumulated
217
.664
63/108
Req. discovery
top-60
188
.575
55/108
Req. discovery
top-120
207
.633
60/108
Pointwise
final top-10
116
.355
36/108
Table 4: Evidence funnel on all 108 multi-hop questions. “Req. discovery” denotes requirement-guided retrieval. Top-60/120 rows report ranked candidates.