cs.CVNov 17, 2026

OVET-Consensus: Rank-Preserving Counterfactual Event Verification for Video Moment Grounding

Authors: Alibay Osmanli, Shaogang Gong

Organizations: Queen Mary University of London London, UK

Abstract

Modern video moment retrieval systems often propose windows that overlap the target event, yet still select the wrong one. We study this scorer bottleneck on QVHighlights with a fixed QD-DETR-derived temporal expert: the parent-aware temporal expert reaches 64.71 [email protected], while diagnostic oracles over the same candidate family reach 75.68 [email protected] within the parent-reranked pool and 94.97 [email protected] over the full 100-candidate evidence pool. We introduce OVET-Consensus, a rank-preserving counterfactual event verification layer that keeps the temporal expert's ranked list as the default and permits only high-confidence rank-1 overrides from a policy calibrated on held-out training videos. The verifier uses parent-aware interval evidence, structured Qwen3-VL event judgments, VideoLLaMA3 pairwise temporal signals, and dense temporal evidence, but never lets those signals freely reorder the top-K list. On QVHighlights validation, OVET-Consensus improves the parent-aware temporal expert from 64.71 to 65.35 [email protected] with a positive paired-bootstrap interval, while mAP is largely unchanged, from 42.67 to 42.74; it makes 20 overrides, with 15 helpful corrections and 3 harmful corrections. The results point to a practical constraint on verifier design: semantic compatibility is useful evidence, but temporal grounding still requires deciding where the event starts, changes, and ends inside a visually compatible scene.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Temporal Evidence Routing with Structured Visual Evidence for TimeLogicQA

    May 31, 2026Yuyang Sun, Yongliang Wu, Xingyu Zhu +8Temporal Video UnderstandingStructured Reasoning

  2. EviDETR: Preserving Query-Relevant Temporal Evidence for Moment Retrieval and Highlight Detection

    Sep 25, 2026Haoran Sun, Yufan Li, Qichen Zhang +2Video Moment RetrievalTemporal Video Understanding