cs.CVOct 20, 2026

PACE: Plan, Attend, Check, and Emit for Training-Free Response Timing in Streaming Video Understanding

Authors: Siqi Guo, Yuxia Chen, Wenbo Zhu, Yangguang Ji, Zhenxiang Jiang, Teng Zhong, Yu Zhang

Organizations: Nanyang Technological University · University of Electronic Science and Technology of China · University of California, Berkeley · National University of Singapore · 

Abstract

Streaming video understanding requires a model to decide not only what to answer but also when to answer. Evidence arrives progressively, and recent benchmarks identify premature responses, issued before the queried event has concluded, as a recurring failure mode. Existing approaches often learn response timing through additional training, while training-free alternatives typically rely on scalar gating signals that do not explicitly represent when an answer becomes final. We organize chunk-wise streaming errors into three patterns: sampling variation can make an answer unstable, a stable answer may lack support in the observed video, or an answer may be supported by the current evidence while the event remains unfinished. We propose PACE (Plan, Attend, Check, and Emit), a training-free framework designed around these three failure modes. Given a question, PACE drafts a plan specifying what to observe and what will signal completion. As the stream unfolds, it invokes an off-the-shelf video LLM at informative moments, evaluates each draft for stability, grounding in its cited frames, and completion, and records verified observations in an event ledger. Experiments on ProactiveVideoQA and OVO-Bench Forward show that PACE improves over the official protocols by up to 5.9 average PAUC points and 6.2 average accuracy points across proprietary and open-source backbones, yielding state-of-the-art performance.

Figures & tables

Explore similar work

CardsList
  1. Don't Pause! Every prediction matters in a streaming video

    Apr 27, 2026Dibyadip Chatterjee, Zhanzhong Pang, Fadime Sener +2Streaming Video UnderstandingEfficient VLM Inference

  2. StreamReady: Learning What to Answer and When in Long Streaming Videos

    Mar 9, 2026Shehreen Azad, Vibhav Vineet, Yogesh Singh RawatStreaming Video UnderstandingVideo QA

  3. Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding

    Mar 19, 2026Yikai Zheng, Xin Ding, Yifan Yang +6Streaming Video UnderstandingEfficient VLM Inference