cs.CVJun 3, 2026

VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding

Authors: Lin FuZheyuan YangYang WangTingyu SongArman CohanYilun Zhao

Abstract

We introduce VideoKR, the first large-scale training corpus specifically designed to strengthen knowledge- and reasoning-intensive video understanding. It comprises 315K video reasoning examples over 145K newly collected, CC-licensed, expert-domain videos. We develop a human-in-the-loop, skill-oriented example generation pipeline that targets progressively deeper video reasoning capabilities while ensuring the difficulty, diversity, and reliability of both the examples and their CoT rationales. We also curate VideoKR-Eval, a new expert-annotated benchmark where questions require genuine video understanding and knowledge-intensive reasoning rather than textual shortcuts. Our experiments show that, under a standard SFT\rightarrowGRPO pipeline, models post-trained on VideoKR outperform prior post-training approaches on knowledge-intensive video reasoning while remaining competitive on general video reasoning, highlighting data design as a key driver of progress in video reasoning. We further conduct comprehensive ablations to isolate the contributions of VideoKR, providing actionable insights for future work.

Explore similar work

CardsList
  1. Video-ToC: Video Tree-of-Cue Reasoning

    Apr 22, 2026Qizhong Tan, Zhuotao Tian, Guangming Lu +2Visual ReasoningTree-Of-Thoughts

  2. Find, Fix, Reason: Context Repair for Video Reasoning

    Apr 17, 2026Haojian Huang, Chuanyu Qin, Yinchuan Li +1Visual Reasoning