Temporal Video Understanding

Overview

Temporal video understanding studies how actions and events unfold, how objects and states change, and how evidence across frames supports tasks such as action localization, moment retrieval, video question answering, and future prediction. Approaches include temporal transformers and state-space models, motion and trajectory representations, event graphs and memory, and adaptive frame or token selection; vision-language models are also trained or guided to reason over video evidence. Evaluation spans action-localization datasets, long-video question answering, temporal-order and counting tests, and streaming settings where models must decide when to respond. A central tension is that models can perform well on broad benchmarks while relying on static cues or language priors rather than temporal evidence, and efficient sampling or compression must retain the brief events needed for reliable reasoning.

Latest papers

CardsList

392 papers20 papers in the last four weeks, down 55% on the four weeks before. 0.2% of all new papers.

  1. TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action

    May 2, 2025Jen-Hao Cheng, Yi-Hao Peng, Huapeng Zhou +11Temporal Action SegmentationTemporal Video Grounding

  2. Quicksviewer: An LMM with Early Video Compression using Annealed Gumbel-Softmax

    Apr 21, 2025Ji Qi, Yuan Yao, Yushi Bai +4Video Token CompressionTemporal Video Understanding