Temporal Video Understanding

Ask about this topic

Momentum

23 papers in the last four weeks, up 109% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 220

All topics
CardsList

  1. SpaTime: Streaming Vision-Language Models for Spatio-temporal Reasoning

    Oct 6, 2026Hairong Yin, Huangying Zhan, Shin-Fang Chng +2Vision-Language ModelsSpatiotemporal Reasoning

    Department of Computer Science, Purdue University, USA · Goertek Alpha Labs, USA

  2. EC-RAG: Event Chain Retrieval-Augmented Generation for Long Video Understanding

    Oct 6, 2026Yuhao Qin, Junbo Wang, Yuke Li +1Multimodal RAGVideo-Language Models

    Northwestern Polytechnical University Xi’an, China

  3. Multi-Label Perceptual Bug Detection in Video Games using Deep Learning on Gameplay Footage

    Oct 6, 2026Nahian Rifaat, Felix Morosov, Loutfouz ZamanAutomated Software TestingMulti-Label Classification

    Ontario Tech University Oshawa, Ontario, Canada · Universität Osnabrück Osnabrück, Niedersachsen, Germany

  4. Joint Class-Time Learning for Video Classification with Multi-Instance Partial-Label Learning

    Oct 5, 2026Lingyu Shen, Wei Tang, Fakhri Karray +1Weakly Supervised LearningMultiple Instance Learning

    School of Computer Science and Engineering, Southeast University, Nanjing 210096, China · Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, United Arab Emirates

  5. Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding

    Oct 1, 2026Mohd Ubaid Wani, Sara Atito, Josef Kittler +1CoT ReasoningInterpretable Anomaly Detection

    Centre for Vision, Speech and Signal Processing (CVSSP) University of Surrey, UK · Surrey Institute for People-Centred AI (PAI) University of Surrey, UK

  6. FlashBack: Knowing When to Remember in Streaming Vision-Language Models

    Oct 1, 2026Yi Chen, MingMing Yu, Rui-Qi Wang +5Memory-Augmented VLMsVision-Language Models

    Rightly Robotics, A4X

  7. Video-Index: A Curated Meta-Benchmark for Video Understanding

    Oct 1, 2026Enxin Song, Yinuo Xu, Shusheng Yang +2Video UnderstandingVideo-Language Model Evaluation

    University of Pennsylvania · New York University · Princeton University

  8. RESUME: Recurrent State Updates from Motion and Residual Signals for Efficient Video Language Modeling

    Sep 30, 2026Can Zhang, Xiaotian Han, Junyuan Shang +5Video-Language ModelsVideo Representation Learning

    Beijing University of Chemical Technology · Baidu, Inc.

  9. TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection

    Sep 30, 2026Bo-Yuan Cheng, Kuan-Yu Chen, Po-Han Huang +2Missing-Modality LearningMultimodal Robustness

    AI Research Center, Inventec Corporation, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan

  10. SYNCR: Diagnosing and Learning Cross-Video Reasoning from Simulation

    Sep 29, 2026Sara Ghazanfari, Siddharth Garg, Prashanth Krishnamurthy +1Video-Language Model EvaluationVideo Reasoning

    New York University

  11. EGSD: Event-Grounded Self-Distillation for Streaming Video Understanding

    Sep 29, 2026Yuwei Miao, Xuesheng Zhang, Wenhao Zou +5Streaming Video UnderstandingSelf-Distillation

    Baidu · University of Chinese Academy of Sciences · China University of Petroleum, Beijing

  12. RoboChrono: A Real Robot Benchmark for Streaming Task Understanding

    Sep 29, 2026Yuzhou Wu, Longteng Fan, Zimeng Li +22Next-Action PredictionRobot Manipulation Benchmarks

    Tianji Tec. · Shenzhen University · General Intelligence Machine +7

  13. Foresight at the Event Boundary: Evaluating Physical Prediction in Video World Models

    Sep 29, 2026Estela Monserrat Arriaga Santana, Julian Rosas Scull, Ehécatl Sacamch'en Núñez Rico +1Physical Consistency in Video GenerationWorld Model Evaluation

    National Autonomous University of Mexico · National Autonomous University of Mexico, Mexico · University of Texas at El Paso +1

  14. ReVA: A Scene-Centric Dataset Beyond Repetition for Remote Sensing Video Question Answering

    Sep 28, 2026Zhen Yao, Likai Wang, Yuming Yang +9Remote Sensing VQAVideo QA

    Lehigh University · University of Southern California · Qualcomm AI Research

  15. ActionLens: Diagnosing Spatial-Temporal Binding Failures in Vision-Language Models

    Sep 28, 2026Gueter Josmy Faure, Min-Hung Chen, Hao Ping Wang +3Video-Language Model EvaluationTemporal Video Understanding

    National Taiwan University · NVIDIA

  16. A Hierarchy-Aware Video-Language Model Evaluation and Hyperbolic Baseline for Surgery

    Sep 22, 2026Ana Manzano Rodríguez, Pascal Mettes, Marlies P. Schijven +1Video-Language Model EvaluationHierarchical Representation Learning

    Data Science Center HAVA-Lab, University of Amsterdam · Video & Image Sense Lab, Informatics Institute, University of Amsterdam · Amsterdam UMC Location University of Amsterdam, Surgery +2

  17. Not Another Text Benchmark: Putting the "Visual" Back in Visual Question Answering for Large Video Models

    Sep 15, 2026Rwiddhi Chakraborty, Yinong, Wang +7Video-Language Model EvaluationVideo QA

    Oliver · University of Copenhagen · Carnegie Mellon University +4

  18. BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender

    Sep 14, 2026Yolo Y. Tang, Daiki Shimada, Jiayue Meng +14AI Agent BenchmarksTemporal Video Understanding

    University of Rochester · Sony Group Corporation · Carnegie Mellon University +1

  19. CapsuleMotion: A Lightweight Real-Time Visual Motion Predictor for Capsule Endoscopy

    Sep 14, 2026Oliver Bause, Julia Werner, Oliver BringmannEndoscopyMedical Imaging

    University of Tübingen, Faculty of Science, Department of Computer Science, Embedded Systems Group

  20. OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality

    Sep 14, 2026Yang Liu, Qionghong Ma, Joongwon Chae +10Surgical Video UnderstandingTemporal Action Detection

    Institute of Biopharmaceutics and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China · Department of Ophthalmology, The Fifth Affiliated Hospital of Wenzhou Medical University, Wenzhou Medical University, Lishui 323000, China · School of Optometry, The Hong Kong Polytechnic University +4

  21. Zero-shot video highlight detection based on text descriptions and synthetic images

    Sep 13, 2026Michal Byra, Alberto Presta, Grzegorz Stefanski +1Video UnderstandingTemporal Video Understanding

    Samsung AI Center, Warsaw, Poland · Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland

  22. LiveProBench: Can Streaming Video Models Really Interact Like Humans?

    Sep 11, 2026Kaixuan Du, Xin Wan, Hang Zhang +4Streaming Video UnderstandingVideo-Language Model Evaluation

    School of Automation Science and Electrical Engineering, Beihang University · Qwen Business Unit of Alibaba

  23. VLX-VR: An Agentic-Aware Video Reasoning Model

    Sep 9, 2026Sheng Li, Peng Liu, Qianqian Zhang +1Video ReasoningMemory-Augmented Video Understanding

    Om AI Research

  24. MotionBlind: Probing the Illusion of Motion Understanding in Video-LLMs

    Sep 8, 2026Dhairya Bhatia, Bishoy Galoaa, Oliver Fritsche +7Video-Language Model EvaluationVideo-Language Models

    Electrical and Computer Engineering Department Northeastern University, Boston, MA, USA

  25. EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning

    Sep 8, 2026Jingpu Yang, Fengxian Ji, Mingxuan Cui +4Visual Spatial ReasoningEgocentric Video QA

    Beihang University, Beijing, China · Zhongguancun Academy, Beijing, China · Northeastern University, Shenyang, China +1

  26. Kairos: A Dataset for Fine-Grained Video-Language Modeling over Space, Time, and Dynamics

    Sep 8, 2026Ruibo Ming, Lei Sun, Deheng Zhang +8Video-Language Model EvaluationVideo-Language Models

    1INSAIT, Sofia University “St. Kliment Ohridski” · 2Adobe Research · 3Snap Research

  27. STSG-VQA: Evidence-Grounded Temporal Question Answering from Surgical Spatio-Temporal Scene Graphs

    Sep 8, 2026Jing Li, Duygu SarikayaMedical VQAQuestion Answering

    School of Computer Science, University of Leeds, UK

  28. Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision

    Sep 3, 2026Shravan Venkatraman, Wenshuai Zhao, Mohammad Hassan Vali +1Self-Supervised LearningState Tracking

    Mohamed bin Zayed University of Artificial Intelligence, UAE · Aalto University, Finland · ELLIS Institute Finland & Department of Computer Science, Aalto University, Finland

  29. The Shape of Time: Video-Token Contrast for Temporal Understanding in VideoLMs

    Sep 3, 2026Yumeng Shi, Quanyu Long, Yin Wu +1Video-Language ModelsVideo Representation Learning

    Nanyang Technological University

  30. TAME: Temporal-Aware Mixture-of-Experts for Text-Video Retrieval

    Sep 2, 2026Uicheol Jung, Juyoung Hong, Hojung Kwon +1Temporal Video UnderstandingMixture of Experts

    Sejong University, Seoul, Republic of Korea · Wisenut, Seongnam, Republic of Korea

  31. TempCloze: Can Video-LLMs Identify the Missing Middle?

    Sep 1, 2026Wenqi Pei, Henry Hengyuan Zhao, Yilai Liu +4Video-Language Model EvaluationVideo-Language Models

    The University of Hong Kong · National University of Singapore · Peking University

  32. ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits

    Sep 1, 2026Sethuraman T, Savya Khosla, Onkar Kishor Susladkar +6Video-Language Model EvaluationVideo-Language Models

    University of Illinois Urbana-Champaign · Adobe Research

  33. DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos

    Aug 30, 2026Bomiao Wang, Zekai Shao, Jiexiang Lan +3Video UnderstandingVideo-Language Model Evaluation

    Fudan University · The Hong Kong University of Science and Technology (Guangzhou)

  34. VideoHarness-RSI: Recursive Harness Self-Improvement for Long-Video Understanding with Frozen Vision-Language Models

    Aug 25, 2026Guoyang Xu, Hao ChenProgram SynthesisLong-Video Understanding

    Tencent

  35. EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory

    Aug 13, 2026Weitao Chen, Hu Jiaxin, Xie Tianyidan +15Egocentric Video QAVideo-Language Model Evaluation

    Nanjing University, China · Huawei Technologies Co., Ltd., China · Tianjin University, China

  36. A Hybrid Framework of Vision Transformer and Gated Recurrent Unit for Detection of Mosquito Diseases

    Aug 12, 2026Danial Sharifrazi, Saadat Behzadi, Nouman Javed +3Convolutional RNNsAnimal Behavior Analysis

  37. FUSE: Frame-Unified Stress Estimation from Facial Video

    Aug 11, 2026Stefanos Gkikas, Thomas Kassiotis, Yang Guo +2Emotion RecognitionTemporal Video Understanding

    Honda Research Institute Japan Wako City, Japan · Department of Electronic Engineering Hellenic Mediterranean University Chania, Greece · Faculty of Information Science and Engineering Ocean University of China Qingdao, China

  38. From Detection to Understanding: TAR and TAR-Bench for Multi-Task Traffic Anomaly Reasoning

    Aug 10, 2026Han Zhang, Yilin Zhao, Zaid Pervaiz Bhat +5Video-Language Model EvaluationVideo Anomaly Detection

    NVIDIA · Santa Clara University

  39. Zero-Shot Traffic Accident Detection via a Coarse-to-Fine VLM-Tracking Pipeline

    Aug 9, 2026Dipit Saha, Shah Mohammad Abdul Mannan, Mohammad Raihan Rashid +2Temporal Video Understanding

    Bangladesh University of Engineering and Technology

  40. VADER: Adaptive Debiasing for Hallucination Mitigation in Video Large Language Models

    Aug 9, 2026Dong Xing, Jiaxin Chen, Hang Yang +3Video-Language ModelsVLM Hallucination Mitigation

    Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences Changchun, Jilin 130033, China · University of Chinese Academy of Sciences, Beijing 100049, China · City University of Hong Kong, Hong Kong, China

  41. CoDAT: Collaborative Dual-Attention Transformer with Low-Cost Temporal Modeling for Efficient Edge Action Recognition

    Aug 7, 2026Novendra Setyawan, Chi-Chia Sun, Mao-Hsiu Hsu +3Edge InferenceEfficient ViTs

    Department of Electro-Optics, National Formosa University, Huwei 632301, Taiwan · Department of Electrical Engineering, University of Muhammadiyah Malang, Malang 65144, Indonesia · Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan +1

  42. The Low Frequency Trap: Video Language Models Fail at Simple Event Bookkeeping

    Aug 6, 2026Sarvesh Baskar, Zikui Cai, Shayan Shabihi +5Video-Language Model EvaluationTemporal Video Understanding

    University of Maryland, College Park, USA · Scale AI, USA

  43. ChronoVision: Temporal Reasoning via Latent State Reconstruction

    Aug 6, 2026Yifan Shen, Jian Xu, Boyi Li +6Multimodal Large Language ModelsLatent Visual Reasoning

    University of Illinois Urbana-Champaign · PediaMed AI · University of Pennsylvania

  44. DynaPix: Can Vision-Language Models Identify the Exact Future?

    Aug 6, 2026Thong Nguyen, Vinh-Hien Do, Quynh Vo +2VLM EvaluationVision-Language Models

    Centre for AI Research, VinUniversity · National University of Singapore

  45. Persistent Object Narratives for Token-Efficient Video Language Models

    Aug 5, 2026Junzhe Chen, Siyuan Meng, Xiaojie GuoVisual TokenizationVideo-Language Models

    Tianjin University

  46. SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding

    Aug 5, 2026Yuqing Feng, Jiawei Ma, Kevin Qinghong Lin +6Surgical Video UnderstandingGenerative Retrieval

    Department of Computer Science, University of Liverpool, Liverpool L69 3BX, U.K. · Department of Computer Science, City University of Hong Kong, Hong Kong SAR, China · Department of Engineering, University of Oxford, Oxford OX1 3PJ, U.K. +2

  47. TRCoRSurg: Temporal-Relational Co-Reasoning for Surgical Video Triplet Recognition

    Aug 5, 2026Fang Li, Shihao Zou, Weixin Si +3Surgical Video UnderstandingRelational Deep Learning

    State Key Laboratory of Virtual Reality Technology and Systems, Beihang University · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · Faculty of Computer Science and Control Engineering, Shenzhen University of Advanced Technology

  48. REZE: Recognition-Based Zero-Shot Extraction for Video Temporal Grounding

    Aug 5, 2026Boyang Li, Chenhui Gou, Jianfei CaiTemporal Video GroundingZero-Shot Learning

    Department of Data Science and AI, Monash University

  49. Predict, Then Retrieve: Cross-Instance Future-State Retrieval from Video Prefixes

    Aug 5, 2026Quynh Vo, Thong Nguyen, Vinh-Hien Do +2Cross-Modal RetrievalVideo Prediction

    Centre for AI Research, VinUniversity · National University of Singapore

  50. AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding

    Aug 4, 2026Yuxiang Duan, Huining Li, Ao Li +6Multi-Agent SystemsVideo Anomaly Detection

    C-FAIR & School of software, Shandong University · Renmin University of China · Nanjing Agricultural University +1

  51. Multi-Task Multi-Frame Visual Piano Transcription

    Aug 4, 2026Yonghyun Kim, Hoyeol Sohn, Juhan Nam +1Automatic Music TranscriptionTemporal Video Understanding

    Music Informatics Group, Georgia Institute of Technology, USA · Graduate School of Culture Technology, KAIST, South Korea

  52. Caved or Convinced: Temporal Sampling Gates Claim Deference in Video Large Language Models

    Aug 4, 2026Yuxin Cao, Wei Song, Jingling Xue +1Selective PredictionVideo-Language Model Evaluation

    National University of Singapore, Singapore · University of New South Wales, Australia

  53. Event ActivityNet: A Large-Scale Simulated-Event Benchmark for Untrimmed Action Understanding

    Aug 3, 2026Cheng-Yao Hong, Ting-Wei Lin, Yun-Chung Lai +3Event-Based VisionVideo Action Recognition

    Institute of Information Science, Academia Sinica, Taiwan · Department of Computer Science, National Tsing Hua University, Taiwan

  54. VisualRouter: Query-Grounded Visual Sampling for Long Video Understanding

    Jul 30, 2026Haiyue Zhang, Yi Bin, Xun Jiang +5Large Vision-Language ModelsLong-Video Understanding

    Tongji University, Shanghai, China · University of Electronic Science and Technology of China, Chengdu, China

  55. HyperClaim: Fine-Grained Cross-Modal Hypergraph Reasoning for Video Misinformation Detection

    Jul 30, 2026Xiangbo Wang, Jiasheng Zhang, Xingtong Yu +2Fake News DetectionAutomated Fact-Checking

    School of Communication Engineering, Hangzhou Dianzi University · School of Computer Science and Technology, Xidian University · School of Computing and Information Systems, Singapore Management University +1

  56. Knowledge-Guided Multimodal Reasoning over Interacting Streams for Video-Level Ambivalence and Hesitancy Recognition

    Jul 28, 2026Podakanti Satyajith Chary, Barath Parthiban, Pranesh Velmurugan +2Multimodal ReasoningMultimodal Emotion Recognition

    Department of Engineering Science, IIT Hyderabad, India · Department of Biomedical Engineering, IIT Hyderabad, India

  57. FORGE: Frame Orthogonality in Relevance Geometry for Long-Form Video Understanding

    Jul 28, 2026Ghazal Kaviani, Ghassan AlRegibEfficient Multimodal InferenceMultimodal Large Language Models

    1OLIVES at the Center for Signal and Information Processing (CSIP), School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA.

  58. LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos

    Jul 27, 2026Ce Zhang, Jinxi He, Katia Sycara +1Multimodal Large Language ModelsLong-Video Understanding

    Robotics Institute, Carnegie Mellon University

  59. MarineEVT: Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoning

    Jul 27, 2026Tuan-An To, Yuk-Kwan Wong, Tuan-Anh Vu +2Visual Question AnsweringVideo Understanding

    The Hong Kong University of Science and Technology, Hong Kong, China · University of California, Los Angeles CA, USA · University of Electronic Science and Technology of China, China

  60. WaveZip: Wavelet-Driven Space-Time Decoupling for Video Token Condensation

    Jul 25, 2026Yuhui Zeng, Wang Chen, Jinfa Huang +5Efficient VLM InferenceVideo Token Compression

    Media Analytics and Computing Lab, Xiamen University, Xiamen, China · Department of Computer Science, University of Rochester, Rochester, NY, USA