Video Understanding

Ask about this topic

Momentum

13 papers in the last four weeks, up 225% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 69

All topics
CardsList

  1. Video-Index: A Curated Meta-Benchmark for Video Understanding

    Oct 1, 2026Enxin Song, Yinuo Xu, Shusheng Yang +2Video UnderstandingVideo-Language Model Evaluation

    University of Pennsylvania · New York University · Princeton University

  2. CoEvoWhen: Policy-Tool Coevolution for Ultra-Long Video Temporal Grounding

    Sep 30, 2026Yiduo Jia, Muzhi Zhu, Jinchuan Shi +4Temporal Video GroundingVideo Understanding

    Zhejiang University, State Key Lab of CAD & CG

  3. CoVisco: Codec-Native Vision Encoder with Native Token Compression for Unified Image-Video Understanding

    Sep 30, 2026Yulong Liu, Xiaotian Han, Junyuan Shang +6Video UnderstandingEfficient VLM Inference

    ERNIE Team, Baidu Inc. · The Hong Kong University of Science and Technology · Institute of Automation, Chinese Academy of Sciences (CASIA)

  4. Video-RSI: Recursive Self-Improvement of Video Understanding Agents via Harness Evolution

    Sep 29, 2026Bingjun Luo, Jialin Guo, Siqi LiVideo UnderstandingAgent Harness Optimization

    Tsinghua University · Harbin Engineering University

  5. Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

    Sep 29, 2026Yuedong Tan, Lei Qi, Yu Liu +13Video UnderstandingEgocentric Video QA

    INSAIT, Sofia University “St. Kliment Ohridski” · University of Würzburg · Technical University of Munich +2

  6. Rethinking Visual Token Compression for Video Large Language Models: A Simple Yet Strong Baseline

    Sep 28, 2026Xiao Zhang, Wang Zeng, Sheng Jin +3Video UnderstandingVideo-Language Models

    School of Computer Science and Engineering, Central South University · SenseTime Research and Tetras.AI

  7. CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models

    Sep 23, 2026Shuo Xing, Pooja Verlani, Balu Adsumilli +1Video UnderstandingVideo-Language Model Evaluation

    Texas A&M University, College Station, USA · Google Inc., Mountain View, USA

  8. MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos

    Sep 23, 2026Reno Kriz, David Etter, Alexander Martin +11Video UnderstandingVideo Retrieval

    Human Language Technology Center of Excellence · Johns Hopkins University · Georgetown University +2

  9. Can Vision-Language Models Analyze Human-Centered Video? Mapping Model Capabilities and Human-AI Collaborative Workflows

    Sep 23, 2026Xiyuan Shen, Jiuyang Lyu, Seokhyun Hwang +4Video UnderstandingVideo-Language Model Evaluation

    University of Washington, USA · Georgia Institute of Technology, USA · Google DeepMind, USA

  10. VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding

    Sep 14, 2026Weixin Xu, Zhenyu Yang, Bing Wang +2Video UnderstandingLong-Video Understanding

  11. Label-Guided Knowledge Distillation for 3D-CNNs in Action Recognition

    Sep 14, 2026Yanjiang Shi, Peng Zhao, Nan Qi +1Video UnderstandingHuman Activity Recognition

    School of Computer Science and Technology, and with the National Engineering Laboratory for Big Data Analytics (NEL-BDA), Xi’an Jiaotong University, Xi’an 710049, China

  12. Zero-shot video highlight detection based on text descriptions and synthetic images

    Sep 13, 2026Michal Byra, Alberto Presta, Grzegorz Stefanski +1Video UnderstandingTemporal Video Understanding

    Samsung AI Center, Warsaw, Poland · Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland

  13. Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding

    Sep 8, 2026Zhenxin Qin, Peng Shi, Cong Han +3Temporal Video GroundingVideo Understanding

    Tongji University · Bilibili Inc.

  14. Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding

    Sep 3, 2026Hongyu Qu, Guangming Yao, Ling Xing +7Memory-Augmented VLMsVideo Understanding

    Nanjing University of Science and Technology · Ant Group · National University of Singapore +1

  15. KnowVis: Knowledge-Centric Visual Summarization for Video Lectures

    Sep 3, 2026Yi Xu, Yifan Hou, Xiaoyu ZhangVideo UnderstandingVideo Summarization

    City University of Hong Kong · ETH Zürich

  16. DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos

    Aug 30, 2026Bomiao Wang, Zekai Shao, Jiexiang Lan +3Video UnderstandingVideo-Language Model Evaluation

    Fudan University · The Hong Kong University of Science and Technology (Guangzhou)

  17. NARU: A Benchmark for NARrative Evolution and Cultural Nuance Understanding in Japanese Extreme Long Video

    Aug 13, 2026Yuheng Huang, Jianlang Chen, Jiayang Song +6Video UnderstandingVideo-Language Model Evaluation

    The University of Tokyo, Tokyo, Japan · Kyushu University, Fukuoka, Japan · Macau University of Science and Technology, Macau, China +2

  18. DAEP: Difficulty-Aware Evidence Planning for Medical Video Corpus Temporal Answer Grounding

    Aug 7, 2026Tianjian He, Yujie Liu, Zhiping Huang +1Temporal Video GroundingVideo Understanding

    TikTok, ByteDance, China · Beijing Institute of Graphic Communication, Beijing, China · Lingnan University, Hong Kong, China

  19. QueenVIS: Rethinking Image-Only Training for Video Instance Segmentation via Query Enrichment

    Jul 27, 2026Arian Kheirandish, Fardin Ayar, Ehsan Javanmardi +2Video UnderstandingInstance Segmentation

    Amirkabir University of Technology (AUT), Tehran, Iran · The University of Tokyo, Tokyo, Japan

  20. MarineEVT: Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoning

    Jul 27, 2026Tuan-An To, Yuk-Kwan Wong, Tuan-Anh Vu +2Visual Question AnsweringVideo Understanding

    The Hong Kong University of Science and Technology, Hong Kong, China · University of California, Los Angeles CA, USA · University of Electronic Science and Technology of China, China

  21. T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video

    Jul 23, 2026Linlin Wang, Xue Yang, Zhihuang Zhou +3Video UnderstandingScene Graph Generation

    School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China · School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China

  22. VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding

    Jul 16, 2026Xinhao Li, Yuhan Zhu, Xiangyu Zeng +24Video UnderstandingStreaming Video Understanding

    Nanjing University · Nanyang Technological University · Shanghai AI Laboratory +1

  23. VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance

    Jul 16, 2026Yunfeng Liu, Yuandong Yang, Jiarui Han +5VLM EvaluationVideo Understanding

    1Nanjing University · 2Shanghai AI Laboratory

  24. SteelBench: Evaluating Vision-Language Models in Real-World Industrial Environments

    Jul 6, 2026Suryanarayana Reddy Yarrabothula, Manisha Chawla, Kunal Sinha +5VLM EvaluationVideo Understanding

    Indian Institute of Technology Bhilai · Steel Authority of India Limited · VIT Vellore

  25. K9-Bench: Evaluating Multimodal LLMs on Canine-Centric Videos

    Jul 2, 2026Khush Attarde, Yusuf Ali, Megha Thukral +3Video UnderstandingMultimodal Large Language Models

    Ogmen Robotics Inc., Massachusetts, USA · Georgia Institute of Technology, Atlanta, USA

  26. LongEgoRefer: A Benchmark for Long-Form Egocentric Video Referring Expression Comprehension

    Jul 2, 2026Shunya Kato, Taiki Miyanishi, Shuhei Kurita +3Temporal Video GroundingVideo Understanding

    Woven by Toyota, Japan · The University of Tokyo, Japan · National Institute of Informatics, Japan +3

  27. MedStreamBench: A Time-Aware Benchmark for Streaming and Proactive Medical Video Understanding

    Jul 2, 2026Yuan Wang, Shujian Gao, Songtao Jiang +2Video UnderstandingStreaming Video Understanding

    College of Computer Science and Technology, Zhejiang University, Zhejiang, China · Insititute of Trustworthy Embodied AI, Fudan University, Shanghai, China · Department of Electrical and Computer Engineering, Carnegie Mellon University, Pennsylvania, USA

  28. Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization

    Jul 1, 2026Mengjingcheng Mo, Jiaxu Leng, Xinbo GaoVideo UnderstandingDirect Preference Optimization

    School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China · Chongqing College of Artificial Intelligence, Chongqing, China

  29. DELTAVID: Enhancing Fine-Grained Spatiotemporal Perception with Cross-Video Differences

    Jun 26, 2026Yankai Yang, Yancheng Long, Bin Wen +4Video UnderstandingVideo-Language Models

    1Harbin Institute of Technology, Shenzhen · 2Kuaishou Technology

  30. HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models

    Jun 25, 2026Jiajun Wu, Haoyu Kang, Yining Sun +13Video UnderstandingVideo Content Moderation

    Central South University · Tsinghua University · South China Normal University +10

  31. P-JEPA: Procedural Video Representation Learning via Joint Embedding Predictive Architecture

    Jun 22, 2026Felix Tristram, Stefano Gasperini, Benjamin Killeen +4Temporal Action SegmentationVideo Understanding

    Technical University of Munich Munich Center for Machine Learning · Carl Zeiss AG · Carl Zeiss AG[cs.CV]

  32. HPP: Hierarchical Programmatic Probing for Long Video Understanding by Decoupling Perception and Reasoning

    Jun 19, 2026Awais Rauf, Ahmed Hasssan, Greg SlabaughVideo UnderstandingLong-Context Modeling

    Queen’s University Belfast · United Kingdom · AMD +2

  33. SA-VIS: Sparse frame Annotations for training Video Instance Segmentation

    Jun 18, 2026Edoardo Mello Rella, Ajad Chhatkuli, Shipra Jain +2Video UnderstandingVideo Object Segmentation

    CVL, ETH Zurich · INSAIT, Sofia University "St. Kliment Ohridski" · Align Technology

  34. Interpretable Temporal Facial-Region Motion Analysis for In-the-Wild Parkinson's Disease Video Classification

    Jun 8, 2026Riyadh AlmushrafyVideo UnderstandingMedical Diagnosis

    Majmaah University, Saudi Arabia · Department of Computer Science and Information, College of Science, Majmaah University, Saudi Arabia

  35. Momentum-Guided Semantic Forecasting (MoFore) for Self-Supervised Video Representation Learning

    Jun 8, 2026Qinwu XuVideo UnderstandingVideo Representation Learning

    ∗This work was independently developed during Early Feb –Mid April 2026.

  36. MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding

    Jun 8, 2026Jie Zhang, Qilang Ye, Hao Zhou +2Video UnderstandingMulti-Agent Collaboration

    School of Computing and Information Technology, Great Bay University · College of Computer Science, Nankai University · Tsinghua Shenzhen International Graduate School, Tsinghua University +1

  37. CACR:Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoning

    Jun 7, 2026Muge Qi, Rong Fu, Pengbin Feng +7Temporal Video GroundingVideo Understanding

    National Biomedical Imaging Center, Peking University, Beijing, China · University of Macau, Macau, China · University of Southern California, Los Angeles, USA +3

  38. Mind the Gap: Disentangling Performance Bottlenecks in Video Instance Segmentation

    Jun 5, 2026Danial Hamdi, Fardin Ayar, Mahdi JavanmardiVideo UnderstandingInstance Segmentation

    Computer Engineering Department, Amirkabir University of Technology (Tehran Polytechnic), No. 350, Hafez Ave., Valiasr Sq., Tehran, 15875-4413, Tehran, Iran

  39. StoryVideoQA: Scaling Deep Video Understanding with a Large-Scale, Multi-Genre and Auto-Generated Dataset

    Jun 4, 2026Zhengqian Wu, Zhixian Liu, Aodong Chen +6Video UnderstandingSynthetic Data Generation

    School of Computer Science, Wuhan University, Wuhan, 430072, Hubei, China. · 2National Engineering Research Center for Multimedia Software, China. · 3Hubei Key Laboratory of Multimedia and Network Communication Engineering, China.

  40. VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding

    Jun 3, 2026Lin Fu, Zheyuan Yang, Yang Wang +3Video UnderstandingVideo QA

    Zhejiang University, Hangzhou, Zhejiang, China · Tongji University, Shanghai, China · University of Chinese Academy of Sciences, Beijing, China +1

  41. VCIFBench: Evaluating Complex Instruction Following for Video Understanding

    Jun 3, 2026Huangchen Xu, Yuan Wu, Yi ChangVLM EvaluationVideo Understanding

    School of Artificial Intelligence, Jilin University · 2Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University · 3International Center of Future Science, Jilin University

  42. TeachObs: A Human-Validated Benchmark for Multimodal Teaching Observation and Model Evaluation

    May 29, 2026Yeil Jeong, Youngjin Yoo, Jiyoung Bae +5Video UnderstandingAI in Education

    Indiana University Bloomington · Pai Chai University · Korea University +4

  43. EarlyTom: Early Token Compression Completes Fast Video Understanding

    May 28, 2026Hesong Wang, Xin Jin, Lu Lu +4Video UnderstandingEfficient VLM Inference

    Zhejiang University · Westlake University · Alibaba Cloud Computing

  44. ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement

    May 28, 2026Jianping Ye, Michel WedelVideo UnderstandingOnline Advertising

    Department of Mathematics, University of Maryland, College Park, MD 20742, USA · Robert H. Smith School of Business, University of Maryland, College Park, MD 20742, USA

  45. MetaphorVU: Towards Metaphorical Video Understanding

    May 25, 2026Zhuoqun Li, Boxi Cao, Guiping Jiang +13VLM EvaluationFigurative Language Understanding

    Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Kuaishou Technology +1

  46. VideoOdyssey: A Benchmark for Ultra-Long-Context and Omni-Modal Video Understanding

    May 21, 2026Haichen He, Jiayi Zhou, Sifeng Shang +3VLM EvaluationVideo Understanding

    Hong Kong Baptist University · GVC Lab, Great Bay University · S-Lab, Nanyang Technological University

  47. Seizure-Semiology-Suite (S3): A Clinically Multimodal Dataset, Benchmark, and Models for Seizure Semiology Understanding

    May 21, 2026Lina Zhang, Tonmoy Monsoor, Peizheng Li +23Video UnderstandingMultimodal Large Language Models

    University of California, Los Angeles · Mercedes-Benz AG · University of Pittsburgh +4

  48. RECIPE: Procedural Planning via Grounding in Instructional Video

    May 19, 2026Luigi Seminara, Antonino Furnari, Lorenzo TorresaniVideo Understanding

    Khoury College of Computer Sciences, Northeastern University, Boston · Department of Mathematics and Computer Science, University of Catania, Italy

  49. ViMU: Benchmarking Video Metaphorical Understanding

    May 14, 2026Qi Li, Xinchao WangVideo UnderstandingVideo QA

    National University of Singapore

  50. BARISTA: A Multi-Task Egocentric Benchmark for Compositional Visual Understanding

    May 12, 2026Patrick Knab, Orgest Xhelili, Inis Buzi +7Video UnderstandingScene Graph Generation

    Ramblr.ai Research · Technical University of Clausthal

  51. Uncertainty-Aware and Decoder-Aligned Learning for Video Summarization

    May 10, 2026Omer Tariq, Syed Muhammad Raza, Jeongbae SonVideo UnderstandingUncertainty Quantification

    Perception AI · Neubility Inc. · Seoul, South Korea

  52. Bridging Modalities, Spanning Time: Structured Memory for Ultra-Long Agentic Video Reasoning

    May 8, 2026Jiazheng Li, Chi-Hao Wu, Yunze Liu +3Video UnderstandingMultimodal Memory

    University of Connecticut · Northwestern University · University of Virginia

  53. Can Multimodal Large Language Models Understand Pathologic Movements? A Pilot Study on Seizure Semiology

    May 5, 2026Lina Zhang, Tonmoy Monsoor, Mehmet Efe Lorasdagi +8Video UnderstandingMultimodal Large Language Models

    University of California, Los Angeles · Mercedes-Benz AG · Zhejiang University

  54. HY-Himmel Technical Report: Hierarchical Interleaved Multi-stream Motion Encoding for Long Video Understanding

    May 4, 2026Haopeng Jin, Hongzhu Yi, Wenlong Zhao +6Video UnderstandingVideo-Language Models

    Tencent · University of Chinese Academy of Sciences · Beijing Forestry University

  55. OmniEncoder: See, Hear, and Feel Continuous Motion Like Humans With One Encoder

    May 2, 2026Detao Bai, Shimin Yao, Weixuan Chen +4Cross-Modal LearningVideo Understanding

    1Tongyi Lab Alibaba Group · Shenzhen University of Advanced Technology

  56. SF20K Competition 2025: Summary and findings

    May 2, 2026Ridouane Ghermi, Xi Wang, Vicky Kalogeiton +1VLM EvaluationVideo Understanding

  57. VISTA: Video Interaction Spatio-Temporal Analysis Benchmark

    May 2, 2026Alejandro Aparcedo, Akash Kumar, Aaryan Garg +5VLM EvaluationVideo Understanding

    University of Central Florida · BITS Pilani · Ho Chi Minh City University of Science +1

  58. High-Speed Vision Improves Zero-Shot Semantic Understanding of Human Actions

    May 1, 2026Yongpeng Cao, Yuji YamakawaVideo UnderstandingZero-Shot Learning

    Institute of Industrial Science, The University of Tokyo, Japan · Interfaculty Initiative in Information Studies, Graduate School of Interdisciplinary Information Studies, The University of Tokyo, Japan

  59. DenseStep2M: A Scalable, Training-Free Pipeline for Dense Instructional Video Annotation

    Apr 29, 2026Mingji Ge, Qirui Chen, Zeqian Li +1Video UnderstandingLLM-Assisted Annotation

    SAI, Shanghai Jiao Tong University · Shanghai, China

  60. Beyond Screenshots: Evaluating VLMs' Understanding of UI Animations

    Apr 28, 2026Chen Liang, Xirui Jiang, Naihao Deng +2VLM EvaluationVideo Understanding

    University of Michigan