Fine-Grained Video Understanding

Ask about this topic

Momentum

27 papers in the last four weeks, up 170% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 174

All topics
CardsList

  1. Multi-Label Perceptual Bug Detection in Video Games using Deep Learning on Gameplay Footage

    Oct 6, 2026Nahian Rifaat, Felix Morosov, Loutfouz ZamanFine-Grained Video Understanding

    Ontario Tech University Oshawa, Ontario, Canada · Universität Osnabrück Osnabrück, Niedersachsen, Germany

  2. MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos

    Oct 6, 2026Souptik Sen, Zahra AhmadiFine-Grained Video UnderstandingVideo Joint Embedding Predictive Architecture

    Peter L. Reichertz Institute for Medical Informatics, Hannover Medical School, Germany · Lower Saxony Center for Artificial Intelligence and Causal Methods in Medicine (CAIMed), Hannover, Germany

  3. Joint Class-Time Learning for Video Classification with Multi-Instance Partial-Label Learning

    Oct 5, 2026Lingyu Shen, Wei Tang, Fakhri Karray +1Fine-Grained Video Understanding

    School of Computer Science and Engineering, Southeast University, Nanjing 210096, China · Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, United Arab Emirates

  4. RoMod: Temporal Routing Modulation via Mixture-of-Experts for Video Anomaly Detection

    Oct 4, 2026Chao Huang, Pengfei Wei, Benfeng Wang +5Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    Sun Yat-sen University · University of Macau

  5. Representation--Behavior Alignment for Explainable Weakly-Supervised Video Anomaly Detection

    Oct 4, 2026Chao Huang, Pengfei Wei, Kaige Li +4Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    Sun Yat-sen University · University of Macau

  6. Controllable Multi-label Video Safety Detection via Adaptive Tversky Policy Optimization

    Oct 1, 2026Guangyu Yang, Jingbiao Mei, Mingsheng Sun +5Fine-Grained Video UnderstandingFrictive Policy Optimization

    University of Cambridge · Xiaohongshu Inc. · AntGroup +2

  7. Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding

    Oct 1, 2026Mohd Ubaid Wani, Sara Atito, Josef Kittler +1Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    Centre for Vision, Speech and Signal Processing (CVSSP) University of Surrey, UK · Surrey Institute for People-Centred AI (PAI) University of Surrey, UK

  8. Can We Anticipate Violence? Multimodal Learning from Pre-Incident Behavioral Cues

    Sep 30, 2026Sindhuja Penchala, Mohammed Yusuf Mujawar, Noorbakhsh Amiri Golilarz +2Fine-Grained Video UnderstandingViolence Detection

    Department of Computer Science, The University of Alabama, Tuscaloosa, AL 35487, USA

  9. TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection

    Sep 30, 2026Bo-Yuan Cheng, Kuan-Yu Chen, Po-Han Huang +2Fine-Grained Video UnderstandingAi-Generated Video Detection

    AI Research Center, Inventec Corporation, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan

  10. Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

    Sep 29, 2026Yuedong Tan, Lei Qi, Yu Liu +13Egocentric VideoFine-Grained Video Understanding

    INSAIT, Sofia University “St. Kliment Ohridski” · University of Würzburg · Technical University of Munich +2

  11. AffectReveal: Event-Grounded Emotion Recognition Beyond Visual Appearances

    Sep 29, 2026Yihao Qian, Runhao Zeng, Sicheng Zhao +3Emotion RecognitionFine-Grained Video Understanding

    South China University of Technology, Guangzhou, China · Shenzhen MSU-BIT University, Shenzhen, China · Tsinghua University, Beijing, China

  12. Cross-attention encoding models reveal dynamic spatiotemporal routing across human higher visual cortex

    Sep 28, 2026Iishaan Inabathini, Margaret M. HendersonSpatio-Temporal AttentionHuman Visual Cortex

    Carnegie Mellon University

  13. W2Rep: Learning Visual Representations by Watching the World Change

    Sep 28, 2026Wen Huang, Hang Guo, Jiarui Yang +3Fine-Grained Video UnderstandingVision Encoders

    Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Nankai University, Tianjin, China · Shenzhen University, Shenzhen, China

  14. When Should the Count Change? Learning State Maintenance for Causal Video Counting

    Sep 28, 2026Pengyiang Liu, Dongyue Lyu, Junbo Niu +3Fine-Grained Video UnderstandingVision State Space Models

    Beihang University · Peking University

  15. Native Association: Confidence-Aware Human Perception in the Wild with a Foundation VLM

    Sep 27, 2026Igal Dmitriev, Ofir LibaFine-Grained Video UnderstandingOptical Character Recognition

    WSC Sports, Tel Aviv, Israel

  16. Groupwise Selective State-Space Filtering for Accurate and Streaming Action Boundary Detection

    Sep 27, 2026Mustafa Bora ÇelikTemporal Action LocalizationFine-Grained Video Understanding

    Department of Electrical and Electronics Engineering, Ankara Medipol University, Ankara, Turkey

  17. Cross-modal Translation via Conditional Latent Denoising for Video Deepfake Detection

    Sep 27, 2026Xinzhe Li, Youzhi Tu, Kong Aik LeeDeepfake DetectionAi-Generated Video Detection

    Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong SAR

  18. LAYERSCOPE: A Layerwise Characterization of Video and Multimodal Learned Representations

    Sep 23, 2026Sandra Arcos-Holzinger, Debashish Chakraborty, Rohita Mocharla +7Multimodal RepresentationsFine-Grained Video Understanding

    Johns Hopkins University · University of Melbourne · Human Language Technology Center of Excellence +2

  19. Prompt, Probe, Train, or Annotate? Single-camera sports video understanding in amateur settings

    Sep 23, 2026Sai Varun Kodathala, Prashanth Pollishetty, Jaylen CargillFine-Grained Video UnderstandingAthleticism

    Research and Development Sports Vision, Inc. Minnetonka, MN

  20. Action-Slot: Structured Action-Centric Representation Learning for Multi-Agent Atomic Activity Understanding

    Sep 21, 2026Yu-Ho Chang, Chi-Hsi Kung, Yi-Hsuan Tsai +1Object-Centric RepresentationsFine-Grained Video Understanding

    National Yang Ming Chiao Tung University · Atmanity Inc.

  21. Video-STLayout Pre-training

    Sep 21, 2026Akash Abdu Jyothi, Greg MoriFine-Grained Video UnderstandingVision Encoders

    School of Computing Science Simon Fraser University Burnaby, Canada

  22. PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videos

    Sep 17, 2026Di Wen, Kailun Yang, Jimmy Weissert +7Egocentric VideoFine-Grained Video Understanding

    Karlsruhe Institute of Technology, Karlsruhe 76131, Germany · Hunan University, Changsha 410012, China

  23. E-AVI: Evidence-Grounded Multimodal Assessment for Automated Video Interviews

    Sep 17, 2026Haoshen Wang, Dongbo Che, Zeyi Xie +3Multimodal EvaluationFine-Grained Video Understanding

    The Hong Kong Polytechnic University · Independent Researcher

  24. Divide and Conquer: Mixture-of-Bottleneck Experts in Informative Ordinal Space for Video-based Multimodal Sentiment Analysis

    Sep 16, 2026Ronghao Lin, Qiaolin He, Zefeng Lu +5Multimodal Sentiment AnalysisMultimodal Deep Learning

    College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China · Nanyang Technological University, Singapore, 639798 · School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou 510006, China +4

  25. Semantic-Aware Neural Video Codec for Error-Resilient Low-Latency Transmission

    Sep 14, 2026Matin Mortaheb, Homa Esfahanizadeh, Jinfeng Du +1Video CompressionFine-Grained Video Understanding

    Nokia Bell Labs, Murray Hill, NJ 07974, USA

  26. Zero-shot video highlight detection based on text descriptions and synthetic images

    Sep 13, 2026Michal Byra, Alberto Presta, Grzegorz Stefanski +1Ai-Generated Video DetectionFine-Grained Video Understanding

    Samsung AI Center, Warsaw, Poland · Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland

  27. Beyond Similarity: Foundation Models as an Efficient Backbone for Training-Free Composed Video Retrieval

    Sep 9, 2026Dmitry Demidov, Muhammad Zaigham Zaheer, Omkar Thawakar +2Fine-Grained Video UnderstandingMultimodal Retrieval

    Mohamed bin Zayed University of Artificial Intelligence, UAE

  28. EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning

    Sep 8, 2026Jingpu Yang, Fengxian Ji, Mingxuan Cui +4Motion-Based PerceptionFine-Grained Video Understanding

    Beihang University, Beijing, China · Zhongguancun Academy, Beijing, China · Northeastern University, Shenyang, China +1

  29. SoftRerank: Hierarchical Soft Fusion with Candidate-Label Reranking for Long-Tailed Micro-Action Recognition

    Sep 8, 2026Yichi Zhang, Zhichao Xia, Yanjun Chi +6Open-Vocabulary Action RecognitionFine-Grained Video Understanding

    University of Science and Technology of China · Unisound AI Technology Co., Ltd.

  30. Boundary Voting Network for Ambiguity-Aware Timestamp-Supervised Action Segmentation

    Sep 8, 2026Runzhong Zhang, Yueqi Duan, Yang Chen +4Temporal Action SegmentationFine-Grained Video Understanding

    School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · Department of Electronic Engineering, Tsinghua University, Beijing, China · Amazon, Seattle, America

  31. Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision

    Sep 3, 2026Shravan Venkatraman, Wenshuai Zhao, Mohammad Hassan Vali +1Fine-Grained Video UnderstandingState-Tracking

    Mohamed bin Zayed University of Artificial Intelligence, UAE · Aalto University, Finland · ELLIS Institute Finland & Department of Computer Science, Aalto University, Finland

  32. Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendation

    Sep 1, 2026Xin LiuVideo Temporal GroundingShort Video Bursts

  33. Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring

    Aug 31, 2026Vanodhya G. Warnasooriya, Amir Hajian, Watchara Ruangsang +1Training-Free Video Anomaly DetectionYolo26

    Dept. of Electrical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand · Media Technology Program, King Mongkut’s Univ. of Technology Thonburi, Bangkok 10150, Thailand

  34. PRISM: Predictive Recomposition via Semantic Latent Decomposition for View-invariant Video Representation Learning

    Aug 31, 2026Youngchae Chee, Hosu Lee, Sungjune Park +2Fine-Grained Video UnderstandingEgocentric Video

    KAIST · University of Illinois Urbana-Champaign

  35. TraVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval

    Aug 13, 2026Yi-Chung Chen, Philip Jacobson, Tom Lampo +6Fine-Grained Video UnderstandingVisual Embeddings

    Uber AV Labs · Purdue University

  36. UniTraffic-Agent: Unified Traffic Video Reasoning for AI City Challenge 2026 Track 3 with Two Out-of-Domain Evaluations

    Aug 13, 2026Peng Li, Qianqian Xu, Shilong Bao +2Intelligent TransportationFine-Grained Video Understanding

    School of Computer Science and Technology, University of Chinese Academy of Sciences (UCAS), Beijing, China · State Key Laboratory of AI Safety, Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS), Beijing, China · Beijing Academy of Artificial Intelligence (BAAI), Beijing, China +1

  37. TD-VAD: Breaking Visual Dependence in Video Anomaly Detection with Text-Driven Learning

    Aug 12, 2026Shuangqing Zhang, Lei-Lei Ma, Zhao Wang +5Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    School of Intelligence Science and Technology, Nanjing University, Suzhou 215163, China. · School of Artificial Intelligence Engineering, Hefei Institute of Technology, Hefei 230001, China. · China Mobile Zijin Innovation Institute, Nanjing 211800, China. +1

  38. From Detection to Understanding: TAR and TAR-Bench for Multi-Task Traffic Anomaly Reasoning

    Aug 10, 2026Han Zhang, Yilin Zhao, Zaid Pervaiz Bhat +5Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    NVIDIA · Santa Clara University

  39. Beyond Hazard Resemblance: Contrastive Event Adjudication for Training-Free Video Anomaly Detection

    Aug 10, 2026Wenti Yin, Xiang Wang, Huaxin Zhang +4Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    Key Laboratory of Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology · Alibaba Group · The Hong Kong University of Science and Technology (Guangzhou)

  40. Agreement-Based Audio-Visual Segmentation:Champion Report for the MeViS-Audio Track in the 8th LSVOS Challenge

    Aug 10, 2026Yiwen Ren, Jianing Liu, Yingxin Wang +4Video Object SegmentationFine-Grained Video Understanding

    National 111 Project Base of Intelligent Information Processing

  41. SCoPE: Training-Free Audio-Visual Event Perception via Sparse Cross-Modal Prior Exchange

    Aug 8, 2026Jaemo Jeong, Junho Yoon, Hyunju Kim +1Audio-Visual ReasoningFine-Grained Video Understanding

    KAIST

  42. Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning

    Aug 7, 2026Shibo Gao, Peipei Yang, Xu-Yao Zhang +1Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing 100044, China. · Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China. · State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.

  43. MuST-VAD: Mutual Structured Learning for Video Anomaly Detection

    Aug 7, 2026Satoshi Hashimoto, Hitoshi Nishimura, Mori KurokawaTraining-Free Video Anomaly DetectionFine-Grained Video Understanding

    KDDI Research, Inc. Fujimino, Saitama, Japan

  44. TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding

    Aug 6, 2026Kepeng Yang, Dongxuan Liu, Rongxin Gao +8Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    XMU · THU · CUHK +1

  45. Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting

    Aug 3, 2026Ruifeng Wang, Di Yang, Jiangtao WangTemporal Action LocalizationTemporal Attention

    School of Artificial Intelligence & Data Science, USTC, Hefei, China · Suzhou Institute for Advanced Research, USTC, Suzhou, China

  46. HyperClaim: Fine-Grained Cross-Modal Hypergraph Reasoning for Video Misinformation Detection

    Jul 30, 2026Xiangbo Wang, Jiasheng Zhang, Xingtong Yu +2Fine-Grained Video UnderstandingAuthenticity

    School of Communication Engineering, Hangzhou Dianzi University · School of Computer Science and Technology, Xidian University · School of Computing and Information Systems, Singapore Management University +1

  47. ENCORE: Event-Assisted Complementary Motion Refinement for Learned Video Compression

    Jul 30, 2026Shuhan Ye, Hongbin Yu, Chenqi Kong +4Video CompressionFine-Grained Video Understanding

    School of Computer Science, Wuhan University, Wuhan, China · School of Artificial Intelligence, Ningbo University, Ningbo, China · National University of Singapore, Singapore +2

  48. Knowledge-Guided Multimodal Reasoning over Interacting Streams for Video-Level Ambivalence and Hesitancy Recognition

    Jul 28, 2026Podakanti Satyajith Chary, Barath Parthiban, Pranesh Velmurugan +2Cross-Modal ConflictsFine-Grained Video Understanding

    Department of Engineering Science, IIT Hyderabad, India · Department of Biomedical Engineering, IIT Hyderabad, India

  49. Knowledge-guided Disentanglement with Atomic Actions for Action Recognition

    Jul 28, 2026Tianci Wu, Siqi Cao, Guangming Zhu +6Open-Vocabulary Action RecognitionFine-Grained Video Understanding

    Xidian University Xi’an, China · National University of Defense Technology Changsha, China · Hunan Institute of Advanced Technology Changsha, China +1

  50. BasketEvent: Understanding Who Did What and When in Basketball Videos

    Jul 23, 2026Yu Zhang, Jiayuan Rao, Haoning Wu +1Fine-Grained Video Understanding

    School of Artificial Intelligence, Shanghai Jiao Tong University Shanghai, China

  51. Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval

    Jul 23, 2026Kyeongmo Chae, Jihoon Lee, Sangtae AhnFine-Grained Video UnderstandingCross-Modal Alignment

    School of Electronic and Electrical Engineering, Kyungpook National University, Daegu, South Korea

  52. Sidewalk Moments: Are Richer Representations Always More Human-Aligned? Evidence from City-Walk Videos

    Jul 23, 2026Liu Liu, Freya Huying Tan, Fábio DuarteFine-Grained Video UnderstandingUrban Environments

    Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139, USA · City Form Lab, MIT · Senseable City Lab, MIT

  53. Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness

    Jul 22, 2026Inpyo Song, Jangwon LeeTraining-Free Video Anomaly DetectionAnomaly Score

  54. TOM-GS: Editable Video Representation via Temporal Opacity Modulation of Static 3D Gaussians

    Jul 21, 2026Marek Lisowski, Łukasz Smoliński, Kornel Howil +33D GaussianDynamic 3D Gaussian Splatting

    University of Warsaw, Faculty of Mathematics, Informatics, and Mechanics · Jagiellonian University, Faculty of Mathematics and Computer Science · IDEAS Research Institute

  55. Context-structured Video Anomaly Detection with Large Vision-Language Models

    Jul 21, 2026Dongjun Kim, Changjae Oh, Andrea Cavallaro +1Training-Free Video Anomaly DetectionFine-Grained Video Understanding

    Yonsei University, Seoul, Republic of Korea · Queen Mary University of London, London, United Kingdom · EPFL, Lausanne, Switzerland

  56. Sparse Evidence Can Suffice: Agentic Evidence Seeking for Multimodal Video Misinformation Detection

    Jul 20, 2026Haochen Zhao, Yongxiu Xu, Xinkui Lin +6Misinformation DetectionFine-Grained Video Understanding

    Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China · Baidu, Beijing, China

  57. VLA-ReID: Video-Level Association for Re-Identification in Multi-Object Tracking with Highly Similar Objects

    Jul 19, 2026Yanrong Qin, Xiaoyan Cao, Yao YaoMulti-Object TrackingRe-Identification

    Glasgow College, University of Electronic Science and Technology of China, Chengdu, China · Key Laboratory for Urban Habitat Environmental Science and Technology, School of Environment and Energy, Peking University Shenzhen Graduate School, Shenzhen, China · School of Management Science and Real Estate, Chongqing University, Chongqing, China

  58. VideoSEMA: a scalable and efficient Mamba-like attention for video understanding

    Jul 16, 2026Nhat Thanh Tran, Fanghui Xue andShuai Zhang, Jiancheng Lyu +3Fine-Grained Video UnderstandingSpatio-Temporal Attention

    Department of Mathematics University of California, Irvine Irvine, USA · Qualcomm AI Research San Diego, USA

  59. CF-Net: Conflict Fusion with Speaker Normalisation and Certainty Weighting for Ambivalence/Hesitancy Recognition

    Jul 15, 2026Tung Hung Bui, Hong Hai Nguyen, Van Thong HuynhCross-Modal ConflictsMultimodal Deep Learning

    Dept. of AI, FPT University · Fac. of CSE, HCMC University of Technology - VNUHCM

  60. RainDancer: RGB-Event Video Deraining with Rain-Oriented Spiking Dynamics

    Jul 15, 2026Kui Jiang, Runzhe Li, Zhaocheng Yu +3RgbtVideo Restoration

    School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China · School of Computer Science and Technology, Harbin University of Science and Technology, Harbin, China