Overview

Video frame selection studies how to choose a small set of frames that preserves the events, objects, and temporal context needed for a task while reducing computation, storage, or annotation. It matters in long-video question answering, surveillance, robotics, medical imaging, and compression, where processing every frame is expensive but missing a brief event can change the result. Methods range from uniform or shot-based sampling and motion or novelty filters to graph- and coverage-based diversity, query-conditioned relevance ranking, and adaptive selectors that use uncertainty, attention, or event structure; selected frames may also receive different resolutions or budgets. Current work increasingly integrates selection with video-language models and edge systems, but a central tension remains: task-specific evidence can improve accuracy while making selections less reusable, and sparse samples risk losing event order, transitions, or rare events, making careful benchmark and budget-matched comparisons important.

Latest papers

CardsList

69 papers4 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. APS: Adaptive Partitioning-Based Frame Selection for Long Video Understanding

    Nov 18, 2026Junxiang Wen, Yinxi Zhao, Jiawei Chen +4Video Frame SelectionAdaptive Video Frame Sampling

  2. VIVID: Beyond Static Multi-Image Reasoning with Localized Visual Differences and Textual Entity Dynamics in Video MLLMs

    Nov 17, 2026Chengqian Ma, Yuanze Zeng, Hongyu Wang +8Video Question AnsweringTemporal Video Understanding

  3. CEVA: Complementary Evidence Verification via Frame-Level Reorganization for Short-Video Fake News Detection

    Nov 17, 2026Wenshen Yang, Junfeng Hao, Jing Li +4Fake News DetectionMultimodal Deception Detection

  4. SceneBound: How Much Should a Streaming 3D Reconstruction Model Remember?

    Oct 31, 2026Ziming Wang, Chuyue Gong, Chutian Wang +4Streaming 3D ReconstructionVideo Frame Selection

  5. MoG-VLM: Efficient Video Anomaly Detection through Motion-Guided Vision-Language Models

    Oct 22, 2026Khaled Waleed Dawoud, Muhammad Zaigham Zaheer, Khan Muhammad +1Video Anomaly DetectionEfficient VLM Inference

  6. KFS4^4LAM: Adaptive KeyFrame Selection with Structure-Aware Mapping for Endoscopic Gaussian Splatting SLAM

    Oct 15, 2026Xinwei Ju, Zhehua Mao, Tianyi Song +33D Mapping3DGS SLAM

  7. MetaSampling: Making Frame Samplers Efficient for Long-Video Question Answering

    Sep 27, 2026Ashim Dahal, Bikramjit BanerjeeMultimodal Large Language ModelsAdaptive Sampling

  8. dKFD: Phase-Structured Evidence Allocation for Fixed-Budget Localized Event Understanding

    Sep 27, 2026Aditya Bagri, Ashutosh Kumar, Chaitanya Lakhchaura +3Video Frame SelectionTemporal Video Understanding

  9. Frame-to-Panorama Localization and Context-Aware Sampling for Scene-Specific Ship Detection in a Smart Marina Testbed

    Sep 24, 2026Ignat Romanov, Andreas Hadjipieris, Neofytos DimitriouTraining Data SelectionVideo Frame Selection

  10. SVMemAgent: A Streaming Video Memory Agent for Query-Agnostic Online Frame Selection

    Sep 16, 2026Dohwan Ko, Ji Soo Lee, Pierce Chuang +7Video Frame SelectionStreaming Video Understanding

  11. MarKey: Marginal Utility Guided Greedy Keyframe Selection for Long Video Understanding

    Sep 14, 2026Hongchang Shi, Jinpeng Hu, Ao Wang +4Long-Video UnderstandingVideo Frame Selection

  12. Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence

    Sep 11, 2026Yifeng Luo, Yupeng Li, Ming Tang +2Fake News DetectionAutomated Fact-Checking

  13. Evaluation of MLLM-Agnostic Plug-and-Play Keyframe Selection Methods for Long Video Understanding

    Sep 4, 2026Dilip Sarkar, Md. Safayet Islam, Liang LiangLong-Video UnderstandingVideo Frame Selection

  14. CoFiE: Coarse-to-Fine Evidence Selection for Efficient Streaming Video Understanding

    Sep 3, 2026Jing Jiang, Yiran Ling, Ruonan Li +2Streaming Video UnderstandingEfficient VLM Inference

  15. RIDGE: Region-Informed Derivative-Guided Evidence Selection for Long Video Understanding

    Aug 30, 2026Shanqing Xu, Meng Luo, Mengchen Qian +7Large Vision-Language ModelsLong-Video Understanding

  16. Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge

    Aug 29, 2026Amir Taherin, José Cano, Bin Ren +2Edge InferenceEfficient Object Detection

  17. Pre-Decoding Acoustic Triage for Budgeted Vision-Language Captioning of Untrimmed Egocentric Video

    Aug 23, 2026Masoud Jalayer, Changyi Li, Yu XiaoEgocentric Video UnderstandingVideo Frame Selection

  18. MEDR: Query-Independent Frame Selection via Multi-Signal Event Modeling and Dynamic Rescoring

    Aug 15, 2026Xinlei Pu, Weijie Shi, Wen Yang +7Video Frame SelectionVideo-Language Models

  19. Evidence-Driven Dynamic Visual Selector for Efficient Long Video Understanding

    Aug 6, 2026Bo Zhang, Wenxin Wang, Feng Chen +4Efficient VLM InferenceLong-Video Understanding

  20. One Ranking, Any Budget: Matryoshka Evidence-to-Context Frame Selection for Long-Video Understanding

    Aug 6, 2026Wang Chen, Yu Chen, Xiang Wang +3Long-Video UnderstandingVideo Frame Selection

  21. When and Where to Look: Adaptive Visual Evidence Scheduling for Efficient Long Video Understanding

    Aug 4, 2026Ke Li, Jiayu Chen, Maoliang Li +5Efficient VLM InferenceLarge Vision-Language Models

  22. Caved or Convinced: Temporal Sampling Gates Claim Deference in Video Large Language Models

    Aug 4, 2026Yuxin Cao, Wei Song, Jingling Xue +1Selective PredictionVideo-Language Model Evaluation

  23. Ground, Cover, and Refine: Evidence-Centric Frame Selection for Long-Video Question Answering

    Aug 3, 2026Fan Wei, Siru Zhong, Runmin Dong +3Long-Video UnderstandingVideo Frame Selection

  24. Coverage-Driven Adaptive Keyframe Selection for Video Understanding

    Aug 1, 2026Junyang Zhang, Puhan Luo, Chen Tang +2Efficient VLM InferenceLarge Vision-Language Models