Video Frame Selection

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, up 67% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 46

All topics

FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering
Sep 30, 2026Haifeng Huang, Biyin Xu, Chunsheng Xin +1Video Frame Selection Long-Video QA
Iowa State University.
MetaSampling: Making Frame Samplers Efficient for Long-Video Question Answering
Sep 27, 2026Ashim Dahal, Bikramjit BanerjeeMultimodal Large Language Models Adaptive Sampling
University of Southern Mississippi Hattiesburg, MS, USA
Frame-to-Panorama Localization and Context-Aware Sampling for Scene-Specific Ship Detection in a Smart Marina Testbed
Sep 24, 2026Ignat Romanov, Andreas Hadjipieris, Neofytos DimitriouTraining Data Selection Video Frame Selection
Department of Computer Science University of Nicosia Nicosia, Cyprus · Maritime Digitalization Centre Cyprus Marine and Maritime Institute Larnaca, Cyprus
MarKey: Marginal Utility Guided Greedy Keyframe Selection for Long Video Understanding
Sep 14, 2026Hongchang Shi, Jinpeng Hu, Ao Wang +4Long-Video Understanding Video Frame Selection
Hefei University of Technology, Hefei, China
Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence
Sep 14, 2026Yifeng Luo, Yupeng Li, Ming Tang +2Fake News Detection Automated Fact-Checking
Department of Interactive Media; Hong Kong Baptist University · AI and Social Good Lab, AI Media Centre; Hong Kong Baptist University · Department of Computer Science and Engineering, Southern University of Science and Technology +1
Select, Compress, Reinvest: A Controlled Study of Visual-Token Allocation in Long-Video MLLMs
Sep 3, 2026Prakhar KhatriVideo-Language Model Evaluation Long-Video Understanding
Independent Researcher
CoFiE: Coarse-to-Fine Evidence Selection for Efficient Streaming Video Understanding
Sep 3, 2026Jing Jiang, Yiran Ling, Ruonan Li +2Streaming Video Understanding Efficient VLM Inference
Harbin Institute of Technology · State Key Laboratory of Smart Farm Technologies and Systems · Pengcheng Laboratory
RIDGE: Region-Informed Derivative-Guided Evidence Selection for Long Video Understanding
Aug 30, 2026Shanqing Xu, Meng Luo, Mengchen Qian +7Large Vision-Language Models Long-Video Understanding
Huazhong University of Science and Technology · National University of Singapore · Fudan University
Evidence-Driven Dynamic Visual Selector for Efficient Long Video Understanding
Aug 6, 2026Bo Zhang, Wenxin Wang, Feng Chen +4Efficient VLM Inference Long-Video Understanding
1Sichuan University · 2Adelaide University · 3Beijing Institute of Technology
One Ranking, Any Budget: Matryoshka Evidence-to-Context Frame Selection for Long-Video Understanding
Aug 6, 2026Wang Chen, Yu Chen, Xiang Wang +3Long-Video Understanding Video Frame Selection
Media Analytics and Computing Lab, Xiamen University, Xiamen, China · Amap, Alibaba Group, China · Department of Computer Science, University of Rochester, Rochester, NY, USA
Beyond Frame Selection: Rethinking Long-Video Understanding with MLLMs
Aug 6, 2026Ziling Huang, Shin'ichi SatohMultimodal Large Language Models Long-Video Understanding
National Institute of Informatics, Japan
When and Where to Look: Adaptive Visual Evidence Scheduling for Efficient Long Video Understanding
Aug 4, 2026Ke Li, Jiayu Chen, Maoliang Li +5Efficient VLM Inference Large Vision-Language Models
School of Electronics Engineering and Computer Science, Peking University · School of Computer Science, Peking University
Caved or Convinced: Temporal Sampling Gates Claim Deference in Video Large Language Models
Aug 4, 2026Yuxin Cao, Wei Song, Jingling Xue +1Selective Prediction Video-Language Model Evaluation
National University of Singapore, Singapore · University of New South Wales, Australia
Ground, Cover, and Refine: Evidence-Centric Frame Selection for Long-Video Question Answering
Aug 3, 2026Fan Wei, Siru Zhong, Runmin Dong +3Long-Video Understanding Video Frame Selection
Department of Earth System Science, Tsinghua University · 5The Hong Kong University of Science and Technology (Guangzhou) · School of Artificial Intelligence, Sun Yat-Sen University +2
Coverage-Driven Adaptive Keyframe Selection for Video Understanding
Aug 1, 2026Junyang Zhang, Puhan Luo, Chen Tang +2Efficient VLM Inference Large Vision-Language Models
University of Science and Technology of China, Hefei, China
FORGE: Frame Orthogonality in Relevance Geometry for Long-Form Video Understanding
Jul 28, 2026Ghazal Kaviani, Ghassan AlRegibEfficient Multimodal Inference Multimodal Large Language Models
1OLIVES at the Center for Signal and Information Processing (CSIP), School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA.
The Visual Bottleneck: Sparse-Frame Adaptation of MLLMs for Joint Spatial-Temporal Video Grounding
Jul 27, 2026Jiameng Zhang, Srikanth MadikeriTemporal Video Grounding VLM Adaptation
University of Zurich
PCA: Persistence-Aware Compression and Aggregation for Fast Video Large Language Models
Jul 22, 2026Zihan Song, Shuo Ye, Bo Zhao +4Video-Language Models Video Frame Selection
Institute for Artificial Intelligence, Great Bay University · Sun Yat-sen University · Youtu Lab, Tencent +2
Efficient Frame Selection for Long Videos at Test Time with Attention-Based MLLM Selectors
Jul 17, 2026Yilin Wang, Xiangxi Zheng, Dongxing Mao +6Efficient VLM Inference Multimodal Large Language Models
ZJU · NJU · CSU +2
Gaussian Mixture Modeling for Event-Aware Visual Allocation in Long Video Understanding
Jul 14, 2026Yifan Lu, Ziqi Zhang, Chunfeng Yuan +3Large Vision-Language Models Video Frame Selection
Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information, CASIA · State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA · School of Artificial Intelligence, University of Chinese Academy of Sciences +2
ReQuest: Rethinking-based Question-Aware Frame Selection for Long-Form Video QA
Jul 2, 2026Minkuk Kim, Suyong Yun, Young Tae Kim +3Efficient VLM Inference Video QA
Kyung Hee University, Republic of Korea · Electronics and Telecommunications Research Institute (ETRI), Republic of Korea
QCA: Query- and Content-Aware Keyframe Selection for Long Video Understanding
Jul 1, 2026Jun Peng, Baiyang Song, Jie Li +4Long-Video Understanding Video Frame Selection
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, P.R. China · Peng Cheng Laboratory, Shenzhen, P.R. China · School of Electronic and Computer Engineering, Peking University, P.R. China
Foundation Model-driven Key Anatomy Frame Selection for Blind-sweep Ultrasound Fetal Birth Weight Estimation
Jul 1, 2026Le Ou, Xiliang Zhu, Huanwen Liang +8Ultrasound Imaging Video Frame Selection
Medical Ultrasound Image Computing (MUSIC) Lab, Shenzhen University, Shenzhen, China · School of Biomedical Engineering, Shenzhen University, Shenzhen, China · School of Biomedical EngineeringNanjing,and Informatics,China Nanjing Medical University +4
Towards Fast and Effective Long Video Understanding of Multimodal Large Language Models via Adaptive Quasi-Gaussian Sampling
Jun 23, 2026Kun Zhang, Chenxin Fang, Tao Chen +4Efficient Multimodal Inference Multimodal Large Language Models
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China
DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection
Jun 22, 2026Sudhanshu Mishra, Jialang Xu, Jensen Ang +3Surgical Video Understanding Video Frame Selection
Department of Electrical and Computer Engineering, National University of Singapore, Singapore · UCL Hawkes Institute, Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom · Department of Neurosurgery, National Neuroscience Institute, Singapore +1
FetSelect: Task-Specific Architectures and Self-Supervised Learning for Automated Fetal Ultrasound Frame Selection
Jun 21, 2026Mahmood Alzubaidi, Raden Muaz, Uzair Shah +4Ultrasound Imaging Video Frame Selection
College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar · LIST Laboratory Department of Electrical Systems Engineering, University of Boumerdes, Boumerdes, Algeria · Sidra Medicine, Doha, Qatar
EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies
Jun 18, 2026Ganlin Yang, Zhangzheng Tu, Yuqiang Yang +10Long-Horizon Robotic Manipulation Vision-Language-Action Models
University of Science and Technology of China · Shanghai AI Laboratory · Dalian University of Technology +5
Q-Fold: Query-Aware Focus-Context Spatio-Temporal Folding for Long Video Understanding
Jun 10, 2026Biao Tang, Xu Chen, Shuxiang Gou +3Multimodal Large Language Models Long-Video Understanding
Shenzhen Campus of Sun Yat-sen University · Harbin Institute of Technology, Shenzhen · Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China
Dot-Flik: A Scalable Edge AI Architecture for Distributed Insect Monitoring
May 27, 2026Mattia Consani, Denisa-Andreea Constantinescu, Åse Håtveit +4Edge Computing Internet of Things
´Ecole Polytechnique F´ed´erale de Lausanne (EPFL), Lausanne, Switzerland · Massachusetts Institute of Technology (MIT), Cambridge, MA, USA
Decomposing Queries into Tool Calls for Long-Video Keyframe Retrieval
May 22, 2026Michal Shlapentokh-Rothman, Prachi Garg, Yu-Xiong Wang +1Tool Use in VLMs Temporal IR
University of Illinois at Urbana-Champaign

Sep 30, 2026, cs.CVJ/K move · Enter open · S save

FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering

Haifeng Huang, Biyin Xu, Chunsheng Xin, Yang Li

Iowa State University.

Video Frame Selection Long-Video QA Query-Aware Video Frame Selection

Open paper AskPDF arXiv

Query-aware keyframe selection enables multimodal large language models (MLLMs) to process long videos using only a small set of question-relevant frames. Existing score-based methods, however, typically search within a fixed, uniformly sampled candidate pool, preventing evidence outside this pool from ever being selected. Given a limited relevance-scoring budget, the key challenge is to allocate evaluations adaptively to promising frames while continuing to explore underrepresented temporal regions. We introduce FORTE, a training-free framework that addresses this challenge through two stages: adaptive relevance scoring and global keyframe optimization. Starting from sparse, uniformly distributed observations, our efficient Gaussian-process relevance predictor estimates relevance for unscored frames, exploiting temporal locality and the approximately banded kernel structure to reduce the core computation from cubic to linear time in the number of frames for fixed bandwidth. The scoring stage then selects which frames to score next by balancing predicted relevance with temporal coverage, prioritizing promising regions while also exploring less-represented parts of the video. The optimization stage selects the final keyframes by maximizing an objective that jointly captures measured relevance and temporal coverage. We derive an exact algorithm that leverages the logarithmic coverage structure to identify the optimal subset of the scored candidate pool in time linear in the pool size, for a fixed final-frame budget. Experiments on four long-video question-answering benchmarks show that FORTE achieves the highest observed mean accuracy among the compared selectors under every tested scoring budget. Further evaluations demonstrate its consistent effectiveness across different relevance scorers and downstream MLLMs.

Momentum

Related topics

Latest papers 46