Video-Language Models

Follow this topic Ask about this topic

Momentum

12 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 110

All topics

Beyond Frame Selection: Generative Latent Evidence Aggregation for Long-Video Understanding
Jul 30, 2026Bowen Liu, Shuning Wang, Xinpeng Ding +3Video-Language Models Long-Video Understanding
The Hong Kong University of Science and Technology · Alibaba Group · Xidian University +1
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model
Jul 27, 2026Senqiao Yang, Kaichen Zhang, Zhaoyang Jia +20Vision-Language Models Efficient VLM Inference
Microsoft Mage Team
PCA: Persistence-Aware Compression and Aggregation for Fast Video Large Language Models
Jul 22, 2026Zihan Song, Shuo Ye, Bo Zhao +4Video-Language Models Video Frame Selection
Institute for Artificial Intelligence, Great Bay University · Sun Yat-sen University · Youtu Lab, Tencent +2
Modularized Dynamic-Granularity Video LLM for Multi-Event Long Video Understanding
Jul 17, 2026Wei Feng, Xin Wang, Yu-Wei Zhan +2Temporal Video Grounding Video-Language Models
Department of Computer Science and Technology, Tsinghua University · Beijing National Research Center for Information Science and Technology, Tsinghua University
VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding
Jul 16, 2026Xinhao Li, Yuhan Zhu, Xiangyu Zeng +24Video Understanding Streaming Video Understanding
Nanjing University · Nanyang Technological University · Shanghai AI Laboratory +1
Accuracy Without Grounding: Diagnosing Visual Dependency Dissociation in Video LLM Benchmarks
Jul 14, 2026Jae Joong LeeVLM Evaluation Video-Language Model Evaluation
Department of Computer Science Purdue University West Lafayette, Indiana, USA
StoryTeller: Training-Free Narrative Grounding for Long-Form Audio Description
Jul 13, 2026Seung Hyun Hahm, Minh T. Dinh, SouYoung JinMemory-Augmented VLMs Video-Language Models
Dartmouth College, USA
SLVMBench: Skill Learning from Video Memory
Jul 13, 2026Yudong Yang, Guangzhi Sun, Yixuan Li +1Memory-Augmented VLMs Video-Language Models
Tsinghua University · University of Cambridge
GeoTrace: Geometry-Aware Trajectory Token Compression for Video Large Language Models
Jul 10, 2026Guohuan Xie, Mengqi Lei, Chuan Shi +3Efficient VLM Inference Video-Language Models
BNRist, THUIBCS, BLBCI, School of Software, Tsinghua University · Yangtze Delta Region Institute, Tsinghua University · Beijing University of Posts and Telecommunications, Beijing, China
Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
Jul 9, 2026Masatoshi Tateno, Alexandros Stergiou, Risa Shinoda +2Human Activity Recognition Object-Centric Representation Learning
1The University of Tokyo · University of Twente · University of Bristol
Natural Language Camera Movement Understanding
Jul 3, 2026Yuwen Tan, Joey Huang, Jin Huang +2VLM Evaluation Video-Language Models
Boston University, Boston, MA 02215, USA · Pixocial Technology, Bellevue, WA 98004, USA
Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning
Jul 3, 2026Wenzheng Zeng, Siyi Jiao, Chen Gao +2Temporal Video Grounding Video Captioning
National University of Singapore, Singapore
MoHallBench: A Benchmark for Motion Hallucination in Video Large Language Models
Jul 1, 2026Sihan Chen, Jiale Li, Jianghang Lin +1VLM Evaluation Hallucination Detection in VLMs
State Key Laboratory of General Artificial Intelligence, Peking University, Shenzhen Graduate School, Shenzhen, China · South China University of Technology, Guangzhou, China · Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, Xiamen, China
MotionAtlas: Detailed Region Captioning for Motion-Centric Videos
Jun 28, 2026Weisong Liu, Haochen Wang, Kuan Gao +8Video Captioning Video-Language Models
Institute of Automation, Chinese Academy of Sciences · Shanghai Jiao Tong University · Peking University +3
DELTAVID: Enhancing Fine-Grained Spatiotemporal Perception with Cross-Video Differences
Jun 26, 2026Yankai Yang, Yancheng Long, Bin Wen +4Video Understanding Video-Language Models
1Harbin Institute of Technology, Shenzhen · 2Kuaishou Technology
HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models
Jun 25, 2026Jiajun Wu, Haoyu Kang, Yining Sun +13Video Understanding Video Content Moderation
Central South University · Tsinghua University · South China Normal University +10
CineCap: Structured Reasoning with Spatio-Temporal Anchors for Cinematographic Video Captioning
Jun 23, 2026Xinyu Mao, Yuhui Zeng, Xiaokun Liu +6Video Captioning Video-Language Models
The Chinese University of Hong Kong HKSAR · Kling Team, Kuaishou Technology China · National University of Singapore Singapore +1
video-SALMONN-R $^3$ : Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding
Jun 23, 2026Yixuan Li, Guangzhi Sun, Yudong Yang +1Efficient VLM Inference Video QA
Tsinghua University · University of Cambridge
VideoLatent: Video-Language Learning via Latent Self-Forcing
Jun 22, 2026Zi-Yuan Hu, Zicong Tang, Shijia Huang +3Multimodal Large Language Models Latent Visual Reasoning
The Chinese University of Hong Kong · Weitu AI
Chains That See, Answers That Don't: A Multi-Aspect Evaluation Recipe for Forced Chain-of-Thought on Video-MME
Jun 22, 2026Zhichao Fan, Yanhang Li, Zexin ZhuangVLM Evaluation Video QA
University of Illinois Urbana-Champaign Urbana, Illinois, USA · Northeastern University Boston, Massachusetts, USA · Southern Methodist University Dallas, Texas, USA
When Does a Video-Language Model Stop Watching? Reward Strength Controls the Formation and Reversal of Visual Shortcuts in Multimodal RLVR
Jun 20, 2026Zekun XuVision-Language Models Video-Language Models
School of Computer Science, The University of Sydney, Sydney, Australia
What Should a Streaming Video Model Remember?
Jun 15, 2026Haonan Ge, Yiwei Wang, Hang Wu +1Streaming Video Understanding Video-Language Models
University of California, Santa Barbara · University of California, Merced · The University of Queensland
Natural-Language Temporal Grounding in Hour-Long Videos is a Search Problem: A Benchmark and Empirical Decomposition
Jun 10, 2026Sukmin Seo, Geewook KimTemporal Video Grounding Temporal IR
NAVER Cloud AI · NAVER Cloud AI KAIST AI
MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models
Jun 10, 2026Yuansheng Gao, Wenbin Xing, Jiahao Yuan +4Video-Language Models Multimodal Foundation Models
Zhejiang University · Sun Yat-sen University · East China Normal University
Streaming Interventions: Can Video Large Language Models Correct Mistakes as They Occur?
Jun 8, 2026Apratim Bhattacharyya, Shweta Mahajan, Sanjay Haresh +5LLM Fine-Tuning Synthetic Data Generation
Qualcomm AI Research · York University · Vector Institute for AI
See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding
Jun 8, 2026Shuning Wang, Zhiheng Wu, YiNuo Lu +6Video QA Video-Language Models
Baidu Inc. · Harbin Institute of Technology · Hong Kong University of Science and Technology
Watch, Remember, Reason: Human-View Video Understanding with MLLMs
Jun 5, 2026Jiahao Meng, Yue Tan, Qi Xu +12Streaming Video Understanding Video-Language Models
School of Intelligence Science and Technology, Peking University · Wuhan University · Shanghai Jiao Tong University +7
AdaCodec: A Predictive Visual Code for Video MLLMs
Jun 1, 2026Haowen Hou, Zhen Huang, Zheming Liang +8Predictive Coding Efficient VLM Inference
Shanghai Jiao Tong University · Shanghai Innovation Institute
Moment-Video: Diagnosing Temporal Fidelity of Video MLLMs on Momentary Visual Events
Jun 1, 2026Xiaolin Liu, Yilun Zhu, Xiangyu Zhao +9VLM Evaluation Video QA
Shandong University · Southeast University · Shanghai Jiao Tong University +1
PaSBench-Video: A Streaming Video Benchmark for Proactive Safety Warning
Jun 1, 2026Yusong Zhao, Yuejin Xie, Youliang Yuan +4Traffic Accident Anticipation Video-Language Models
The Chinese University of Hong Kong, Shenzhen · Tsinghua University

Jul 30, 2026, cs.CVJ/K move · Enter open · S save

Beyond Frame Selection: Generative Latent Evidence Aggregation for Long-Video Understanding

Bowen Liu, Shuning Wang, Xinpeng Ding, Zhiheng Wu+2

The Hong Kong University of Science and Technology · Alibaba Group · Xidian University+1

Video-Language Models Long-Video Understanding Long-Video QA

Open paper AskPDF arXiv

Long-video understanding commonly compresses videos into a small set of frames or visual tokens for answer generation. Existing compact pipelines focus on retaining relevant visual content as explicit evidence. Yet making evidence available does not ensure that complementary cues across moments are integrated for answering. Our key idea is to organize selected frames into query-relevant cross-frame evidence before generation. We formulate this post-selection stage as a latent evidence interface and instantiate it with GenEvA (

\textbf{Gen}erative

Latent

\textbf{Ev}idence

\textbf{A}ggregation

), a distribution-guided latent evidence aggregation framework. Specifically, GenEvA uses a query-conditioned evidence distribution to focus aggregation on relevant frames, forming compact cross-frame latent evidence from their frame-specific information. Since cross-frame integration is not always needed, the same distribution determines whether to insert this latent complement. Across four benchmarks and two Video-MLLM backbones, GenEvA consistently improves matched-frame baselines. At 8 frames, it raises the four-benchmark LLaVA-Video average by

+5.2

points and Qwen2.5-VL accuracy on LVBench by

+10.1

points. These gains require only

0.11\%

0.40\%

average video-token overhead; analyses further show task-aware allocation and benefits from Adaptive Evidence Invocation.

Momentum

Related topics

Latest papers 110