FrameRouter: Frame Budget Routing for Long-Video Understanding on Video-MME-v2 and Beyond
Organizations: Tsinghua University, Beijing, China · Harbin Engineering University, Harbin, China · BNRist, THUIBCS, School of Software, Tsinghua University, Beijing, China
Abstract
Long-video question answering benchmarks like Video-MME-v2 typically evaluate systems under a uniform frame budget for every question, despite stark variation in the evidence each query actually demands. We analyze this mismatch on Video-MME-v2 and find that different question subsets prefer different frozen frame-budget policies, while uniformly increasing the frame count does not reliably improve all metrics. These findings motivate fixed-mean frame-budget routing, a controlled inference setting in which each question may receive a different frame budget while the average budget matches a uniform reference. We introduce FrameRouter, a training-free test-time framework that combines an evidence-demand router, a budget-constrained allocation rule, and a frozen bank of frame-sampling policies. By controlling how much visual evidence each question receives while leaving the underlying samplers unchanged, FrameRouter is orthogonal to query-aware frame selection. Across Video-MME-v2 and several long-video understanding benchmarks, FrameRouter improves long-video question answering by using the same average visual budget more selectively across questions. Code is available at https://github.com/bingjunluo/FrameRouter.
Figures & tables
| Model | MVBench | VideoMMMU | L.V.Bench (w. sub) | L.V.Bench (wo sub) | ||||
|---|---|---|---|---|---|---|---|---|
| Frames | Acc. | Frames | Acc. | Frames | Acc. | Frames | Acc. | |
| Commercialization Models | ||||||||
| Gemini-3-Pro | - | 74.1 | - | 87.6 | - | 77.7 | - | - |
| GPT-5 | 50 | 74.1 | 50 | 84.6 | 50 | 72.6 | - | - |
| Kimi-K2.5 | - | 73.5 | - | 86.6 | - | 79.8 | - | - |
| Open-Source Models (Thinking) | ||||||||
| Method | Non-Lin | Consistency | Coherence | Avg. Acc. | ||
|---|---|---|---|---|---|---|
| Baseline | 30.60 | 29.50 | 32.70 | 48.90 | ||
| High-only | 33.94 | 33.10 | 35.47 | 53.03 | ||
| Low-only | 34.64 | 32.86 | 37.91 | 52.66 | ||
| Ours | 34.86 | 33.20 | 37.93 | 53.34 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
Long-Video QA
Long-video question answering develops methods for finding and reasoning over relevant visual and audio evidence across extended recordings.
See all 98 papers