EgoEsportsQA: An Egocentric Video Benchmark for Perception and Reasoning in Esports
Organizations: Renmin University of China · Beijing University of Posts and Telecommunications
Abstract
While video large language models (Video-LLMs) excel in understanding slow-paced, real-world egocentric videos, their capabilities in high-velocity, information-dense virtual environments remain under-explored. Existing benchmarks focus on daily activities, yet lack a rigorous testbed for evaluating fast, rule-bound reasoning in virtual scenarios. To fill this gap, we introduce EgoEsportsQA, a pioneering video question-answering (QA) benchmark for grounding perception and reasoning in expert esports knowledge. We curate 1,745 high-quality QA pairs from professional matches across 3 first-person shooter games via a scalable six-stage pipeline. These questions are structured into a two-dimensional decoupled taxonomy: 11 sub-tasks in the cognitive capability dimension (covering perception and reasoning levels) and 6 sub-tasks in the esports knowledge dimension. Comprehensive evaluations of state-of-the-art Video-LLMs reveal that current models still fail to achieve satisfactory performance, with the best model only 71.58%. The results expose notable gaps across both axes: models exhibit stronger capabilities in basic visual perception than in deep tactical reasoning, and they grasp overall macro-progression better than fine-grained micro-operations. Extensive ablation experiments demonstrate the intrinsic weaknesses of current Video-LLM architectures. Further analysis suggests that our dataset not only reveals the connections between real-world and virtual egocentric domains, but also offers guidance for optimizing downstream esports applications, thereby fostering the future advancement of Video-LLMs in various egocentric environments.
Figures & tables
| Benchmarks | Domain | Anno. | #Clips | #QAs | Len. |
| EgoVQA ( 2019 ) | Indoor, Daily | M | 120 | 120 | 60s |
| EgoTaskQA ( 2022 ) | Indoor, Daily | A&M | 400 | 8,000 | 25s |
| AssistQ ( 2022 ) | Instructional | M | 20 | 106 | 115s |
| EgoSchema ( 2023 ) | Human Activity | A&M | 5,063 | 5,063 | 180s |
| EgoLifeQA ( 2025 ) | Daily Life | A&M | 644 | 3,000 | 4.3h |
| EgoMemoria ( 2025 ) | Daily, Instructional | A | 629 | 7,026 | - |
| Models | Params | Counter-Strike 2 (%) | Valorant (%) | Overwatch 2 (%) | Overall (%) | |||||
| Perc. | Reas. | Perc. | Reas. | Perc. | Reas. | Perc. | Reas. | Total | ||
| Closed-source Video-LLMs | ||||||||||
| Gemini 3 Flash ( 2025 ) | - | 70.09 | 43.33 | 47.33 | 33.69 | 50.54 | 42.91 | 56.66 | 40.81 | 49.74 |
| GPT-5 ( 2025 ) | - | 82.05 | 66.00 | 71.76 | 70.05 | 68.92 | 68.73 | 74.36 | 67.98 | 71.58 |
| Claude-Sonnet-4.5 ( 2025 ) | - | 65.24 | 45.33 | 54.20 | 50.80 | 46.76 | 46.91 | 55.34 | 47.24 | 51.81 |
| Doubao-Seed-1.8 ( 2025 ) | - | 73.79 | 56.33 | 61.45 | 55.61 | 60.81 | 55.64 | 65.62 | 55.91 | 61.38 |
| Modality | Overall Score (%) | ||||
| Text | Visual | Audio | Perception | Reasoning | Total |
| ✓ | ✗ | ✗ | 24.01 | 25.07 | 24.47 |
| ✓ | ✓ | ✗ | 56.66 | 40.81 | 49.47 |
| ✓ | ✓ | ✓ | 57.27 | 49.74 | 53.98 |
| Sampling Rate | Perception | Reasoning | Total |
| 0.5 fps | 49.24 | 38.58 | 44.58 |
| 1.0 fps | 56.66 | 40.81 | 49.74 |
| 2.0 fps | 46.19 | 39.11 | 43.09 |
| Resolution | Perception | Reasoning | Total |
| 256 144 | 30.52 | 30.05 | 30.32 |
| 640 360 | 47.41 | 36.48 | 42.64 |
| 1280 720 | 56.66 | 40.81 | 49.74 |
| 1920 1080 | 50.76 | 36.48 | 44.53 |
| Context Window | Perception | Reasoning | Total |
| Local ( ) | 62.36 | 46.85 | 55.59 |
| Expanded ( s margin) | 63.48 | 46.98 | 56.28 |
| Global (Full Video) | 56.66 | 40.81 | 49.74 |
| Model | EgoEsportsQA-CS2 (%) | MVBench (%) | ||
| Perc. | Reas. | Total | Ego. Nav. | |
| Qwen3-VL-8B | 68.66 | 42.00 | 56.37 | 33.50 |
| + CS2 Data | 69.80 | 45.67 | 58.68 | 36.00 |
Egocentric Video QA
Egocentric video question answering uses first-person camera footage to answer grounded questions about activities, objects, space, and time.
See all 46 papers