cs.LGApr 15, 2026

Scouting By Reward: VLM-TO-IRL-Driven Player Selection For Esports

Authors: Qing Yan, Wenyu Yang, Yufei Wang, Wenhao Ma, Linchong Hu, Yifei Jin, Anton Dahbura

Organizations: Johns Hopkins University · University of Pennsylvania · Cornell University

Abstract

Traditional esports scouting workflows rely heavily on manual video review and aggregate performance metrics, which often fail to capture the nuanced decision-making patterns necessary to determine if a prospect fits a specific tactical archetype. To address this, we reframe style-based player evaluation in esports as an Inverse Reinforcement Learning (IRL) problem. In this paper, we introduce a novel player selection framework that learns professional-specific reward functions from logged gameplay demonstrations, allowing organizations to rank candidates by their stylistic alignment with a target star player. Our proposed architecture utilizes a multimodal, two-branch intake: one branch encodes structured state-action trajectories derived from high-resolution in-game telemetry, while the second encodes temporally aligned tactical pseudo-commentary generated by Vision-Language Models (VLMs) from broadcast footage. These representations are fused and evaluated via a Generative Adversarial Imitation Learning (GAIL) objective, where a discriminator learns to capture the unique mechanical and tactical signatures of elite professionals. By transitioning from generic skill estimation to scouting "by reward," this framework provides a scalable, workflow-aware digital twin system that enables data-driven roster construction and targeted talent discovery across massive candidate pools.

Explore similar work

CardsList
  1. Robust Player-Conditional Champion Ranking for League of Legends: Style Similarity, Mastery Priors, and Archetype-Constrained Discovery

    May 18, 2026Min Heo, Pranav Kadiyam, Prasun PanthiLearning to RankUser Modeling

  2. Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAG

    Jun 26, 2026Deep Ghosal, Ishani Sen, Wazib Ansar +1Sports Video AnalysisMulti-Agent Systems

  3. Play Like Champions: Counterfactual Feedback Generation in Latent Space

    Jun 30, 2026Andrzej Białecki, Adam Mastalerz, Han ZhouCounterfactual LearningAlgorithmic Recourse