Gameplay Video
Gameplay video analysis is a rapidly evolving field focused on extracting meaningful information and insights from video recordings of gameplay. Current research emphasizes developing AI models, often employing transformer architectures, convolutional neural networks, and recurrent neural networks, to perform tasks such as action recognition, pose estimation, emotion detection, and event segmentation within video sequences. These advancements are driving progress in areas like player experience modeling, video editing and generation, and even applications in healthcare (e.g., pain recognition and ADHD diagnosis) by leveraging the rich spatiotemporal data inherent in gameplay videos. The resulting techniques have significant implications for improving game design, enhancing user experience, and creating new possibilities for human-computer interaction.
Papers
ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videos
Maria Luísa Lima, Willams de Lima Costa, Estefania Talavera Martinez, Veronica Teichrieb
LightningDrag: Lightning Fast and Accurate Drag-based Image Editing Emerging from Videos
Yujun Shi, Jun Hao Liew, Hanshu Yan, Vincent Y. F. Tan, Jiashi Feng