Gameplay Video
Gameplay video analysis is a rapidly evolving field focused on extracting meaningful information and insights from video recordings of gameplay. Current research emphasizes developing AI models, often employing transformer architectures, convolutional neural networks, and recurrent neural networks, to perform tasks such as action recognition, pose estimation, emotion detection, and event segmentation within video sequences. These advancements are driving progress in areas like player experience modeling, video editing and generation, and even applications in healthcare (e.g., pain recognition and ADHD diagnosis) by leveraging the rich spatiotemporal data inherent in gameplay videos. The resulting techniques have significant implications for improving game design, enhancing user experience, and creating new possibilities for human-computer interaction.
Papers
CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videos
Nikita Karaev, Iurii Makarov, Jianyuan Wang, Natalia Neverova, Andrea Vedaldi, Christian Rupprecht
Analysis and Benchmarking of Extending Blind Face Image Restoration to Videos
Zhouxia Wang, Jiawei Zhang, Xintao Wang, Tianshui Chen, Ying Shan, Wenping Wang, Ping Luo
Latent Action Pretraining from Videos
Seonghyeon Ye, Joel Jang, Byeongguk Jeon, Sejune Joo, Jianwei Yang, Baolin Peng, Ajay Mandlekar, Reuben Tan, Yu-Wei Chao, Bill Yuchen Lin, Lars Liden, Kimin Lee, Jianfeng Gao, Luke Zettlemoyer, Dieter Fox, Minjoon Seo
Quality Prediction of AI Generated Images and Videos: Emerging Trends and Opportunities
Abhijay Ghildyal, Yuanhan Chen, Saman Zadtootaghaj, Nabajeet Barman, Alan C. Bovik
VOVTrack: Exploring the Potentiality in Videos for Open-Vocabulary Object Tracking
Zekun Qian, Ruize Han, Junhui Hou, Linqi Song, Wei Feng
Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Content
Qiuheng Wang, Yukai Shi, Jiarong Ou, Rui Chen, Ke Lin, Jiahao Wang, Boyuan Jiang, Haotian Yang, Mingwu Zheng, Xin Tao, Fei Yang, Pengfei Wan, Di Zhang
Deepfake detection in videos with multiple faces using geometric-fakeness features
Kirill Vyshegorodtsev, Dmitry Kudiyarov, Alexander Balashov, Alexander Kuzmin
Optimal-state Dynamics Estimation for Physics-based Human Motion Capture from Videos
Cuong Le, Viktor Johansson, Manon Kok, Bastian Wandt