cs.HCNov 18, 2026

Learning Martial Arts Motion Skills for Animating Opponents in VR Sparring Games

Authors: Jiqing Wen, Qixuan Shi, Robert LiKamWa, Pavan Turaga

Organizations: Arizona State University · Rice University

Abstract

Animating virtual opponents is an important yet challenging task in game development. In martial arts games, opponent motions must not only be physically plausible but also exhibit appropriate technique, timing, transitions, and target-directed intent. Traditional game animations often rely on handcrafted clips, state machine transitions, and procedural adjustments, which can be labor-intensive and may limit the behavioral diversity of non-player characters. This paper presents a martial arts motion skills learning framework for character animation in virtual sparring games. Inspired by Tang Soo Do, we collected a martial arts motion capture dataset containing isolated attacking and defending techniques, technique combinations and transitions, and contextual sparring variations. We first pretrained a reusable repertoire of martial arts motion skills from the captured data using reinforcement learning (RL) with adversarial style rewards, and then adapted these skills with task-specific rewards for target-directed striking and threat-aware evasion. We evaluated the motions generated by the learned policy through a user study, in which participants assessed their physical plausibility, smoothness, and martial arts form. To demonstrate their applicability to interactive gameplay, we developed a VR sparring prototype for Meta Quest headsets. The prototype combines policy-generated motion clips with lightweight state-based control to support interactive opponent behavior. Together, these findings support the feasibility of using a learned martial arts skill repertoire as a motion foundation for animating opponents in VR sparring games.

Figures & tables

Explore similar work

CardsList
  1. Robo-Saber: Generating and Simulating Virtual Reality Players

    Feb 20, 2026Nam Hee Kim, Jingjing May Liu, Jaakko Lehtinen +3Human Behavior SimulationHuman Motion Generation

  2. Humanoid Badminton: Learning Dynamic Racket Skills from Limited Human Motion Data

    Sep 25, 2026Jingzhi Cui, Zhexiong Wang, Bangjie Xu +9Robot Skill LearningRobotics