cs.LGNov 11, 2026

One Hierarchy, Many Sports: Hierarchy-Aligned Multi-Task Learning for Next-Shot Prediction

Authors: Chao-Wei Cai, Min-Te Sun, Sheng Kuang Wu, Hung-Hsuan Chen

Organizations: Computer Science and Information Engineering, National Central University, Taoyuan, Taiwan · Department of Kinesiology, National Tsing Hua University, Hsinchu, Taiwan

Abstract

Next-shot prediction in racket sports requires learning from event data with different match structures, recorded attributes, and label vocabularies. Table tennis, badminton, and tennis nevertheless share a hierarchy in which shots form rallies and rallies form higher scoring units. We present MT-HTA, a hierarchy-aligned multi-task Transformer that uses this structure to jointly predict the attributes of the next shot. A temporal Transformer captures event progression, a feature-token path models interactions among semantic fields rather than along the time axis, and task-specific attention retrieves information from hierarchical summaries and player context. The architecture supports three- and four-level hierarchies and sport-dependent task sets. Across four datasets from three sports, the final MT-HTA achieves the highest mean task-averaged F1 among the compared main models. Ablations on table tennis support the combination of hierarchical encoding, task attention, and feature-token interaction. Additional modules alter the balance between classification scores and spatial error rather than improving every metric. These results support a reusable architecture for heterogeneous racket-sport event data. We release the code for reproducibility. https://github.com/gndd1221/For-Sports-event-modeling-with-rally-and-score-hierarchical-A-Multi-Task-Hierarchical-Transformer

Figures & tables

Explore similar work

CardsList
  1. TTNet: Multi-Task Deep Learning for Table Tennis Player Analysis with Smart Racket

    Oct 6, 2026Ko-Hsun Chen, Xiang-Wei Ke, Hsien-Cheng Huang +1Multi-Task Learning

  2. Learning Athletic Humanoid Tennis Skills from Imperfect Human Motion Data

    Mar 13, 2026Zhikai Zhang, Haofei Lu, Yunrui Lian +12RoboticsHumanoid Robot Control

  3. TennisVAR: A Stroke-Evidence-Grounded Multimodal Large Language Model for Tactical Reasoning in Tennis Videos

    Aug 13, 2026Yifan Mei, Qingling Shi, Changli Wu +3Sports Video AnalysisMultimodal Large Language Models