cs.CVMar 26, 2026

BFMD: A Full-Match Badminton Dense Dataset for Dense Shot Captioning

Authors: Ning Ding, Keisuke Fujii, Toru Tamaki

Organizations: Nagoya Institute of Technology · Nagoya University

Abstract

Understanding tactical dynamics in badminton requires analyzing entire matches rather than isolated clips. However, existing badminton datasets mainly focus on short clips or task-specific annotations and rarely provide full-match data with dense multimodal annotations. This limitation makes it difficult to generate accurate shot captions and perform match-level analysis. To address this limitation, we introduce the first Badminton Full Match Dense (BFMD) dataset, with 19 broadcast matches (including both singles and doubles) covering over 20 hours of play, comprising 1,687 rallies and 16,751 hit events, each annotated with a shot caption. The dataset provides hierarchical annotations including match segments, rally events, and dense rally-level multimodal annotations such as shot types, shuttle trajectories, player pose keypoints, and shot captions. We develop a VideoMAE-based multimodal captioning framework with a Semantic Feedback mechanism that leverages shot semantics to guide caption generation and improve semantic consistency. Experimental results demonstrate that multimodal modeling and semantic feedback improve shot caption quality over RGB-only baselines. We further showcase the potential of BFMD by analyzing the temporal evolution of tactical patterns across full matches.

Figures & tables

Explore similar work

CardsList
  1. BadmintonGRF: A Multimodal Dataset and Benchmark for Markerless Ground Reaction Force Estimation in Badminton

    May 3, 2026Kuoye Niu, Jianwei Li, Shengze Cai +6Benchmark ConstructionMultimodal Sensor Fusion

  2. Decoupling Spatio-Temporal Adapter for Fine-Grained Badminton Action Localization

    May 22, 2026Tianyu Wang, Junjie Wu, Jingquan Gao +1Sports Video AnalysisTemporal Action Detection

  3. ShuttleEnv: An Interactive Data-Driven RL Environment for Badminton Strategy Modeling

    Mar 18, 2026Ang Li, Xinyang Gong, Bozhou Chen +5Game-Playing AgentsReinforcement Learning