End-to-End Key-Player-Based Group Activity Recognition Network Applied to Basketball Offensive Tactic Identification in Limited Data Scenarios

Tsung Yu Tsai*, Yen-Yu Lin, Shyh Kang Jeng, Hong Yuan Mark Liao

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

In this paper, we propose an end-to-end key-player-based group activity recognition network specially applied to the identification of basketball offensive tactics in limited data scenarios. Our previous studies show that basketball tactics can be better recognized via key player detection with multiple instance learning (MIL) using the support vector machine (SVM). However, the SVM in that work is required to extract features depending on basketball- and tactic-specific knowledge for good performance. Thus, in this study, we develop an end-to-end trainable neural network without prior knowledge and integrate MIL into it. As long as a tactic label is given, MIL can train the network to identify tactic's key players. For testing, our network can recognize the key players in a video clip and provide a tag of the tactic related to them. Like other neural network models, our network requires a large annotated dataset. At the same time, we could collect only a few labeled data, which is common in dealing with group activity recognition. To overcome such a limitation, we propose a novel data augmentation framework, the tactical-based conditional generative adversarial network (GAN), for generating new labeled trajectories. The experimental results show that our method significantly improves 9.13 % in tactic recognition and 4.965 % in key player detection.

Original languageEnglish
Article number9492072
Pages (from-to)104395-104404
Number of pages10
JournalIEEE Access
Volume9
DOIs
StatePublished - 20 Jul 2021

Keywords

  • Data augmentation
  • end-to-end deep neural networks
  • generative adversarial networks
  • group activity recognition
  • key player detection
  • multiple instance learning
  • sports video analysis

Fingerprint

Dive into the research topics of 'End-to-End Key-Player-Based Group Activity Recognition Network Applied to Basketball Offensive Tactic Identification in Limited Data Scenarios'. Together they form a unique fingerprint.

Cite this