TrackNetV2: Efficient Shuttlecock Tracking Network

Nien En Sun, Yu Ching Lin, Shao Ping Chuang, Tzu Han Hsu, Dung Ru Yu, Ho Yi Chung, Tsi Ui Ik*

*此作品的通信作者

研究成果: Conference contribution同行評審

16 引文 斯高帕斯(Scopus)

摘要

TrackNet, a deep learning network, was proposed to track high-speed and tiny objects such as tennis balls and shuttlecocks from videos. To conquer low image quality issues such as blur, afterimage, and short-term occlusion, some number of consecutive images are input together to detect an flying object. In this work, TrackNetV2 is proposed to improve the performance of TrackNet from various aspects, especially processing speed, prediction accuracy, and GPU memory usage. First of all, the processing speed is improved from 2.6 FPS to 31.8 FPS. The performance boost is achieved by reducing the input image size and re-engineering the network from a Multiple-In Single-Out (MISO) design to a Multiple-In Multiple-Out (MIMO) design. Then, to improve the prediction accuracy, a comprehensive dataset from diverse badminton match videos is collected and labeled for training and testing. The dataset consists of 55563 frames from 18 badminton match videos. In addition, the network mechanisms are composed of not only VGG16 and upsampling layers but also U-net. Last, to reduce GPU memory usage, the data structure of the heatmap layer is remodeled from a pixel-wise one-hot encoding 3D array to a real-valued 2D array. To reflect the change of the heatmap representation, the loss function is redesigned from a RMSE-based function to a weighted cross-entropy based function. An overall validation shows that the accuracy, precision and recall of TrackNetV2 respectively reach 96.3%, 97.0% and 98.7% in the training phase and 85.2%, 97.2% and 85.4% in a test on a brand new match. The processing speed of the 3-in and 3-out version TrackNetV2 can reach 31.84 FPS. The dataset and source code of this work are available at https://nol.cs.nctu.edu.tw:234/open-source/TrackNetv2/.

原文English
主出版物標題Proceedings - 2020 International Conference on Pervasive Artificial Intelligence, ICPAI 2020
發行者Institute of Electrical and Electronics Engineers Inc.
頁面86-91
頁數6
ISBN(電子)9781665404839
DOIs
出版狀態Published - 3 12月 2020
事件1st International Conference on Pervasive Artificial Intelligence, ICPAI 2020 - Taipei, Taiwan
持續時間: 3 12月 20205 12月 2020

出版系列

名字Proceedings - 2020 International Conference on Pervasive Artificial Intelligence, ICPAI 2020

Conference

Conference1st International Conference on Pervasive Artificial Intelligence, ICPAI 2020
國家/地區Taiwan
城市Taipei
期間3/12/205/12/20

指紋

深入研究「TrackNetV2: Efficient Shuttlecock Tracking Network」主題。共同形成了獨特的指紋。

引用此