Periodic Physical Activity Information Segmentation, Counting and Recognition From Video

Sheng Hsien Cheng, Muhammad Atif Sarwar, Yousef Awwad Daraghmi, Tsi Ui Ik*, Yih Lang Li

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

The research on complex human body motion including sports and workout activity recognition is a major challenge and long-lasting problem for the computer vision community. Recent development in deep learning algorithms to track people's workout activity characteristics based on video sensors can be used to infer the human body pose for further analysis. Specifically, tracking complex body movements while performing multi-pose physical exercise helps individuals provide fine granularity feedback including activity repetition counting and activity recognition. Therefore, this research proposes a system that provides a repetition counter and activity recognition of physical exercise from video frames (extracted 3D human skeleton using VIBE) based on the deep semantic features and repetitive segmentation algorithm. The proposed system locates both ends of the activity's action and segments the activity into multiple unit actions which improves activity recognition, time intervals, # of sets, and other quantitative values of activity. The proposed system is evaluated on the physical activities dataset named "NOL-18 Exercise"through extensive experiments. The proposed system results show that the accuracy of the repetitive action segmentation is 96.27% with 0.23% time error, and action recognition reaches 99.06%. The system can be employed to fitness or rehabilitation centers and used for treating patients.

Original languageEnglish
Pages (from-to)23019-23031
Number of pages13
JournalIEEE Access
Volume11
DOIs
StatePublished - 2023

Keywords

  • Activity analysis
  • activity recognition
  • activity segmentation
  • periodical information mining
  • repetitive action counting

Fingerprint

Dive into the research topics of 'Periodic Physical Activity Information Segmentation, Counting and Recognition From Video'. Together they form a unique fingerprint.

Cite this