Robust 3D skeleton tracking based on openpose and a probabilistic tracking framework

Ching Chun Huang*, Manh Hung Nguyen

*此作品的通信作者

研究成果: Conference contribution同行評審

12 引文 斯高帕斯(Scopus)

摘要

For human skeleton tracking, conventional methods may directly rely on the Kinect built-in function to extract skeleton joints and realize the tracking function. However, the left-right confusion problem and the self-occlusion problem would make the Kinect joints unstable and incorrect. In this paper, we aim to solve these crucial issues and realize a reliable 3D skeleton tracking system via multiple Kinect cameras. First, the proposed method corrected the Kinect skeleton by referring to the OpenPose-extracted joints. Since OpenPose extracts the joints by analyzing image content, we can differentiate the front side and the back side and thus can correct the left-right confusion. Second, to alleviate the self-occlusion problem, we back-project the 2D OpenPose joints from multiple cameras and form an alternative 3D skeleton. The OpenPose reconstructed joints are treated as robust 3D anchors for multiple skeleton fusion. Last but not least, we introduce the inter-joint constraints into our skeleton tracking framework so that we can trace all joints simultaneously, make sure the skeleton movement consistent, and well maintain the length between neighboring joints. We evaluate our method with challenging actions. A practical system is also built for demonstration. The experimental results show the system can track skeleton stably without error propagation and vibration. The average localization error is also smaller than conventional methods.
原文English
主出版物標題2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
發行者Institute of Electrical and Electronics Engineers Inc.
頁面4107-4112
頁數6
ISBN(電子)9781728145693
DOIs
出版狀態Published - 10月 2019
事件2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019 - Bari, Italy
持續時間: 6 10月 20199 10月 2019

出版系列

名字Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
2019-October
ISSN(列印)1062-922X

Conference

Conference2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
國家/地區Italy
城市Bari
期間6/10/199/10/19

Keywords

  • Skeleton , Three-dimensional displays , Cameras , Tracking , Two dimensional displays , Indexes , Estimation

指紋

深入研究「Robust 3D skeleton tracking based on openpose and a probabilistic tracking framework」主題。共同形成了獨特的指紋。

引用此