Mimicking the Annotation Process for Recognizing the Micro Expressions

Bo Kai Ruan, Ling Lo, Hong Han Shuai, Wen Huang Cheng

研究成果: Conference contribution同行評審

3 引文 斯高帕斯(Scopus)

摘要

Micro-expression recognition (MER) has recently become a popular research topic due to its wide applications, e.g., movie rating and recognizing the neurological disorder. By virtue of deep learning techniques, the performance of MER has been significantly improved and reached unprecedented results. This paper proposes a novel architecture to mimic how the expressions are annotated. Specifically, during the annotation process in several datasets, the AU labels are first obtained with FACS, and the expression labels are then decided based on the combinations of the AU labels. Meanwhile, these AU labels describe either the eyes or mouth movements (mutually-exclusive). Following this idea, we design a dual-branch structure with a new augmentation method to separately capture the eyes and mouth features and teach the model what the general expressions should be. Moreover, to adaptively fuse the area features for different expressions, we propose Area Weighted Module to assign different weights to each region. Additionally, we set up an auxiliary task to align the AU similarity scores to help our model capture facial patterns further with AU labels. The proposed approach outperforms other state-of-the-art methods in terms of accuracy on the CASME II and SAMM datasets. Moreover, we provide a new visualization approach to show the relationship between the facial regions and AU features.

原文English
主出版物標題MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia
發行者Association for Computing Machinery, Inc
頁面228-236
頁數9
ISBN(電子)9781450392037
DOIs
出版狀態Published - 10 10月 2022
事件30th ACM International Conference on Multimedia, MM 2022 - Lisboa, Portugal
持續時間: 10 10月 202214 10月 2022

出版系列

名字MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia

Conference

Conference30th ACM International Conference on Multimedia, MM 2022
國家/地區Portugal
城市Lisboa
期間10/10/2214/10/22

指紋

深入研究「Mimicking the Annotation Process for Recognizing the Micro Expressions」主題。共同形成了獨特的指紋。

引用此