Facial Chirality: From Visual Self-Reflection to Robust Facial Feature Learning

Ling Lo, Hong Xia Xie, Hong Han Shuai, Wen Huang Cheng

研究成果: Article同行評審


As a fundamental vision task, facial expression recognition has made substantial progress recently. However, the recognition performance often degrades significantly in real-world scenarios due to the lack of robust facial features. In this paper, we propose an effective facial feature learning method that takes the advantage of facial chirality to discover the discriminative features for facial expression recognition. Most previous studies implicitly assume that human faces are symmetric. However, our work reveals that the facial asymmetric effect can be a crucial clue. Given a face image and its reflection without additional labels, we decouple the emotion-invariant facial features from the input image pair to better capture the emotion-related facial features. Moreover, as our model aligns emotion-related features of the image pair to enhance the recognition performance, the value of precise facial landmark alignment as a pre-processing step is reconsidered in this paper. Experiments demonstrate that the learned emotion-related features outperform the state of the art methods on several facial expression recognition benchmarks as well as real-world occlusion datasets, which manifests the effectiveness and robustness of the proposed model.

頁(從 - 到)1-11
期刊IEEE Transactions on Multimedia
出版狀態Accepted/In press - 2022


深入研究「Facial Chirality: From Visual Self-Reflection to Robust Facial Feature Learning」主題。共同形成了獨特的指紋。