Recognizing Tonal and Non-Tonal Mandarin Sentences for EEG-based Brain-Computer Interface

Shiau Ru Yang, Tzyy Ping Jung, Chin Teng Lin, Kuan Chih Huang, Chun Shu Wei, Herming Chiueh, Yue Loong Hsin, Guan Ting Liou, Li Chun Wang

研究成果: Article同行評審


Most current research has focused on non-tonal languages such as English. However, more than 60world’s population speaks tonal languages. Mandarin is the most spoken tonal languages in the world. Interestingly, the use of tone in tonal languages may represent different meanings of words and reflect feelings, which is very different from non-tonal languages. The objective of this study is to determine whether a spoken Mandarin sentence with or without tone can be distinguished by analyzing electroencephalographic signals (EEG). We first constructed a new Brain Research Center Speech (BRCSpeech) database to recognize Mandarin. The EEG data of 14 participants were recorded, while they articulated pre-selected sentences. To our knowledge, this is the first study to apply the method of asymmetric feature extraction method for speech recognition using EEG signals. This study shows that the feature extraction method of Rational Asymmetry (RASM) can achieve the best accuracy in the classification of cross-subjects. In addition, our proposed Binomial Variable Algorithm methodology can achieve 98.82% accuracy in cross-subject classification. Furthermore, we demonstrate that the use of eight channels ((F7, F8), (C5, C6), (P5, P6), and (O1, O2)) can achieve an accurate of 94.44%. This study explores the neuro-physiological correlation of Mandarin pronunciation, which can help develop a tonal language synthesis system based on BCI in the future.


深入研究「Recognizing Tonal and Non-Tonal Mandarin Sentences for EEG-based Brain-Computer Interface」主題。共同形成了獨特的指紋。