Recognizing Tonal and Nontonal Mandarin Sentences for EEG-Based Brain-Computer Interface

Shiau Ru Yang, Tzyy Ping Jung*, Chin Teng Lin, Kuan Chih Huang, Chun Shu Wei, Herming Chiueh, Yue Loong Hsin, Guan Ting Liou, Li Chun Wang*


研究成果: Article同行評審

2 引文 斯高帕斯(Scopus)


Most current research has focused on nontonal languages such as English. However, more than 60% of the world's population speaks tonal languages. Mandarin is the most spoken tonal languages in the world. Interestingly, the use of tone in tonal languages may represent different meanings of words and reflect feelings, which is very different from nontonal languages. The objective of this study is to determine whether a spoken Mandarin sentence with or without tone can be distinguished by analyzing electroencephalographic (EEG) signals. We first constructed a new Brain Research Center Speech (BRCSpeech) database to recognize Mandarin. The EEG data of 14 participants were recorded, while they articulated preselected sentences. To the best of our knowledge, this is the first study to apply the method of asymmetric feature extraction method for speech recognition using EEG signals. This study shows that the feature extraction method of rational asymmetry (RASM) can achieve the best accuracy in the classification of cross-subjects. In addition, our proposed binomial variable algorithm methodology can achieve 98.82% accuracy in cross-subject classification. Furthermore, we demonstrate that the use of eight channels [(F7, F8), (C5, C6), (P5, P6), and (O1, O2)] can achieve an accurate of 94.44%. This study explores the neurophysiological correlation of Mandarin pronunciation, which can help develop a tonal language synthesis system based on BCI in the future.

頁(從 - 到)1666-1677
期刊IEEE Transactions on Cognitive and Developmental Systems
出版狀態Published - 1 12月 2022


深入研究「Recognizing Tonal and Nontonal Mandarin Sentences for EEG-Based Brain-Computer Interface」主題。共同形成了獨特的指紋。