A speech command control-based recognition system for dysarthric patients based on deep learning technology

Yu Yi Lin, Wei Zhong Zheng, Wei Chung Chu, Ji Yan Han, Ying Hsiu Hung, Guan Min Ho, Chia Yuan Chang, Ying Hui Lai*

*此作品的通信作者

研究成果: Article同行評審

4 引文 斯高帕斯(Scopus)

摘要

Voice control is an important way of controlling mobile devices; however, using it remains a challenge for dysarthric patients. Currently, there are many approaches, such as automatic speech recognition (ASR) systems, being used to help dysarthric patients control mobile devices. However, the large computation power requirement for the ASR system increases implementation costs. To alleviate this problem, this study proposed a convolution neural network (CNN) with a phonetic posteriorgram (PPG) speech feature system to recognize speech commands, called CNN–PPG; meanwhile, the CNN model with Mel-frequency cepstral coefficient (CNN–MFCC model) and ASRbased systems were used for comparison. The experiment results show that the CNN–PPG system provided 93.49% accuracy, better than the CNN–MFCC (65.67%) and ASR-based systems (89.59%). Additionally, the CNN–PPG used a smaller model size comprising only 54% parameter numbers compared with the ASR-based system; hence, the proposed system could reduce implementation costs for users. These findings suggest that the CNN–PPG system could augment a communication device to help dysarthric patients control the mobile device via speech commands in the future.

原文English
文章編號2477
期刊Applied Sciences (Switzerland)
11
發行號6
DOIs
出版狀態Published - 2 3月 2021

指紋

深入研究「A speech command control-based recognition system for dysarthric patients based on deep learning technology」主題。共同形成了獨特的指紋。

引用此