Enhancing intelligibility of dysarthric speech using gated convolutional-based voice conversion system

Chen Yu Chen, Wei Zhong Zheng, Syu Siang Wang, Yu Tsao, Pei Chun Li, Ying Hui Lai

研究成果: Conference article同行評審

13 引文 斯高帕斯(Scopus)

摘要

The voice conversion (VC) system is a well-known approach to improve the communication efficiency of patients with dysarthria. In this study, we used a gated convolutional neural network (Gated CNN) with the phonetic posteriorgrams (PPGs) features to perform VC for patients with dysarthria, with WaveRNN vocoder used to synthesis converted speech. In addition, two well-known deep learning-based models, convolution neural network (CNN) and bidirectional long short-term memory (BLSTM) were used to compare with the Gated CNN in the proposed VC system. The results from the evaluation of speech intelligibility metric of Google ASR and listening test showed that the proposed system performed better than the original dysarthric speech. Meanwhile, the Gated CNN model performs better than the other models and requires fewer parameters compared to BLSTM. The results suggested that Gated CNN can be used as a communication assistive system to overcome the degradation of speech intelligibility caused by dysarthria.

原文English
頁(從 - 到)4686-4690
頁數5
期刊Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
2020-October
DOIs
出版狀態Published - 2020
事件21st Annual Conference of the International Speech Communication Association, INTERSPEECH 2020 - Shanghai, China
持續時間: 25 10月 202029 10月 2020

指紋

深入研究「Enhancing intelligibility of dysarthric speech using gated convolutional-based voice conversion system」主題。共同形成了獨特的指紋。

引用此