Modelling Errors in Automatic Speech Recognition for Dysarthric Speakers

Santiago-Omar Caballero Morales, Stephen Cox

Research output: Contribution to journalArticlepeer-review

45 Citations (Scopus)

Abstract

Dysarthria is a motor speech disorder characterized by weakness, paralysis, or poor coordination of the muscles responsible for speech. Although automatic speech recognition (ASR) systems have been developed for disordered speech, factors such as low intelligibility and limited phonemic repertoire decrease speech recognition accuracy, making conventional speaker adaptation algorithms perform poorly on dysarthric speakers. In this work, rather than adapting the acoustic models, we model the errors made by the speaker and attempt to correct them. For this task, two techniques have been developed: (1) a set of “metamodels” that incorporate a model of the speaker's phonetic confusion matrix into the ASR process; (2) a cascade of weighted finite-state transducers at the confusion matrix, word, and language levels. Both techniques attempt to correct the errors made at the phonetic level and make use of a language model to find the best estimate of the correct word sequence. Our experiments show that both techniques outperform standard adaptation techniques.
Original languageEnglish
JournalEURASIP Journal on Advances in Signal Processing
Volume2009, Article ID 308340
DOIs
Publication statusPublished - 2009

Cite this