Speaker-independent machine lip-reading with speaker-dependent viseme classifiers

Helen L. Bear, Stephen Cox, Richard Harvey

Research output: Contribution to conferencePaperpeer-review

Abstract

In machine lip-reading, which is identification of speech from visual-only information, there is evidence to show that visual speech is highly dependent upon the speaker (Cox et al, 2008). Here, we use a phoneme-clustering method to form new phoneme-to-viseme maps for both individual and multiple speakers. We use these maps to examine how similarly speakers talk visually. We conclude that broadly speaking, speakers have the same repertoire of mouth gestures, where they differ is in the use of the gestures.
Original languageEnglish
Publication statusPublished - Sep 2015
EventFAAVSP 2015 - Austria, Vienna, United Kingdom
Duration: 11 Sep 201513 Sep 2015

Conference

ConferenceFAAVSP 2015
CountryUnited Kingdom
CityVienna
Period11/09/1513/09/15

Cite this