Towards videorealistic synthetic visual speech

Barry Theobald, J. Andrew Bangham, Silko Kruse, Gavin Cawley, Iain Matthews

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

In this paper we present preliminary results of work towards a videorealistic visual speech synthesiser. A generative model is used to track the face of a talker uttering a series of training sentences and an inventory of synthesis units is built by representing the trajectory of the model parameters with spline curves. A set of model parameters corresponding to a new utterance is formed by concatenating spline segments corresponding to synthesis units in the inventory and sampling at the original frame rate. The new parameters are applied to the model to create a sequence of images corresponding to the talking face.
Original languageEnglish
Title of host publicationUncertainty in Geometric Computations
EditorsJoab Winkler, Mahesan Niranjan
PublisherKluwer Academic Publishers
Pages175-184
Number of pages10
Volume704
ISBN (Print)978-0-7923-7309-4
DOIs
Publication statusPublished - 2001

Publication series

NameThe Kluwer International Series in Engineering and Computer Science
PublisherKluwer Academic Publishers

Cite this