Evaluating talking heads based on appearance models

Barry-John Theobald; J. Andrew Bangham; Iain Matthews; Gavin Cawley

Evaluating talking heads based on appearance models

Barry-John Theobald, J. Andrew Bangham, Iain Matthews, Gavin Cawley

Research output: Contribution to conference › Paper

4 Citations (Scopus)

Abstract

In this paper we describe how 2D appearance models can be applied to the problem of creating a near-videorealistic talking head. A speech corpus of a talker uttering a set of phonetically balanced training sentences is analysed using a generative model of the human face. Segments of original parameter trajectories corresponding to the synthesis unit are extracted from a codebook, normalised, blended, concatenated and smoothed before being applied to the model to give natural, realistic animations of novel utterances. We also present some early results of subjective tests conducted to determine the realism of the synthesiser.

Original language	English
Pages	187-192
Number of pages	6
Publication status	Published - Sep 2003
Event	International Conference on Auditory-Visual Speech Processing - St. Jorioz, France Duration: 4 Sep 2003 → 7 Sep 2003

Conference

Conference	International Conference on Auditory-Visual Speech Processing
Abbreviated title	AVSP-2003
Country/Territory	France
City	St. Jorioz
Period	4/09/03 → 7/09/03

Access to Document

http://www.isca-speech.org/archive_open/avsp03/av03_187.html

Cite this

@conference{f771150b8ab244a7b220210319b0076a,

title = "Evaluating talking heads based on appearance models",

abstract = "In this paper we describe how 2D appearance models can be applied to the problem of creating a near-videorealistic talking head. A speech corpus of a talker uttering a set of phonetically balanced training sentences is analysed using a generative model of the human face. Segments of original parameter trajectories corresponding to the synthesis unit are extracted from a codebook, normalised, blended, concatenated and smoothed before being applied to the model to give natural, realistic animations of novel utterances. We also present some early results of subjective tests conducted to determine the realism of the synthesiser.",

author = "Barry-John Theobald and Bangham, {J. Andrew} and Iain Matthews and Gavin Cawley",

year = "2003",

month = sep,

language = "English",

pages = "187--192",

note = "International Conference on Auditory-Visual Speech Processing, AVSP-2003 ; Conference date: 04-09-2003 Through 07-09-2003",

}

TY - CONF

T1 - Evaluating talking heads based on appearance models

AU - Theobald, Barry-John

AU - Bangham, J. Andrew

AU - Matthews, Iain

AU - Cawley, Gavin

PY - 2003/9

Y1 - 2003/9

N2 - In this paper we describe how 2D appearance models can be applied to the problem of creating a near-videorealistic talking head. A speech corpus of a talker uttering a set of phonetically balanced training sentences is analysed using a generative model of the human face. Segments of original parameter trajectories corresponding to the synthesis unit are extracted from a codebook, normalised, blended, concatenated and smoothed before being applied to the model to give natural, realistic animations of novel utterances. We also present some early results of subjective tests conducted to determine the realism of the synthesiser.

AB - In this paper we describe how 2D appearance models can be applied to the problem of creating a near-videorealistic talking head. A speech corpus of a talker uttering a set of phonetically balanced training sentences is analysed using a generative model of the human face. Segments of original parameter trajectories corresponding to the synthesis unit are extracted from a codebook, normalised, blended, concatenated and smoothed before being applied to the model to give natural, realistic animations of novel utterances. We also present some early results of subjective tests conducted to determine the realism of the synthesiser.

M3 - Paper

SP - 187

EP - 192

T2 - International Conference on Auditory-Visual Speech Processing

Y2 - 4 September 2003 through 7 September 2003

ER -