The Development and Evaluation of a Speech to Sign Translation System to Assist Transactions

Stephen Cox; Michael Lincoln; Judy Tryggvason; Melanie Nakisa; Mark Wells; Marcus Tutt; Sanja Abbott

doi:10.1207/S15327590IJHC1602_02

The Development and Evaluation of a Speech to Sign Translation System to Assist Transactions

Stephen Cox, Michael Lincoln, Judy Tryggvason, Melanie Nakisa, Mark Wells, Marcus Tutt, Sanja Abbott

Research output: Contribution to journal › Article › peer-review

25 Citations (Scopus)

Abstract

The design, development, and evaluation of an experimental translation system that aims to aid transactions between a deaf person and a clerk in a post office (PO) is described. The system uses a speech recognizer to recognize speech from a PO clerk and then synthesizes recognized phrases in British Sign language (BSL) using a specially developed avatar. The main objective in developing this prototype system was to determine how useful it would be to a customer whose first language was BSL, and to discover what areas of the system required more research and development to make it more effective. The system was evaluated by 6 prelingually profoundly deaf people and 3 PO clerks. Deaf users and PO clerks were supportive of the system, but the former group required a higher quality of signing from the avatar and the latter a system that was less constrained in the phrases it could recognize; both these areas are being addressed in the next phase of development.

Original language	English
Pages (from-to)	141-161
Number of pages	21
Journal	International Journal of Human-Computer Interaction
Volume	16
Issue number	2
DOIs	https://doi.org/10.1207/S15327590IJHC1602_02
Publication status	Published - 2003

Access to Document

10.1207/S15327590IJHC1602_02

Cite this

@article{b18be16757234df6b23f8f365761baf2,

title = "The Development and Evaluation of a Speech to Sign Translation System to Assist Transactions",

abstract = "The design, development, and evaluation of an experimental translation system that aims to aid transactions between a deaf person and a clerk in a post office (PO) is described. The system uses a speech recognizer to recognize speech from a PO clerk and then synthesizes recognized phrases in British Sign language (BSL) using a specially developed avatar. The main objective in developing this prototype system was to determine how useful it would be to a customer whose first language was BSL, and to discover what areas of the system required more research and development to make it more effective. The system was evaluated by 6 prelingually profoundly deaf people and 3 PO clerks. Deaf users and PO clerks were supportive of the system, but the former group required a higher quality of signing from the avatar and the latter a system that was less constrained in the phrases it could recognize; both these areas are being addressed in the next phase of development.",

author = "Stephen Cox and Michael Lincoln and Judy Tryggvason and Melanie Nakisa and Mark Wells and Marcus Tutt and Sanja Abbott",

year = "2003",

doi = "10.1207/S15327590IJHC1602_02",

language = "English",

volume = "16",

pages = "141--161",

journal = "International Journal of Human-Computer Interaction",

issn = "1044-7318",

publisher = "Taylor and Francis",

number = "2",

}

TY - JOUR

T1 - The Development and Evaluation of a Speech to Sign Translation System to Assist Transactions

AU - Cox, Stephen

AU - Lincoln, Michael

AU - Tryggvason, Judy

AU - Nakisa, Melanie

AU - Wells, Mark

AU - Tutt, Marcus

AU - Abbott, Sanja

PY - 2003

Y1 - 2003

N2 - The design, development, and evaluation of an experimental translation system that aims to aid transactions between a deaf person and a clerk in a post office (PO) is described. The system uses a speech recognizer to recognize speech from a PO clerk and then synthesizes recognized phrases in British Sign language (BSL) using a specially developed avatar. The main objective in developing this prototype system was to determine how useful it would be to a customer whose first language was BSL, and to discover what areas of the system required more research and development to make it more effective. The system was evaluated by 6 prelingually profoundly deaf people and 3 PO clerks. Deaf users and PO clerks were supportive of the system, but the former group required a higher quality of signing from the avatar and the latter a system that was less constrained in the phrases it could recognize; both these areas are being addressed in the next phase of development.

AB - The design, development, and evaluation of an experimental translation system that aims to aid transactions between a deaf person and a clerk in a post office (PO) is described. The system uses a speech recognizer to recognize speech from a PO clerk and then synthesizes recognized phrases in British Sign language (BSL) using a specially developed avatar. The main objective in developing this prototype system was to determine how useful it would be to a customer whose first language was BSL, and to discover what areas of the system required more research and development to make it more effective. The system was evaluated by 6 prelingually profoundly deaf people and 3 PO clerks. Deaf users and PO clerks were supportive of the system, but the former group required a higher quality of signing from the avatar and the latter a system that was less constrained in the phrases it could recognize; both these areas are being addressed in the next phase of development.

U2 - 10.1207/S15327590IJHC1602_02

DO - 10.1207/S15327590IJHC1602_02

M3 - Article

VL - 16

SP - 141

EP - 161

JO - International Journal of Human-Computer Interaction

JF - International Journal of Human-Computer Interaction

SN - 1044-7318

IS - 2

ER -