A visual speech recognition system for an ultrasound-based silent speech interface 

Fiche du document

Auteurs
Date

17 août 2011

Discipline
Type de document
Périmètre
Langue
Identifiants
Source

HAL-SHS : linguistique

Collection

Archives ouvertes

Organisation

Centre pour la communication scientifique directe

Mots-clés En

Silent speech interface visual speech recognition vocal tract ultrasound imaging

Sujets proches En

Talking

Citer ce document

Jun Cai et al., « A visual speech recognition system for an ultrasound-based silent speech interface  », HAL-SHS : linguistique, ID : 10670/1.nshka0

Métriques

Partage / Export

Résumé En

The development of a continuous visual speech recognizer for a silent speech interface has been investigated using a visual speech corpus of ultrasound and video images of the tongue and lips. By using high-speed visual data and tied-state cross-word triphone HMMs, and including syntactic information via domain-specific language models, word-level recognition accuracy as high as 72% was achieved on visual speech. Using the Julius system, it was also found that the recognition should be possible in nearly real-time.

document thumbnail

Par les mêmes auteurs

Sur les mêmes sujets

Sur les mêmes disciplines

Exporter en