A French-Spanish Multimodal Speech Communication Corpus Incorporating Acoustic Data, Facial, Hands and Arms Gestures Information
Fiche du document
2 septembre 2018
- handle: 10670/1.81onoj
- hal: hal-01862585
info:eu-repo/semantics/OpenAccess
Mots-clés
multimodal speech multimodal corpora human-computer interaction -Computer Interaction [cs.HC]Sujets proches
Talking Natural science Sciences Science of scienceCiter ce document
Lucas Terissi et al., « A French-Spanish Multimodal Speech Communication Corpus Incorporating Acoustic Data, Facial, Hands and Arms Gestures Information », HAL-SHS : linguistique, ID : 10670/1.81onoj
Métriques
Partage / Export
Résumé
A Bilingual Multimodal Speech Communication Corpus incorporating acoustic data as well as visual data related to face, hands and arms gestures during speech, is presented in this paper. This corpus comprises different speaking modalities, including scripted text speech, natural conversation, and free speech. The corpus has been compiled in two different languages , viz., French and Spanish. The experimental setups for the recording of the corpus, the acquisition protocols, and the employed equipment are described. Statistics regarding the number and gender of the speakers, number of words, number of sentences, and duration of the recording sessions, are also provided. Preliminary results from the analysis of the correlation among speech, head and hand movements during spontaneous speech are also presented in this paper, showing that acoustic prosodic features are related with head and hand gestures .