The effects of speech-gesture cooperation in animated agents' behavior in multimedia presentations - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Interacting with Computers Année : 2007

The effects of speech-gesture cooperation in animated agents' behavior in multimedia presentations

Résumé

Until now, research on arrangement of verbal and non-verbal information in multimedia presentations has not considered multimodal behavior of animated agents. In this paper, we will present an experiment exploring the effects of different types of speech-gesture cooperation in agents' behavior: redundancy (gestures duplicate pieces of information conveyed by speech), complementarity (distribution of information across speech and gestures) and a control condition in which gesture does not convey semantic information. Using a Latin-square design, these strategies were attributed to agents of different appearances to present different objects. Fifty-four male and 54 female users attended three short presentations performed by the agents, recalled the content of presentations and evaluated both the presentations and the agents. Although speech-gesture cooperation was not consciously perceived, it proved to influence users' recall performance and subjective evaluations: redundancy increased verbal information recall, ratings of the quality of explanation, and expressiveness of agents. Redundancy also resulted in higher likeability scores for the agents and a more positive perception of their personality. Users' gender had no influence on this set of results.
Fichier principal
Vignette du fichier
LCPI_IWC_2007_BUISINE.pdf (830.68 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00786343 , version 1 (08-02-2013)

Identifiants

Citer

Stéphanie Buisine, Jean-Claude Martin. The effects of speech-gesture cooperation in animated agents' behavior in multimedia presentations. Interacting with Computers, 2007, pp.484-493. ⟨10.1016/j.intcom.2007.04.002⟩. ⟨hal-00786343⟩
91 Consultations
547 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More