Listen and tell me who the user is talking to: Automatic detection of the interlocutor's type during a conversation - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Listen and tell me who the user is talking to: Automatic detection of the interlocutor's type during a conversation

Résumé

In the well-known Turing test, humans have to judge whether they write to another human or a chatbot. In this article, we propose a reversed Turing test adapted to live conversations: based on the speech of the human, we have developed a model that automatically detects whether she/he speaks to an artificial agent or a human. We propose in this work a prediction methodology combining a step of specific features extraction from behaviour and a specific deep learning model based on recurrent neural networks. The prediction results show that our approach, and more particularly the considered features, improves significantly the predictions compared to the traditional approach in the field of automatic speech recognition systems, which is based on spectral features, such as Mel-frequency Cepstral Coefficients (MFCCs). Our approach allows evaluating automatically the type of conversational agent, human or artificial agent, solely based on the speech of the human interlocutor. Most importantly, this model provides a novel and very promising approach to weigh the importance of the behaviour cues used to make correctly recognize the nature of the interlocutor, in other words, what aspects of the human behaviour adapts to the nature of its interlocutor.
Fichier principal
Vignette du fichier
RO_MAN.pdf (195.68 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03814587 , version 1 (14-10-2022)

Identifiants

Citer

Youssef Hmamouche, Magalie Ochs, Thierry Chaminade, Laurent Prevot. Listen and tell me who the user is talking to: Automatic detection of the interlocutor's type during a conversation. IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Aug 2022, Napoli, Italy. ⟨10.1109/RO-MAN53752.2022.9900632⟩. ⟨hal-03814587⟩
29 Consultations
108 Téléchargements

Altmetric

Partager

More