Introducing CALMED: Multimodal Annotated Dataset for Emotion Detection in Children with Autism - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Introducing CALMED: Multimodal Annotated Dataset for Emotion Detection in Children with Autism

Annanda Sousa
Karen Young
Mathieu D’aquin
Jennifer Holloway

Résumé

Automatic Emotion Detection (ED) aims to build systems to identify users' emotions automatically. This field has the potential to enhance HCI, creating an individualised experience for the user. However, ED systems tend to perform poorly on people with Autism Spectrum Disorder (ASD). Hence, the need to create ED systems tailored to how people with autism express emotions. Previous works have created ED systems tailored for children with ASD but did not share the resulting dataset. Sharing annotated datasets is essential to enable the development of more advanced computer models for ED within the research community. In this paper, we describe our experience establishing a process to create a multimodal annotated dataset featuring children with a level 1 diagnosis of autism. In addition, we introduce CALMED (Children, Autism, Multimodal, Emotion, Detection), the resulting multimodal emotion detection dataset featuring children with autism aged 8-12. CALMED includes audio and video features extracted from recording files of study sessions with participants, together with annotations provided by their parents into four target classes. The generated dataset includes a total of 57,012 examples, with each example representing a time window of 200ms (0.2s). Our experience and methods described here, together with the dataset shared, aim to contribute to future research applications of affective computing in ASD, which has the potential to create systems to improve the lives of people with ASD.
Fichier principal
Vignette du fichier
HCII_2023___Introducing_CALMED__Multimodal_Annotated_Dataset_for_Emotion_Detection_in_Children_with_Autism.pdf (2.8 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04168999 , version 1 (23-07-2023)

Identifiants

Citer

Annanda Sousa, Karen Young, Mathieu D’aquin, Manel Zarrouk, Jennifer Holloway. Introducing CALMED: Multimodal Annotated Dataset for Emotion Detection in Children with Autism. HCII 2023: Universal Access in Human-Computer Interaction, Margherita Antona; Constantine Stephanidis, Jul 2023, Copenhagen, Denmark. pp.657-677, ⟨10.1007/978-3-031-35681-0_43⟩. ⟨hal-04168999⟩
36 Consultations
111 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More