Annotation of Messages from Social Media for Influencer Detection - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Annotation of Messages from Social Media for Influencer Detection

Résumé

To develop an influencer detection system, we designed an influence model based on the analysis of conversations in the "Change My View" debate forum. This led us to identify enunciative features (argumentation, emotion expression, view change, ...) related to influence between participants. In this paper, we present the annotation campaign we conducted to build up a reference corpus on these enunciative features. The annotation task was to identify in social media posts the text segments that corresponded to each enunciative feature. The posts to be annotated were extracted from two social media: the "Change My View" debate forum, with discussions on various topics, and Twitter, with posts from users identified as supporters of ISIS (Islamic State of Iraq and Syria). Over a thousand posts have been double or triple annotated throughout five annotation sessions gathering a total of 27 annotators. Some of the sessions involved the same annotators, which allowed us to analyse the evolution of their annotation work. Most of the sessions resulted in a reconciliation phase between the annotators, allowing for discussion and iterative improvement of the guidelines. We measured and analysed interannotator agreements over the course of the sessions, which allowed us to validate our iterative approach.
Fichier principal
Vignette du fichier
2022.law-1.10.pdf (466.92 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04066269 , version 1 (12-04-2023)

Identifiants

  • HAL Id : hal-04066269 , version 1

Citer

Kévin Deturck, Damien Nouvel, Namrata Patel, Frédérique Segond. Annotation of Messages from Social Media for Influencer Detection. LAW-XVI, 2022, Marseille, France. ⟨hal-04066269⟩
16 Consultations
5 Téléchargements

Partager

Gmail Facebook X LinkedIn More