What Did You Learn To Hate? A Topic-Oriented Analysis of Generalization in Hate Speech Detection - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

What Did You Learn To Hate? A Topic-Oriented Analysis of Generalization in Hate Speech Detection

Résumé

Hate speech has unfortunately become a significant phenomenon on social media platforms, and it can cover various topics (misogyny, sexism, racism, xenophobia, etc.) and targets (e.g., black people, women). Various hate speech detection datasets have been proposed, some annotated for specific topics, and others for hateful speech in general. In either case, they often employ different annotation guidelines, which can lead to inconsistencies, even in datasets focusing on the same topics. This can cause issues in models trying to generalize across more data and more topics in order to improve detection accuracy. In this paper, we propose, for the first time, a topic-oriented approach to study generalization across popular hate speech datasets. We first perform a comparative analysis of the performances of Transformer-based models in capturing topic-generic and topic-specific knowledge when trained on different datasets. We then propose a novel, simple yet effective approach to study more precisely which topics are best captured in implicit manifestations of hate, showing that selecting combinations of datasets with better out-of-domain topical coverage improves the reliability of automatic hate speech detection.
Fichier principal
Vignette du fichier
What Did You Learn To Hate.pdf (232.97 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04122231 , version 1 (08-06-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04122231 , version 1

Citer

Tom Bourgeade, Patricia Chiril, Farah Benamara, Véronique Moriceau. What Did You Learn To Hate? A Topic-Oriented Analysis of Generalization in Hate Speech Detection. 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2023), Association for Computational Linguistics (ACL), May 2023, Dubrovnik, Croatia. pp.3495-3508. ⟨hal-04122231⟩
48 Consultations
8 Téléchargements

Partager

Gmail Facebook X LinkedIn More