A BERT-based transfer learning approach for hate speech detection in online social media - Archive ouverte HAL Access content directly
Conference Papers Year : 2019

A BERT-based transfer learning approach for hate speech detection in online social media

Abstract

Generated hateful and toxic content by a portion of users in social media is a rising phenomenon that motivated researchers to dedicate substantial efforts to the challenging direction of hateful content identification. We not only need an efficient automatic hate speech detection model based on advanced machine learning and natural language processing, but also a sufficiently large amount of annotated data to train a model. The lack of a sufficient amount of labelled hate speech data, along with the existing biases, has been the main issue in this domain of research. To address these needs, in this study we introduce a novel transfer learning approach based on an existing pre-trained language model called BERT (Bidirectional Encoder Representations from Transformers). More specifically, we investigate the ability of BERT at capturing hateful context within social media content by using new fine-tuning methods based on transfer learning. To evaluate our proposed approach , we use two publicly available datasets that have been annotated for racism, sexism, hate, or offensive content on Twitter. The results show that our solution obtains considerable performance on these datasets in terms of precision and recall in comparison to existing approaches. Consequently , our model can capture some biases in data annotation and collection process and can potentially lead us to a more accurate model.
Fichier principal
Vignette du fichier
Complex_Network A BERT-Based Transfer.pdf (387.13 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02344806 , version 1 (04-11-2019)

Identifiers

Cite

Marzieh Mozafari, Reza Farahbakhsh, Noel Crespi. A BERT-based transfer learning approach for hate speech detection in online social media. Complex Networks 2019: 8th International Conference on Complex Networks and their Applications, Dec 2019, Lisbonne, Portugal. pp.928-940, ⟨10.1007/978-3-030-36687-2_77⟩. ⟨hal-02344806⟩
597 View
1188 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More