WAC: A Corpus of Wikipedia Conversations for Online Abuse Detection - Archive ouverte HAL Access content directly
Conference Papers Year : 2020

WAC: A Corpus of Wikipedia Conversations for Online Abuse Detection

Noé Cecillon
Vincent Labatut
Richard Dufour
Georges Linares


With the spread of online social networks, it is more and more difficult to monitor all the user-generated content. Automating the moderation process of the inappropriate exchange content on Internet has thus become a priority task. Methods have been proposed for this purpose, but it can be challenging to find a suitable dataset to train and develop them. This issue is especially true for approaches based on information derived from the structure and the dynamic of the conversation. In this work, we propose an original framework, based on the Wikipedia Comment corpus, with comment-level abuse annotations of different types. The major contribution concerns the reconstruction of conversations, by comparison to existing corpora, which focus only on isolated messages (i.e. taken out of their conversational context). This large corpus of more than 380k annotated messages opens perspectives for online abuse detection and especially for context-based approaches. We also propose, in addition to this corpus, a complete benchmarking platform to stimulate and fairly compare scientific works around the problem of content abuse detection, trying to avoid the recurring problem of result replication. Finally, we apply two classification methods to our dataset to demonstrate its potential.
Fichier principal
Vignette du fichier
paper.pdf (699.83 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02497514 , version 1 (13-03-2020)



Noé Cecillon, Vincent Labatut, Richard Dufour, Georges Linares. WAC: A Corpus of Wikipedia Conversations for Online Abuse Detection. 12th International Conference on Language Resources and Evaluation (LREC), May 2020, Marseille, France. pp.1375-1383. ⟨hal-02497514⟩





Gmail Facebook X LinkedIn More