Change detection in textual classification with unexpected dynamics - Archive ouverte HAL
Article Dans Une Revue Expert Systems with Applications Année : 2021

Change detection in textual classification with unexpected dynamics

Résumé

Identifying changes in the dynamics of a classification scheme is an important task to solve using textual data streams. Changes in the volume of documents classified into one category could be a sign of a new emerging structure, which therefore gives clues on the need to update the classification scheme. In this paper, we present a method based on forecasting techniques, change detection and time series monitoring in order to raise alerts as soon as a change occurs in the volume of a given category. We build features only based on the textual content that enable us to accurately predict the expected temporal evolution of such category. Then, we use statistical process control to determine if the current volume is too far away from the one we might expect. We test our method on the New York Times Annotated Corpus and on an industrial data set from Electricité de France (EDF) and we observe that it raises alerts at the right time compared to other techniques from the literature.
Fichier principal
Vignette du fichier
ESWA_CDPred.pdf (2.82 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03230916 , version 1 (20-05-2021)

Identifiants

Citer

Clément Christophe, Julien Velcin, Jairo Cugliari, Philippe Suignard, Manel Boumghar. Change detection in textual classification with unexpected dynamics. Expert Systems with Applications, 2021, 176, pp.114831. ⟨10.1016/j.eswa.2021.114831⟩. ⟨hal-03230916⟩
40 Consultations
76 Téléchargements

Altmetric

Partager

More