Evaluation of text clustering methods and their dataspace embeddings: an exploration - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Evaluation of text clustering methods and their dataspace embeddings: an exploration

Résumé

Fair evaluation of text clustering methods needs to clarify the relations between 1)pre-processing, resulting in raw term occurrence vectors, 2)data transformation, and 3)method in the strict sense. We have tried to empirically compare a dozen well-known methods and variants in a protocol crossing three contrasted open-access corpora in a few tens transformed dataspaces. We compared the resulting clusterings to their supposed "ground-truth" classes by means of four usual indices. The results show both a confirmation of well-established implicit combinations, and good performances of unexpected combinations, mostly in spectral or kernel dataspaces. The rich material resulting from these some 450 runs includes a wealth of intriguing facts, which needs further research on the specificities of text corpora in relation to methods and dataspaces.
Fichier principal
Vignette du fichier
Cadot-Lelu_Cluster-Challenge7.pdf (1.14 Mo) Télécharger le fichier
Links_to_codes.pdf (56.82 Ko) Télécharger le fichier
PresentationIFCS19LeLu-Cadot_ccc.pdf (995.56 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02116493 , version 1 (02-05-2019)
hal-02116493 , version 2 (19-08-2019)
hal-02116493 , version 3 (09-10-2019)
hal-02116493 , version 4 (30-01-2020)

Identifiants

  • HAL Id : hal-02116493 , version 4

Citer

Alain Lelu, Martine Cadot. Evaluation of text clustering methods and their dataspace embeddings: an exploration. IFCS 2019 - 16th International of the Federation of Classification Societies, Aug 2019, Thessaloniki, Greece. ⟨hal-02116493v4⟩
323 Consultations
645 Téléchargements

Partager

Gmail Facebook X LinkedIn More