Network-Based Pooling for Topic Modeling on Microblog Content - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Network-Based Pooling for Topic Modeling on Microblog Content

Résumé

Topic modeling with tweets is difficult due to the short and informal nature of the texts. Tweet-pooling (aggregation of tweets into longer documents prior to training) has been shown to improve model outputs, but performance varies depending on the pooling scheme and data set used. Here we investigate a new tweet-pooling method based on network structures associated with Twitter content. Using a standard formulation of the well-known Latent Dirichlet Allocation (LDA) topic model, we trained various models using different tweet-pooling schemes on three diverse Twitter datasets. Tweet-pooling schemes were created based on mention/reply relationships between tweets and Twitter users, with several (non-networked) established methods also tested as a comparison. Results show that pooling tweets using network information gives better topic coherence and clustering performance than other pooling schemes, on the majority of datasets tested. Our findings contribute to an improved methodology for topic modeling with Twitter content.
Fichier principal
Vignette du fichier
spire_2019_ollagnier.pdf (340.77 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03589875 , version 1 (26-02-2022)

Identifiants

Citer

Anaïs Ollagnier, Hywel C Williams. Network-Based Pooling for Topic Modeling on Microblog Content. 26th International Symposium on String Processing and Information Retrieval (SPIRE 2019), Oct 2019, Ségovie, United States. pp.80-87, ⟨10.1007/978-3-030-32686-9_6⟩. ⟨hal-03589875⟩
22 Consultations
55 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More