Automatic Text Summarization Approaches to Speed up Topic Model Learning Process - Archive ouverte HAL
Article Dans Une Revue International Journal of Computational Linguistics and Applications Année : 2016

Automatic Text Summarization Approaches to Speed up Topic Model Learning Process

Résumé

The number of documents available into Internet moves each day up. For this reason, processing this amount of information effectively and expressibly becomes a major concern for companies and scientists. Methods that represent a textual document by a topic representation are widely used in Information Retrieval (IR) to process big data such as Wikipedia articles. One of the main difficulty in using topic model on huge data collection is related to the material resources (CPU time and memory) required for model estimate. To deal with this issue, we propose to build topic spaces from summarized documents. In this paper, we present a study of topic space representation in the context of big data. The topic space representation behavior is analyzed on different languages. Experiments show that topic spaces estimated from text summaries are as relevant as those estimated from the complete documents. The real advantage of such an approach is the processing time gain: we showed that the processing time can be drastically reduced using summarized documents (more than 60\% in general). This study finally points out the differences between thematic representations of documents depending on the targeted languages such as English or latin languages.
Fichier principal
Vignette du fichier
IJCLA-2016-2-pp-087-109-preprint-1.pdf (881.73 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02356467 , version 1 (22-04-2020)

Identifiants

Citer

Mohamed Morchid, Juan-Manuel Torres-Moreno, Richard Dufour, Javier Ramírez-Rodríguez, Georges Linares. Automatic Text Summarization Approaches to Speed up Topic Model Learning Process. International Journal of Computational Linguistics and Applications, 2016, 7, pp.87 - 109. ⟨hal-02356467⟩

Collections

UNIV-AVIGNON LIA
57 Consultations
44 Téléchargements

Altmetric

Partager

More