Efficient Generation and Processing of Word Co-occurrence Networks Using corpus2graph - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Efficient Generation and Processing of Word Co-occurrence Networks Using corpus2graph

Résumé

Corpus2graph is an open-source NLP-application-oriented Python package that generates a word co-occurrence network from a large corpus. It not only contains different built-in methods to preprocess words, analyze sentences, extract word pairs and define edge weights, but also supports user-customized functions. By using parallelization techniques, it can generate a large word co-occurrence network of the whole English Wikipedia data within hours. And thanks to its nodes-edges-weight three-level progressive calculation design, rebuilding networks with different configurations is even faster as it does not need to start all over again. This tool also works with other graph libraries such as igraph, NetworkX and graph-tool as a front end providing data to boost network generation speed.
Fichier non déposé

Dates et versions

hal-01836489 , version 1 (12-07-2018)

Identifiants

  • HAL Id : hal-01836489 , version 1

Citer

Zheng Zhang, Ruiqing Yin, Pierre Zweigenbaum. Efficient Generation and Processing of Word Co-occurrence Networks Using corpus2graph. Workshop on Graph-Based Natural Language Processing, Jun 2018, New Orleans, LA, United States. ⟨hal-01836489⟩
148 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More