A replicable comparison study of NER software: StanfordNLP, NLTK, OpenNLP, SpaCy, Gate - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

A replicable comparison study of NER software: StanfordNLP, NLTK, OpenNLP, SpaCy, Gate

Résumé

Named Entity Recognition (NER) is a key building block of any Natural Language Processing (NLP) system, making possible the detection and classification of entities (e.g., Person, Location) in any given text. While a large number of NER software exist today, it remains difficult for NLP and NER practitioners to clearly and objectively identify what software perform(s) the best. One of the reasons is the difference in results across the literature and the lack of information needed to be able to fully reproduce the experiment. To overcome this problem, this paper presents a comprehensive and replicable study to assess the performance of NER software, thus laying the groundwork for future benchmarking and meaningful comparison studies. As part of our experiments, the latest version of five well-known NER software were selected, along with two distinct corpora. We observe a discrepancy between the result we get and the result found in the literature being around 50% in certain cases. We also found that StanfordNLP usually performs the best.
Fichier non déposé

Dates et versions

hal-03002671 , version 1 (12-11-2020)

Identifiants

Citer

Xavier Schmitt, Sylvain Kubler, Jérémy Robert, Mike Papadakis, Yves Le Traon. A replicable comparison study of NER software: StanfordNLP, NLTK, OpenNLP, SpaCy, Gate. Sixth International Conference on Social Networks Analysis, Management and Security, SNAMS 2019, Oct 2019, Grenada, Spain. ⟨10.1109/SNAMS.2019.8931850⟩. ⟨hal-03002671⟩
129 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More