A survey on training and evaluation of word embeddings - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Data Science and Analytics Année : 2021

A survey on training and evaluation of word embeddings

Résumé

Word Embeddings have proven to be effective for many Natural Language Processing tasks by providing word representations integrating prior knowledge. In this article, we focus on the algorithms and models used to compute those representations and on their methods of evaluation. Many new techniques were developed in a short amount of time and there is no unified terminology to emphasise strengths and weaknesses of those methods. Based on the state of the art, we propose a thorough terminology to help with the classification of these various models and their evaluations. We also provide comparisons of those algorithms and methods, highlighting open problems and research paths, as well as a compilation of popular evaluation metrics and datasets. This survey gives: 1) an exhaustive description and terminology of currently investigated word embeddings, 2) a clear segmentation of evaluation methods and their associated datasets, and 3) high-level properties to indicate pros and cons of each solution.
Fichier principal
Vignette du fichier
ijdsa_format_final_postprint.pdf (584.78 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03148517 , version 1 (22-02-2021)

Identifiants

Citer

François Torregrossa, Robin Allesiardo, Vincent Claveau, Nihel Kooli, Guillaume Gravier. A survey on training and evaluation of word embeddings. International Journal of Data Science and Analytics, 2021, 11 (2), pp.85-103. ⟨10.1007/s41060-021-00242-8⟩. ⟨hal-03148517⟩
339 Consultations
746 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More