A survey on training and evaluation of word embeddings - Archive ouverte HAL Access content directly
Journal Articles International Journal of Data Science and Analytics Year : 2021

A survey on training and evaluation of word embeddings


Word Embeddings have proven to be effective for many Natural Language Processing tasks by providing word representations integrating prior knowledge. In this article, we focus on the algorithms and models used to compute those representations and on their methods of evaluation. Many new techniques were developed in a short amount of time and there is no unified terminology to emphasise strengths and weaknesses of those methods. Based on the state of the art, we propose a thorough terminology to help with the classification of these various models and their evaluations. We also provide comparisons of those algorithms and methods, highlighting open problems and research paths, as well as a compilation of popular evaluation metrics and datasets. This survey gives: 1) an exhaustive description and terminology of currently investigated word embeddings, 2) a clear segmentation of evaluation methods and their associated datasets, and 3) high-level properties to indicate pros and cons of each solution.
Fichier principal
Vignette du fichier
ijdsa_format_final_postprint.pdf (584.78 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03148517 , version 1 (22-02-2021)



François Torregrossa, Robin Allesiardo, Vincent Claveau, Nihel Kooli, Guillaume Gravier. A survey on training and evaluation of word embeddings. International Journal of Data Science and Analytics, 2021, 11 (2), pp.85-103. ⟨10.1007/s41060-021-00242-8⟩. ⟨hal-03148517⟩
262 View
315 Download



Gmail Facebook Twitter LinkedIn More