Improving Arabic information retrieval using word embedding similarities - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Speech Technology Année : 2018

Improving Arabic information retrieval using word embedding similarities

Résumé

Term mismatch is a common limitation of traditional information retrieval (IR) models where relevance scores are estimated based on exact matching of documents and queries. Typically, good IR model should consider distinct but semantically similar words in the matching process. In this paper, we propose a method to incorporate word embedding (WE) semantic similarities into existing probabilistic IR models for Arabic in order to deal with term mismatch. Experiments are performed on the standard Arabic TREC collection using three neural word embedding models. The results show that extending the existing IR models improves significantly baseline bag-of-words models. Although the proposed extensions significantly outperform their baseline bag-of-words, the difference between the evaluated neural word embedding models is not statistically significant. Moreover, the overall comparison results show that our extensions significantly improve the Arabic WordNet based semantic indexing approach and three recent WE-based IR language models.
Fichier non déposé

Dates et versions

hal-01706531 , version 1 (12-02-2018)

Identifiants

  • HAL Id : hal-01706531 , version 1

Citer

Abdelkader El Mahdaouy, Said El Alaoui Ouatik, Eric Gaussier. Improving Arabic information retrieval using word embedding similarities. International Journal of Speech Technology, 2018, 21 (1), pp.121-136. ⟨hal-01706531⟩
189 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More