Improving Arabic information retrieval using word embedding similarities - Archive ouverte HAL Access content directly
Journal Articles International Journal of Speech Technology Year : 2018

Improving Arabic information retrieval using word embedding similarities

Abstract

Term mismatch is a common limitation of traditional information retrieval (IR) models where relevance scores are estimated based on exact matching of documents and queries. Typically, good IR model should consider distinct but semantically similar words in the matching process. In this paper, we propose a method to incorporate word embedding (WE) semantic similarities into existing probabilistic IR models for Arabic in order to deal with term mismatch. Experiments are performed on the standard Arabic TREC collection using three neural word embedding models. The results show that extending the existing IR models improves significantly baseline bag-of-words models. Although the proposed extensions significantly outperform their baseline bag-of-words, the difference between the evaluated neural word embedding models is not statistically significant. Moreover, the overall comparison results show that our extensions significantly improve the Arabic WordNet based semantic indexing approach and three recent WE-based IR language models.
No file

Dates and versions

hal-01706531 , version 1 (12-02-2018)

Identifiers

  • HAL Id : hal-01706531 , version 1

Cite

Abdelkader El Mahdaouy, Said El Alaoui Ouatik, Eric Gaussier. Improving Arabic information retrieval using word embedding similarities. International Journal of Speech Technology, 2018, 21 (1), pp.121-136. ⟨hal-01706531⟩
178 View
0 Download

Share

Gmail Facebook Twitter LinkedIn More