LoGE: an unsupervised local-global document extension generation in information retrieval for long documents - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Web Information Systems Année : 2023

LoGE: an unsupervised local-global document extension generation in information retrieval for long documents

Résumé

This paper aims to manage the word gap in information retrieval (IR) especially for long documents belonging to specific domains. In fact, with the continuous growth of text data that modern IR systems have to manage, existing solutions are needed to efficiently find the best set of documents for a given request. The words used to describe a query can differ from those used in related documents. Despite meaning closeness, nonoverlapping words are challenging for IR systems. This word gap becomes significant for long documents from specific domains. To generate new words for a document, a deep learning (DL) masked language model is used to infer related words. Used DL models are pretrained on massive text data and carry common or specific domain knowledge to propose a better document representation. The authors evaluate the approach of this study on specific IR domains with long documents to show the genericity of the proposed model and achieve encouraging results In this paper, to the best of the authors’ knowledge, an original unsupervised and modular IR system based on recent DL methods is introduced.
Fichier non déposé

Dates et versions

hal-04347068 , version 1 (15-12-2023)

Identifiants

Citer

Oussama Ayoub, Christophe Rodrigues, Nicolas Travers. LoGE: an unsupervised local-global document extension generation in information retrieval for long documents. International Journal of Web Information Systems, 2023, 19 (5/6), pp.244-262. ⟨10.1108/IJWIS-07-2023-0109⟩. ⟨hal-04347068⟩
29 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More