A Quantitative Analysis of Noise Impact on Document Ranking - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

A Quantitative Analysis of Noise Impact on Document Ranking

Résumé

After decades of massive digitization, a substantial amount of documents exists in digital form. The accessibility of these documents is strongly impacted by the quality of document indexing. Most of these documents are indexed in noisy versions that include numerous errors. The noise can be due to manual input mistakes or optical character recognition process and results in errors like spelling mistakes, missing characters, and others. This paper presents a study of the impact of noise on document ranking, an essential task in natural language processing (NLP) with wide-ranging practical applications. We provide a deep and quantitative analysis of the impact of recognition errors on document ranking by testing two popular ranking models on several noisy versions of a subset of the MS MARCO passage ranking dataset, with various levels and types of noise. Our study provides insights into the challenges of document ranking under noisy conditions and advocates for developing ranking models that are more robust to noise.
Fichier principal
Vignette du fichier
SMC 2023 - A Quantitative Analysis of Noise Impact.pdf (546.83 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04284004 , version 1 (14-11-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04284004 , version 1

Citer

Edward Giamphy, Kevin Sanchis, Gohar Dashyan, Jean-Loup Guillaume, Ahmed Hamdi, et al.. A Quantitative Analysis of Noise Impact on Document Ranking. IEEE Conference on Systems, Man, and Cybernetics, Oct 2023, Honolulu, United States. ⟨hal-04284004⟩

Collections

L3I UNIV-ROCHELLE
42 Consultations
55 Téléchargements

Partager

Gmail Facebook X LinkedIn More