Evaluating the impact of text duplications on a corpus of more than 600,000 clinical narratives in a French Hospital - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Evaluating the impact of text duplications on a corpus of more than 600,000 clinical narratives in a French Hospital

Résumé

A significant part of medical knowledge is stored as unstructured free text. However, Clinical narratives are known to contains duplicated sections due to clinicians’ copy/paste parts of a former report into a new one. In this study, we aim at evaluating the duplications found within patients records in 650,000 French clinical narratives. We adapted a method to identify efficiently duplicated zones in a reasonable time. We evaluated the potential impact of duplications in two use-cases: the presence of (i) treatments and/or (ii) relative dates. We identified an average rate of duplication of 33%. We found that 20% of the document contained drugs mentioned only in duplicated zones and that 1.48% of the document contained mentions of relative dates in duplicated zone, that could potentially lead to erroneous interpretation. We suggest the systematic identification and annotation of duplicated zones in clinical narratives for information extraction and temporal-oriented tasks.
Fichier principal
Vignette du fichier
WilliamDiganMedinfo2919submission_809.pdf (881.82 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02265124 , version 1 (08-08-2019)

Identifiants

  • HAL Id : hal-02265124 , version 1

Citer

William Digan, Maxime Wack, Vincent Looten, Antoine Neuraz, Anita Burgun, et al.. Evaluating the impact of text duplications on a corpus of more than 600,000 clinical narratives in a French Hospital. medinfo 2019, Aug 2019, Lyon, France. ⟨hal-02265124⟩
208 Consultations
82 Téléchargements

Partager

Gmail Facebook X LinkedIn More