Data Extraction and Synthesis in Systematic Reviews of Diagnostic Test Accuracy: A Corpus for Automating and Evaluating the Process - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Data Extraction and Synthesis in Systematic Reviews of Diagnostic Test Accuracy: A Corpus for Automating and Evaluating the Process

Résumé

Background: Systematic reviews are critical for obtaining accurate estimates of diagnostic test accuracy, yet these require extracting information buried in free text articles, which is often laborious. Objective: We create a dataset describing the data extraction and synthesis processes in 63 DTA systematic reviews, and demonstrate its utility by using it to replicate the data synthesis in the original reviews. Method: We construct our dataset using a custom automated extraction pipeline complemented with manual extraction, verification, and post-editing. We evaluate us- ing manual assessment by two annotators and by comparing against data extracted from source files. Results: The constructed dataset contains 5,848 test results for 1,354 diagnostic tests from 1,738 diagnostic studies. We observe an extraction error rate of 0.06–0.3%. Conclusions: This constitutes the first dataset describing the later stages of the DTA systematic review process, and is intended to be useful for automating or evaluating the process.
Fichier non déposé

Dates et versions

hal-01990494 , version 1 (23-01-2019)

Identifiants

  • HAL Id : hal-01990494 , version 1

Citer

Christopher Norman, Mariska Leeflang, Aurélie Névéol. Data Extraction and Synthesis in Systematic Reviews of Diagnostic Test Accuracy: A Corpus for Automating and Evaluating the Process. AMIA Annual Symposium, American Medical Informatics Association, Nov 2018, San Francisco, CA, United States. ⟨hal-01990494⟩
32 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More