Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse - Archive ouverte HAL Access content directly
Journal Articles Medical Image Analysis Year : 2023

Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse

Abstract

A variety of algorithms have been proposed for computer-aided diagnosis of dementia from anatomical brain MRI. These approaches achieve high accuracy when applied to research data sets but their performance on real-life clinical routine data has not been evaluated yet. The aim of this work was to study the performance of such approaches on clinical routine data, based on a hospital data warehouse, and to compare the results to those obtained on a research data set. The clinical data set was extracted from the hospital data warehouse of the Greater Paris area, which includes 39 different hospitals. The research set was composed of data from the Alzheimer's Disease Neuroimaging Initiative data set. In the clinical set, the population of interest was identified by exploiting the diagnostic codes from the 10th revision of the International Classification of Diseases that are assigned to each patient. We studied how the imbalance of the training sets, in terms of contrast agent injection and image quality, may bias the results. We demonstrated that computer-aided diagnosis performance was strongly biased upwards (over 17 percent points of balanced accuracy) by the confounders of image quality and contrast agent injection, a phenomenon known as the Clever Hans effect or shortcut learning. When these biases were removed, the performance was very poor. In any case, the performance was considerably lower than on the research data set. Our study highlights that there are still considerable challenges for translating dementia computer-aided diagnosis systems to clinical routine.
Fichier principal
Vignette du fichier
6-Paper_NO_track_changes.pdf (465.98 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03656136 , version 1 (01-05-2022)
hal-03656136 , version 2 (04-06-2023)

Licence

Identifiers

  • HAL Id : hal-03656136 , version 2

Cite

Simona Bottani, Ninon Burgos, Aurélien Maire, Dario Saracino, Sebastian Stroer, et al.. Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse. Medical Image Analysis, 2023, 89, pp.102903. ⟨hal-03656136v2⟩
288 View
373 Download

Share

Gmail Mastodon Facebook X LinkedIn More