How precise are performance estimates for typical medical image segmentation tasks? - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

How precise are performance estimates for typical medical image segmentation tasks?

Résumé

An important issue in medical image processing is to be able to estimate not only the performances of algorithms but also the precision of the estimation of these performances. Reporting precision typically amounts to reporting standard-error of the mean (SEM) or equivalently confidence intervals. However, this is rarely done in medical image segmentation studies. In this paper, we aim to estimate what is the typical confidence that can be expected in such studies. To that end, we first perform experiments for Dice metric estimation using a standard deep learning model (U-net) and a classical task from the Medical Segmentation Decathlon. We extensively study precision estimation using both Gaussian assumption and bootstrapping (which does not require any assumption on the distribution). We then perform simulations for other test set sizes and performance spreads. Overall, our work shows that small test sets lead to wide confidence intervals (e.g. ∼8 points of Dice for 20 samples with σ ≃ 10).
Fichier principal
Vignette du fichier
final_version.pdf (240.72 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04104891 , version 1 (24-05-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04104891 , version 1

Citer

Rosana El Jurdi, Olivier Colliot. How precise are performance estimates for typical medical image segmentation tasks?. IEEE International Symposium on Biomedical Imaging (ISBI 2023), IEEE, Apr 2023, Cartagena de Indias, Colombia. ⟨hal-04104891⟩
12 Consultations
26 Téléchargements

Partager

Gmail Facebook X LinkedIn More