Multi-expert annotation of Crohn’s disease images of the small bowel for automatic detection using a convolutional recurrent attention neural network - Archive ouverte HAL Access content directly
Journal Articles Endoscopy International Open Year : 2021

Multi-expert annotation of Crohn’s disease images of the small bowel for automatic detection using a convolutional recurrent attention neural network

Remi Vallée
  • Function : Author
  • PersonId : 177271
  • IdHAL : remi-vallee

Abstract

Background and study aims: Computer-aided diagnostic tools using deep neural networks are efficient for detection of lesions in endoscopy but require a huge number of images. The impact of the quality of annotation has not been tested yet. Here we describe a multi-expert annotated dataset of images extracted from capsules from Crohn’s disease patients and the impact of the quality of annotations on the accuracy of a recurrent attention neural network.Methods: Images of capsule were annotated by a reader first and then reviewed by three experts in inflammatory bowel disease. Concordance analysis between experts was evaluated by Fleiss’ kappa and all the discordant images were, again, read by all the endoscopists to obtain a consensus annotation. A recurrent attention neural network developed for the study was tested before and after the consensus annotation. Available neural networks (ResNet and VGGNet) were also tested under the same conditions.Results: The final dataset included 3498 images with 2124 non-pathological (60.7 %), 1360 pathological (38.9 %), and 14 (0.4 %) inconclusive. Agreement of the experts was good for distinguishing pathological and non-pathological images with a kappa of 0.79 (P < 0.0001). The accuracy of our classifier and the available neural networks increased after the consensus annotation with a precision of 93.7 %, sensitivity of 93 %, and specificity of 95 %.Conclusions: The accuracy of the neural network increased with improved annotations, suggesting that the number of images needed for the development of these systems could be diminished using a well-designed dataset.
Fichier principal
Vignette du fichier
a-1468-3964.pdf (1.01 Mo) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

hal-03268826 , version 1 (23-06-2021)

Identifiers

Cite

Astrid de Maissin, Remi Vallée, Mathurin Flamant, Marie Fondain-Bossiere, Catherine Le Berre, et al.. Multi-expert annotation of Crohn’s disease images of the small bowel for automatic detection using a convolutional recurrent attention neural network. Endoscopy International Open, 2021, 09 (07), pp.E1136 - E1144. ⟨10.1055/a-1468-3964⟩. ⟨hal-03268826⟩
407 View
87 Download

Altmetric

Share

Gmail Facebook X LinkedIn More