Multi-sequence learning for multiple sclerosis lesion segmentation in spinal cord MRI - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Multi-sequence learning for multiple sclerosis lesion segmentation in spinal cord MRI

Résumé

Automated tools developed to detect multiple sclerosis lesions in spinal cord MRI have thus far been based on processing single MR sequences in a deep learning model. This study is the first to explore a multi-sequence approach to this task and we propose a method to address inherent issues in multi-sequence spinal cord data, i.e., differing fields of view, inter-sequence alignment and incomplete sequence data for training and inference. In particular, we investigate a simple missing-modality method of replacing missing features with the mean over the available sequences. This approach leads to better segmentation results when processing a single sequence at inference than a model trained directly on that sequence, and our experiments provide valuable insights into the mechanism underlying this surprising result. In particular, we demonstrate that both the encoder and decoder benefit from the variability introduced in the multi-sequence setting. Additionally, we propose a latent feature augmentation scheme to reproduce this variability in a single-sequence setting, resulting in similar improvements over the single-sequence baseline.
Fichier principal
Vignette du fichier
MICCAI_2024___Orig_Submission-1.pdf (256.96 Ko) Télécharger le fichier
MICCAI_2024___Supplementary_Materials-8.pdf (367.27 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04668565 , version 1 (06-08-2024)

Licence

Identifiants

  • HAL Id : hal-04668565 , version 1

Citer

Ricky Walsh, Malo Gaubert, Cédric Meurée, Burhan Rashid Hussein, Anne Kerbrat, et al.. Multi-sequence learning for multiple sclerosis lesion segmentation in spinal cord MRI. MICCAI 2024 - 27th International Conference on Medical Image Computing and Computer-Assisted Intervention, Oct 2024, Marrakech, Morocco. pp.1-10. ⟨hal-04668565⟩
20 Consultations
7 Téléchargements

Partager

More