Providing Automatic Feedback to Trainees after Automatic Evaluation - Archive ouverte HAL
Communication Dans Un Congrès Année : 2021

Providing Automatic Feedback to Trainees after Automatic Evaluation

Résumé

Learning how to perform precise and controlled gestures is difficult, especially when feedback about made errors is sparse. Therefore, some works try to facilitate learning by providing virtual "coaches". Most of them propose to automatically score task quality. But simply assessing quality through a score is not enough. Indeed, it is essential to provide explanations on assigned scores just like experts do when supervising trainees. However when quality assessment is done automatically, such explanations are rare and computing an automatic feedback is complex. In this work, we propose to address this problem by providing an automatic feedback based on neural network explanation. Contrary to previous state of the art methods, which are focused on neural networks explicability for classification tasks, we want to explain network decision on a regression problem (quality score prediction). Thus, we propose to use gradient-based approaches and adapt them to a regression task. Moreover, to address the problem of noise present in sensitivity maps, we propose a solution that leads to more robust gradients. To test our approach, since automatic quality assessment datasets do not contain ground truth about errors position and amplitude, a synthetic dataset representing a simple temporal task has been created, with its associated ground truth. Once the method has been validated on this synthetic dataset, we apply it on real data composed of robotic surgical gestures.
Fichier principal
Vignette du fichier
icra_2021.pdf (313.57 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03390984 , version 1 (21-10-2021)

Identifiants

Citer

Mégane Millan, Catherine Achard. Providing Automatic Feedback to Trainees after Automatic Evaluation. ICRA 2021, May 2021, Xi'an, China. ⟨10.1109/ICRA48506.2021.9561486⟩. ⟨hal-03390984⟩
35 Consultations
106 Téléchargements

Altmetric

Partager

More