Online classification accuracy is a poor metric to study mental imagery-based bci user learning: an experimental demonstration and new metrics - Archive ouverte HAL Access content directly
Conference Papers Year : 2017

Online classification accuracy is a poor metric to study mental imagery-based bci user learning: an experimental demonstration and new metrics

Abstract

While promising for many applications, Electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs) are still scarcely used outside laboratories , due to a poor reliability. It is thus necessary to study and fix this reliability issue. Doing so requires to use appropriate reliability metrics to quantify both signal processing and user learning performances. So far, Classification Accuracy (CA) is the typical metric used for both aspects. However, we argue in this paper that CA is a poor metric to study how well users are learning to use the BCI. Indeed CA is notably unspecific, discrete, training data and classifier dependent, and as such may not always reflect successful EEG pattern self-modulation by the user. We thus propose new performance metrics to specifically measure how distinct and stable the EEG patterns produced by the user are. By re-analyzing EEG data with these metrics, we indeed confirm that CA may hide some learning effects or hide the user inability to self-modulate a given EEG pattern.
Fichier principal
Vignette du fichier
lotte-jeunet_graz2017_metrics_final.pdf (1.19 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01519478 , version 1 (07-05-2017)

Identifiers

  • HAL Id : hal-01519478 , version 1

Cite

Fabien Lotte, Camille Jeunet. Online classification accuracy is a poor metric to study mental imagery-based bci user learning: an experimental demonstration and new metrics . 7th International BCI Conference, Sep 2017, Graz, Austria. ⟨hal-01519478⟩
975 View
614 Download

Share

Gmail Facebook X LinkedIn More