The largest EEG-based Benchmark for Open Science#
+We report the results of the benchmark study performed in: +The largest EEG-based BCI reproducibility study for open science: the MOABB benchmark
+This study conducts an extensive Brain-computer interfaces (BCI) reproducibility analysis on open electroencephalography datasets, +aiming to assess existing solutions and establish open and reproducible benchmarks for effective comparison within the field. Please note that the results are obtained using Within-Session evaluation. +The results are reported regarding mean accuracy and standard deviation across all folds for all sessions and subjects.
+If you use the same evaluation procedure, you should expect similar results if you use the same pipelines and datasets, with some minor variations due to the randomness of the cross-validation procedure.
+You can copy and use the table in your work, but please **cite the paper** if you do so.
+Motor Imagery#
+Motor Imagery is a BCI paradigm where the subject imagines performing a movement. +Each imagery task is associated with a different class, and each task has its difficulty level related to how the brain generates the signal.
+Here, we present three different scenarios for Motor Imagery classification:
+-
+
Left vs Right Hand: We use only the classes Left Hand and Right Hand.
+Right Hand vs Feet: We use only Right Hand and Feet classes.
+All classes: We use all the classes in the dataset, when there are more than classes that are not Left Hand and Right Hand.
+
All the results here are for within-session evaluation, a 5-fold cross-validation, over the subject’s session.
+Motor Imagery - Left vs Right Hand#
+Left vs Right Hand: We use only the classes Left Hand and Right Hand.
+Pipelines |
+ + | + | + | + | + | + | + | + | + | + |
---|
Motor Imagery - Right Hand vs Feet#
+Right Hand vs Feet: We use only Right Hand and Feet classes.
+Pipeline |
+ + | + | + | + | + | + | + | + | + |
---|
Motor Imagery - All classes#
+All classes: We use all the classes in the dataset, when there are more than classes that are not Left Hand and Right Hand.
+Pipelines |
+ + | + | + | + | + | + |
---|
SSVEP (All classes)#
+Here, we have the results of the within-session evaluation, a 5-fold cross-validation, over the subject’s session. +We use all the classes available in the dataset.
+ + + + +Pipeline |
+ + | + | + | + | + | + | + |
---|
P300/ERP (All classes)#
+Here, we have the results of the within-session evaluation, a 5-fold cross-validation, over the subject’s session. +We use all the classes available in the dataset.
+Pipelines |
+ + | + | + | + | + | + | + | + | + | + | + | + | + | + | + |
---|