Statistics in MOABB
Open
@bruAristimunha is already working on this.
Since Mar 11, 2023.
moabb
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 264
- Avg merge
- 1d 13m
- Merged PRs (30d)
- 23
Description
MOABB has a very good statistical methodology for experimental analysis and benchmarking algorithms.
It could be a nice addition to reinforce these aspects with:
- a specific example/tutorial, that details the chosen statistics and how to use it.
- improve definition of chance level
Regarding chance level, we simply use the limit when the number of samples tends to infinity (50% for 2 classes, 25% for 4 classes, etc). This chance level is a crude approximation and could be refined, either using the class sample balance (Better than random: a closer look on BCI results) or by characterizing the class sample distribution (Exceeding chance level by chance)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.