brain-score / brain-score/vision
deal with failed benchmarks
Open
- Dominant language
- Python
- Stars
- 193
- Forks
- 105
- Avg merge
- 10h 48m
- Merged PRs (30d)
- 10
Description
E.g. one recent submission ran through on all benchmarks but then ran into an out-of-memory error for Kar2019. Is there a way for us to detect these and report the score as failed?
OOM in particular crashes python, so may be difficult...
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.