brain-score / brain-score/language

plugin tests summary only shows 1 plugin even though 2 failed

Open
#86 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Jupyter Notebook
Stars
45
Forks
21
Avg merge
1h 7m
Merged PRs (30d)
1

Description

In https://app.travis-ci.com/github/brain-score/language/jobs/585999208 two plugins failed: `metrics/linear_predictivity` and `models/random_embedding`.
But the summary at the end only shows 1 plugin as failed:
```
AssertionError:
1 plugin tests failed
{'models_random_embedding': 1}
```
I'm guessing this is because the metric plugin failed due to an import and so could not be collected in the first place.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.