brain-score / brain-score/vision

Marques score assertion errors

Open
#1,197 0 comments 0 reactions 2 assignees Claimed by @mike-ferguson View on GitHub
bug
Dominant language
Python
Stars
193
Forks
105
Avg merge
10h 48m
Merged PRs (30d)
10

Description

Score assertion errors are present within the [marques2020 benchmark tests](https://github.com/brain-score/vision/blob/master/brainscore_vision/benchmarks/marques2020/test.py). See below for an example:

```
brainscore_vision/benchmarks/marques2020/test.py:68 (test_Marques2020[Marques2020_Cavanaugh2002-grating_summation_field-expected0])

array(0.77613597)
Attributes:
error: 0.024806444383184106
raw: [0.79613484 0.76925312 0.7953668 0.77673325 0.79324324 0.76894... != 0.599 ± 1.0e-02

benchmark = 'Marques2020_Cavanaugh2002-grating_summation_field'
expected = 0.599 ± 1.0e-02
```

Also, to get to the point of having this test run, `--target8.00--sourceNone` must be stripped from the `stimuli.identifer`.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.