brain-score / brain-score/language
bug in Futrell2018 corpus?
- Dominant language
- Jupyter Notebook
- Stars
- 45
- Forks
- 21
- Avg merge
- 1h 7m
- Merged PRs (30d)
- 1
Description
From Ethan Wilcox:
> a bug was found in the corpus in 2020, and I'm wondering if the current Brain Score uses the original or the corrected dataset
> ...
> [in Brain-Score] there's a script that uploaded the raw RTs from a server where they had been downloaded, and the last time this script was uploaded was 2022, which was after the bug had been fixed. But, the github code doesn't say when the initial data had been downloaded
Contributor guide
No contributing guide indexed for this repository
Research direction
Locate the script that uploaded the raw RTs and inspect its history and the current Brain-Score dataset source. Compare the corpus in use with the 2020 corrected dataset and establish when the initial data was downloaded. Done when the dataset version and download timing are verified or the discrepancy is documented.
Written by the indexing model from the issue text.
Assessment
- Domain
- data
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100