brain-score / brain-score/vision
Fix Score reproducibility discrepancy with Rank 12 and 18 models
Open
- Dominant language
- Python
- Stars
- 193
- Forks
- 105
- Avg merge
- 10h 48m
- Merged PRs (30d)
- 10
Description
Currently the following models do not reproduce on MajajHong2015-IT:
1. `resnet50_finetune_cutmix_e3_robust_linf8255_e0_247x234`
- Website Score: 0.518, Local 2.0 Score: 0.5238, Local 1.0 score: 0.518
- 1.0 Reproducibility status PR here: #884
2. `resnet50-VITO-8deg-cc`
- Website Score: 0.512, Local 2.0 Score: 0.5079, 1.0 Local score: 0.512
- 1.0 Reproducibility status PR here: #883
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.