brain-score / brain-score/brain-score.web

non-public benchmarks shown in user area table

Open
#53 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
3
Forks
7
Avg merge
7m
Merged PRs (30d)
1

Description

Users are supposed to only see benchmarks that they have run their model on in the user area. However it seems that all available benchmarks are visible to them.
![image (4)](https://user-images.githubusercontent.com/5308236/105869928-c304cd80-5fc5-11eb-9352-8c87069640f7.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the user-area table and the code that loads its benchmark list. Reproduce the view with a user who has run a model on only some benchmarks, then trace the visibility or filtering behavior. Done means users see only benchmarks on which they have run their model.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
frontend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.