brain-score / brain-score/brain-score.web
delete submitted models and score consistency
- Dominant language
- JavaScript
- Stars
- 3
- Forks
- 7
- Avg merge
- 7m
- Merged PRs (30d)
- 1
Description
Hey,
I just realized that the average model score is different in all three places (profile, model page, competition leaderboard). I guess it's due to benchmarks that have and have not been added in the places. I guess it would clearer and more comprehensive to have this unified on all tables.
Also I was wondering if you might want to implement a function to delete submitted models from the database, as the number of model submissions might increase..
Thanks!
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing how average scores are calculated for the profile, model page, and competition leaderboard, then inspect how submitted models are stored in the database. Done means the three displayed averages use one consistent definition and submitted models can be deleted safely.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript
- Domain
- backend, database
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100