brain-score / brain-score/brain-score.web

delete submitted models and score consistency

Open
#129 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
JavaScript
Stars
3
Forks
7
Avg merge
7m
Merged PRs (30d)
1

Description

Hey,
I just realized that the average model score is different in all three places (profile, model page, competition leaderboard). I guess it's due to benchmarks that have and have not been added in the places. I guess it would clearer and more comprehensive to have this unified on all tables.

Also I was wondering if you might want to implement a function to delete submitted models from the database, as the number of model submissions might increase..

Thanks!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing how average scores are calculated for the profile, model page, and competition leaderboard, then inspect how submitted models are stored in the database. Done means the three displayed averages use one consistent definition and submitted models can be deleted safely.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
backend, database
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.