brain-score / brain-score/brain-score.web

Updating the `public` identifier for models to `leaderboard_public`

Open
#240 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
3
Forks
7
Avg merge
7m
Merged PRs (30d)
1

Description

Currently, each model has an attribute `public` that specifies whether model scores will be displayed publicly through the BrainScore leaderboard. We want to add a new attribute specifying whether a submitted model's codebase is public. To avoid confusion between the two attributes, the current `public` attribute in the database, submission JSON files on Braintree, and website need to be updated to `leaderboard_public`.

The new attribute specifying whether a submitted model's codebase is public could therefore be called `code_public`.

Contributor guide

No contributing guide indexed for this repository

Research direction

Trace the current `public` attribute through the database, submission JSON files on Braintree, and the website. Identify every place that reads or writes the identifier, then verify that leaderboard visibility uses `leaderboard_public` and codebase visibility uses the new `code_public` attribute across those surfaces.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
database, web-dev
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.