brain-score / brain-score/core

allow private code submissions

Open
#26 0 comments 0 reactions 1 assignee Claimed by @samwinebrake View on GitHub
Dominant language
Python
Stars
4
Forks
9
PR merge metrics
No merged PRs in 30d

Description

There are quite a few users who prefer to not make their submitted model code public, e.g. because it's under active development. I would like to support that use case in the future too where users can e.g. submit a model before publication, include the results in their paper, and later opt to make it public. In other words, it should be possible to receive a score for a private model without making any of the code public.

One way to implement this (suggested by @kvfairchild) is to manage a separate private repository with private registries for internal scoring use only, that we can internally still score on and make the scores visible to the user (and potentially publicly if selected).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.