brain-score / brain-score/core

Feature suggestion: distributed learning on volunteer compute

Open
#122 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4
Forks
9
PR merge metrics
No merged PRs in 30d

Description

Another feature idea is for a case where we allow the user to upload their model, which we will train for them and evaluate on a chosen benchmark with a chose metric.

We can think of ways to use open-source distributed-learning libraries like [this one](https://github.com/learning-at-home/hivemind) for **very** distributed training (taking into account a possibility where compute is not guaranteed for the whole training process and coincidently) on volunteer computers.

And there are [known success stories] of volunteer compute being used for costly scientific computations (https://en.wikipedia.org/wiki/LHC@home#:~:text=The%20project's%20computing%20power%20isand%20other%20experimental%20particle%20accelerators.&text=The%20project%20is%20run%20withteraFLOPS%20as%20of%20March%202023.)

I understand that this is very far-fetched but hopefully Brain-Score team grows enourmously one day, and there will be enough people to handle this as well!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.