bigscience-workshop / bigscience-workshop/petals

Feature Request: Distributed inference API where the "miners" are paid.

Open
#556 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
650
PR merge metrics
No merged PRs in 30d

Description

I'm imagining a situation where people can infer for others and make a small profit. In practicality it is similar to, but more useful than, cryptocurrency mining. You would get paid a small amount per percent of a request you inferred by users of the inference API.
If the system was built people could load their own models into the cluster and it would make sure demand is met at market rate. This would improve access for individuals to large compute in projects they want to develop, and would not be a worse use of compute than cryptocurrency mining.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.