bigscience-workshop / bigscience-workshop/petals
Feature Request: Distributed inference API where the "miners" are paid.
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 650
- PR merge metrics
- No merged PRs in 30d
Description
I'm imagining a situation where people can infer for others and make a small profit. In practicality it is similar to, but more useful than, cryptocurrency mining. You would get paid a small amount per percent of a request you inferred by users of the inference API.
If the system was built people could load their own models into the cluster and it would make sure demand is met at market rate. This would improve access for individuals to large compute in projects they want to develop, and would not be a worse use of compute than cryptocurrency mining.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.