bigscience-workshop / bigscience-workshop/petals
batch processing/parallel processing
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 650
- PR merge metrics
- No merged PRs in 30d
Description
Hi there, does Petals currenly support batch processing/parallel processing? For example, to increase resource usage or system throughput, we would like to see servers parallelly processing multiple prompts at the same time, aka batch processing. Is this possible?
Thanks a lot.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.