bigscience-workshop / bigscience-workshop/petals
Is it possible to share DistributedBloomForCausalLM between several worker processes?
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 650
- PR merge metrics
- No merged PRs in 30d
Description
Trying to do it (`model.share_memory()`), and getting this error
```
Mar 27 19:35:35.329 [ERROR] [petals.client.routing.sequence_manager.make_sequence:119] Using a sequence manager that is not running: it has either crashed or never started
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.