bigscience-workshop / bigscience-workshop/petals

Is it possible to share DistributedBloomForCausalLM between several worker processes?

Open
#296 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
650
PR merge metrics
No merged PRs in 30d

Description

Trying to do it (`model.share_memory()`), and getting this error

```
Mar 27 19:35:35.329 [ERROR] [petals.client.routing.sequence_manager.make_sequence:119] Using a sequence manager that is not running: it has either crashed or never started
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.