huggingface / huggingface/accelerate
[Feature]: CPU+GPU using accelerate?
Open
feature request
- Dominant language
- Python
- Stars
- 9.9k
- Forks
- 1.5k
- Avg merge
- 5d 2h
- Merged PRs (30d)
- 27
Description
Hey Everyone!
Could accelerate make it possible to distribute the processes between CPU + GPU and RAM + VRAM?
As I'm not familiar with it and only tested `accelerate config` command, it might be a feature request
Contributor guide
Assessment
This issue has not been assessed yet.