huggingface / huggingface/optimum-benchmark
Do optimum-benchmark support deepspeed_mii
Open
- Dominant language
- Python
- Stars
- 341
- Forks
- 64
- Avg merge
- 58m
- Merged PRs (30d)
- 1
Description
Thank you very much for your efforts in this work.
I found that you support deepspeed. But I think for inference workload, deepspeed-mii has better performance, as claimed in this repo: https://github.com/microsoft/DeepSpeed-MII.
I am curious about its performance. I wonder how hard it is to support this backend?
Contributor guide
Assessment
This issue has not been assessed yet.