bigscience-workshop / bigscience-workshop/petals
Pascal family cards support.
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 650
- PR merge metrics
- No merged PRs in 30d
Description
It's said in the FAQ that models are served in FP16 to conserve the GPU memory. What's about support for cards like 1080Ti than? AFAIK they have terrible performance for FP16 (something like 150GFLOP/S compared to 10TFLOP/S on FP32)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.