AnswerDotAI / AnswerDotAI/gpu.cpp
Support for 4bit or 8bit tensor
Open
- Dominant language
- C++
- Stars
- 4k
- Forks
- 199
- Avg merge
- 2m
- Merged PRs (30d)
- 3
Description
Although it may be out of scope, it would be nice to have an example of computing 4bit and 8bit tensors, to save memory bandwidth.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.