AnswerDotAI / AnswerDotAI/gpu.cpp
Support for 4bit or 8bit tensor
Open
- Dominant language
- C++
- Stars
- 4k
- Forks
- 199
- Avg merge
- 2m
- Merged PRs (30d)
- 3
Description
Although it may be out of scope, it would be nice to have an example of computing 4bit and 8bit tensors, to save memory bandwidth.
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are named. First clarify the intended 4-bit and 8-bit tensor representation and the example's expected scope, then identify the relevant tensor and GPU-computation entry points; done should include a working example that demonstrates the requested reduced memory bandwidth.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- hpc, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100