[QST] Integer 16 support
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 10.5k
- Forks
- 2.1k
- Avg merge
- 3d 11h
- Merged PRs (30d)
- 7
Description
What is your question?
Hey folks,
first of all, thanks for this framework.
I was recently implementing a cuda kernel for a Linear Layer and a Convolutional 2D layer using Int8 arithemtric and saving it into int32 tensors.
I was wondering, when implementing a similar kernel for int16 input and weight and saving it into int32/64 does not work. I figured out, that there is no available kernel configuration for such operation.
Do you think this might be added somehow or do you know a fancy trick or workaround to accomplish this task ?
Thanks for your help !
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue concerns CUDA kernels for linear and 2D convolution layers using int16 inputs and weights with int32 or int64 outputs. No files, tests, or entry points are identified, so begin by locating the existing int8 kernel configurations and comparing their supported input and accumulation types. Done would mean documented support or a confirmed workaround for the requested int16 operations.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100