microsoft / microsoft/onnxruntime
[Documentation] Int4 Blockwise Quantization Documentation
Open
documentation
quantization
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the documentation issue
I recently see onnxruntime adds the int4 blockwise quantization feature and wish to know whether there is any associated documentation regarding this very new feature for us to build and test it?
### Page / URL
_No response_
Contributor guide
Research direction
The issue names no page, file, or test. Start by locating ONNX Runtime's int4 blockwise quantization implementation and existing quantization documentation; done means documenting how to build and test this feature.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- documentation, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100