Support 1 * 128 and 128 * 128 block-wise quant?
Open
@szkarpinski is already working on this.
Since Aug 6, 2025.
enhancement
- Dominant language
- Cython
- Stars
- 601
- Forks
- 46
- PR merge metrics
- No merged PRs in 30d
Description
In the CUDA 12.9 cuBLASLt documentation, I noticed support for 1×128 and 128×128 block-wise quantization methods. However, I found that nvmath-python currently lacks bindings for this type of quantize approach. I wonder do we have any plan for support this approach?
https://docs.nvidia.com/cuda/cublas/index.html#cublasltmatmulmatrixscale-t
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.