NVIDIA / NVIDIA/CUDALibrarySamples
Does cuSPARSELt not support SpMV operations?
Open
@j4yan is already working on this.
Since Aug 9, 2025.
cuSPARSELt
- Dominant language
- Cuda
- Stars
- 2.5k
- Forks
- 478
- PR merge metrics
- No merged PRs in 30d
Description
Hi
As shown in the figure, during the decoding phase, the 2:4 sparsity model is about 12% slower than the dense model, the questions are as follows:
- Is the decode phase dominated by GEMV / small‑N GEMM operations, and does cuSPARSELt not support SpMV operations?
- Are there any sparse kernels or recommended practices for GEMV (matrix‑vector) that can take advantage of 2:4 sparsity?
Thanks!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.