NVIDIA / NVIDIA/CUDALibrarySamples
cuSparseLt python bindings & performance questions
Open
@j4yan is already working on this.
Since Jan 7, 2026.
cuSPARSELt
- Dominant language
- Cuda
- Stars
- 2.5k
- Forks
- 478
- PR merge metrics
- No merged PRs in 30d
Description
Hi all,
- it would be great to have some python bindings for cuSparseLt, because it'll be a while until pytorch supports this for all dtypes, especially low-precision such as int8
- Using the C++ API, I'm only getting about 30% more speed for sparse int8 x int8 compared to dense
torch._int_mm. Is that expected? I would have expected more given the hardware claims of twice the speed.
I'm pretty sure int8xint8 isn't bandwidth-limited on any modern GPU, is it?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.