NVIDIA / NVIDIA/CUDALibrarySamples
Question about pointer arrays for grouped GEMM in cublasLtMatmul
Open
@hbabak is already working on this.
Since Mar 18, 2026.
cuBLASLt
- Dominant language
- Cuda
- Stars
- 2.5k
- Forks
- 478
- PR merge metrics
- No merged PRs in 30d
Description
I am trying to understand how grouped GEMM is represented in cuBLASLt.
My confusion is the following:
For grouped GEMM, each operation in the group should have its own matrix pointers A[i], B[i], and C[i].
But from the cublasLtMatmul function signature, A/B/C seem to be single pointers rather than pointer-to-pointer arguments.
Because of this, I am unsure which of the following is correct:
- The API expects pointer arrays for A/B/C.
If yes, are these arrays located in host memory or device memory? - The API expects a single pointer, and grouped GEMM is expressed through offsets or strides.
- There is another grouped GEMM-specific mechanism in cuBLASLt that I may be missing.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.