NVIDIA / NVIDIA/CUDALibrarySamples

Question about pointer arrays for grouped GEMM in cublasLtMatmul

Open
#308 2 comments 0 reactions 1 assignee View on GitHub

@hbabak is already working on this.

Since Mar 18, 2026.

cuBLASLt
Dominant language
Cuda
Stars
2.5k
Forks
478
PR merge metrics
No merged PRs in 30d

Description

I am trying to understand how grouped GEMM is represented in cuBLASLt.

My confusion is the following:

For grouped GEMM, each operation in the group should have its own matrix pointers A[i], B[i], and C[i].
But from the cublasLtMatmul function signature, A/B/C seem to be single pointers rather than pointer-to-pointer arguments.

Because of this, I am unsure which of the following is correct:

  1. The API expects pointer arrays for A/B/C.
    If yes, are these arrays located in host memory or device memory?
  2. The API expects a single pointer, and grouped GEMM is expressed through offsets or strides.
  3. There is another grouped GEMM-specific mechanism in cuBLASLt that I may be missing.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.