[QST] How to do concurrent GEMMs ?

Hello,
Is it possible to launch concurrent GEMMs from the host? (only using more CPU threads as a last resort) I have used streams, but they are not running concurrently, but sequentially (which was what I expected from the code). Is there a way to do it or is there a more efficient way using another kind of GEMM instead of the basic template? Thank you, below is the code I am using to call the GEMMs.

for(int i = 0; i < 4; i++ ){
      for(int j = 0; j < 4; j++){
        CutlassGemm(m,n,k,W1[i], m, Input_8bit_pointer[j], m,Interm1[i*4+j], m, cuda_streams[i][j], i, j );
      }
}

Start from the CutlassGemm call and the cuda_streams[i][j] setup shown in the issue. Trace how the four-by-four GEMM launches are configured and determine whether the reported sequential execution is expected; document the supported path or limitation and verify it with a focused concurrency test.