CUDA error: CUBLAS_STATUS_EXECUTION_FAILED Help
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 155
Description
### Your question
CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling cublasLtMatmul with transpose_mat1 1 transpose_mat2 0 m 320 n 8192 k 320 mat1_ld 320 mat2_ld 320 result_ld 320 abcType 2 computeType 68 scaleType 0.
RuntimeError: CUDA error: the launch timed out and was terminated Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.
+-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 566.36 Driver Version: 566.36 CUDA Version: 12.7 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce 940MX WDDM | 00000000:01:00.0 Off | N/A | | N/A 0C P8 N/A / 200W | 0MiB / 2048MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | No running processes found | +-----------------------------------------------------------------------------------------+
### Logs
```powershell
```
### Other
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.