[BUG]RuntimeError: cublas error: CUBLAS_STATUS_NOT_SUPPORTED
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 585
- Forks
- 67
- PR merge metrics
- No merged PRs in 30d
Description
Describe the bug
使用docker环境,运行三个demo时后台都报错误
File "/usr/local/lib/python3.6/dist-packages/bminf/arch/t5/model.py", line 238, in encode
True
File "/usr/local/lib/python3.6/dist-packages/bminf/layers/transformer_block.py", line 42, in forward
x = self.self_attention.forward(allocator, x, attention_mask, self_attn_position_bias)
File "/usr/local/lib/python3.6/dist-packages/bminf/layers/attention.py", line 63, in forward
qkv_i32
File "/usr/local/lib/python3.6/dist-packages/bminf/functions/gemm.py", line 86, in igemm
_igemm(allocator, a, aT, b, bT, c, device, stream)
File "/usr/local/lib/python3.6/dist-packages/bminf/functions/gemm.py", line 265, in _igemm
stream.ptr
File "/usr/local/lib/python3.6/dist-packages/bminf/backend/cublaslt.py", line 101, in checkCublasStatus
raise RuntimeError("cublas error: %s" % cublas_errors[cublas_status])
RuntimeError: cublas error: CUBLAS_STATUS_NOT_SUPPORTED
请问是什么原因,是哪个版本有问题吗?
Environment:
cuda:10.1
模型:EVA-int8
显存:12G
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with bminf/backend/cublaslt.py at checkCublasStatus, then follow the call chain through bminf/functions/gemm.py, bminf/layers/attention.py, and bminf/arch/t5/model.py. Reproduce the three demos in the Docker environment with CUDA 10.1 and the EVA-int8 model; done means identifying the incompatible component or configuration and confirming the error is resolved.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100