我也是一样的问题， CUDA Version: 11.8
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 12.3k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
我也是一样的问题， CUDA Version: 11.8
Ubuntu 22.04.2 LTS
Detail Information:
Setting pad_token_idtoeos_token_id:106068 for open-end generation.
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/hyp/anaconda3/envs/moss/lib/python3.8/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "/home/hyp/anaconda3/envs/moss/lib/python3.8/site-packages/transformers/generation/utils.py", line 1358, in generate
if pad_token_id is not None and torch.sum(inputs_tensor[:, -1] == pad_token_id) > 0:
RuntimeError: CUDA error: no kernel image is available for execution on the device
Originally posted by @r4ehyp in https://github.com/OpenLMLab/MOSS/issues/109#issuecomment-1520233385
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the traceback in transformers/generation/utils.py at line 1358 and reproduce the generation call in the reported Ubuntu, Python, and CUDA environment. Compare the PyTorch device support with the installed hardware and versions. Done means the reported generation path completes without the CUDA kernel-image error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100