abetlen / abetlen/llama-cpp-python

CUDA error 102

未關閉
#904 4 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
bug
主要語言
Python
星號
10.6k
分支
1.4k
PR 合併指標
PR 指標待擷取

描述

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [ Yes] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [Yes ] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [Yes ] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [Yes ] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

Operating Environment:
wsl2(Ubuntu 22.04.2 LTS)
python:3.10.13
llama-cpp-python: 0.2.15
NVIDIA-SMI 535.43.02
Driver Version: 535.98
CUDA Version: 11.7

The installation process is fine, running with the CPU without any errors, but it often happens once it is running on the GPU
```
CUDA error 102 at /tmp/pip-install-7_e6fm5e/llama-cpp-python_bce7693afa4f423faad647793d7b8412/vendor/llama.cpp/ggml-cuda.cu:7100: device doesn't have valid Grid license
current device: 0
```
It's not 100% that there is such an error, sometimes the first few conversations are fine, and suddenly the error is reported! What is certain is that if you keep talking, this error will happen, and then the process will be terminated. And I've tested multiple different models, and the problem is the same, how can I fix it?

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。