abetlen / abetlen/llama-cpp-python
cuBLAS on WSL: "no CUDA-capable device is detected"
Open
bug
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 1.4k
- PR merge metrics
- PR metrics pending
Description
Hi there,
I'm following this instruction to build llama.cpp from scratch:
https://github.com/ggerganov/llama.cpp#cublas
I run it in ubuntu in WSL.
CPU inference works for me with no issue, but when I try to run cublas build it fails with:
```
CUDA error 100 at /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: no CUDA-capable device is detected
current device: 0
GGML_ASSERT: /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: !"CUDA error"
Aborted
```
Any idea how can I fix it?
Thanks,
Mike.
Contributor guide
Assessment
This issue has not been assessed yet.