abetlen / abetlen/llama-cpp-python
cuBLAS on WSL: "no CUDA-capable device is detected"
Aperta
bug
- Lingua principale
- Python
- Stelle
- 10.6k
- Fork
- 1.4k
- Metriche di merge delle PR
- Metriche PR in attesa
Descrizione
Hi there,
I'm following this instruction to build llama.cpp from scratch:
https://github.com/ggerganov/llama.cpp#cublas
I run it in ubuntu in WSL.
CPU inference works for me with no issue, but when I try to run cublas build it fails with:
```
CUDA error 100 at /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: no CUDA-capable device is detected
current device: 0
GGML_ASSERT: /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: !"CUDA error"
Aborted
```
Any idea how can I fix it?
Thanks,
Mike.
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.