abetlen / abetlen/llama-cpp-python
cuBLAS on WSL: "no CUDA-capable device is detected"
Abierto
bug
- Lenguaje dominante
- Python
- Estrellas
- 10.6k
- Forks
- 1.4k
- Métricas de merge de PR
- Métricas de PR pendientes
Descripción
Hi there,
I'm following this instruction to build llama.cpp from scratch:
https://github.com/ggerganov/llama.cpp#cublas
I run it in ubuntu in WSL.
CPU inference works for me with no issue, but when I try to run cublas build it fails with:
```
CUDA error 100 at /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: no CUDA-capable device is detected
current device: 0
GGML_ASSERT: /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: !"CUDA error"
Aborted
```
Any idea how can I fix it?
Thanks,
Mike.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.