abetlen / abetlen/llama-cpp-python

cuBLAS on WSL: "no CUDA-capable device is detected"

Open
#1,030 2 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

Hi there,

I'm following this instruction to build llama.cpp from scratch:
https://github.com/ggerganov/llama.cpp#cublas
I run it in ubuntu in WSL.
CPU inference works for me with no issue, but when I try to run cublas build it fails with:

```
CUDA error 100 at /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: no CUDA-capable device is detected
current device: 0
GGML_ASSERT: /mnt/c/ws/ai/llama/llama.cpp/ggml-cuda.cu:485: !"CUDA error"
Aborted
```

Any idea how can I fix it?

Thanks,
Mike.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.