Can't install vllm, llama.cpp
Open
bug
help wanted
- Dominant language
- Python
- Stars
- 2.7k
- Forks
- 1k
- Avg merge
- 7d 14h
- Merged PRs (30d)
- 2
Description
## 🐛 Bug
Recently, CUDA has updated to12. However, I'm encountering errors when attempting to install VLLM and llama.cpp using pip. Could there be an issue with my CUDA installation? For reference, the error messages are:
### To Reproduce
### Expected behavior
### Additional context
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.