abetlen / abetlen/llama-cpp-python
Can't compile llama-cpp-python in any way.
- Lingua principale
- Python
- Stelle
- 10.6k
- Fork
- 1.4k
- Metriche di merge delle PR
- Metriche PR in attesa
Descrizione

Setup:
-Cmake
-MinGW
-Windows 10
I earlier managed to compile llama.cpp on it's own, but It wasn't a shared library and compiled executables instead, but whenever I do the command recommended on llama-cpp-python github for windows It always seems to get stuck on what I have in the picture above.
I've been fighting it for the last 24h and Im running out of energy, I just want llama-cpp-python to be running with clblast so i can use my gpu...
I've tried pip install with cmake args, I've tried cloning both the main llama-cpp-python and llama.cpp seperately into the locations (llama-cpp-python/vendor/llama.cpp) and doing pip install /dir../. .
I've also now as in the screenshot tried to create a make file for MinGW directly and then ./make it (also tried msvc v142, that one gave me errors that said there is a #define bool _Bool, which there is... and it just won't compile)
I'll take any suggestion, for me right now there is only one goal and it is to get llama-cpp-python running with gpus so i can use it with langchain and finish my small project.
Any help is appreciated
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.