abetlen / abetlen/llama-cpp-python

Can't compile llama-cpp-python in any way.

Aperta
#734 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
bug build
Lingua principale
Python
Stelle
10.6k
Fork
1.4k
Metriche di merge delle PR
Metriche PR in attesa

Descrizione

![image](https://github.com/abetlen/llama-cpp-python/assets/77459670/8b1e28bd-0ef6-43bd-9f9d-861f15a281f5)
Setup:
-Cmake
-MinGW
-Windows 10

I earlier managed to compile llama.cpp on it's own, but It wasn't a shared library and compiled executables instead, but whenever I do the command recommended on llama-cpp-python github for windows It always seems to get stuck on what I have in the picture above.

I've been fighting it for the last 24h and Im running out of energy, I just want llama-cpp-python to be running with clblast so i can use my gpu...

I've tried pip install with cmake args, I've tried cloning both the main llama-cpp-python and llama.cpp seperately into the locations (llama-cpp-python/vendor/llama.cpp) and doing pip install /dir../. .
I've also now as in the screenshot tried to create a make file for MinGW directly and then ./make it (also tried msvc v142, that one gave me errors that said there is a #define bool _Bool, which there is... and it just won't compile)

I'll take any suggestion, for me right now there is only one goal and it is to get llama-cpp-python running with gpus so i can use it with langchain and finish my small project.

Any help is appreciated

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.