abetlen / abetlen/llama-cpp-python

Can't compile llama-cpp-python in any way.

Abierto
#734 1 comentario 0 reacciones 0 asignados Ver en GitHub
bug build
Lenguaje dominante
Python
Estrellas
10.6k
Forks
1.4k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

![image](https://github.com/abetlen/llama-cpp-python/assets/77459670/8b1e28bd-0ef6-43bd-9f9d-861f15a281f5)
Setup:
-Cmake
-MinGW
-Windows 10

I earlier managed to compile llama.cpp on it's own, but It wasn't a shared library and compiled executables instead, but whenever I do the command recommended on llama-cpp-python github for windows It always seems to get stuck on what I have in the picture above.

I've been fighting it for the last 24h and Im running out of energy, I just want llama-cpp-python to be running with clblast so i can use my gpu...

I've tried pip install with cmake args, I've tried cloning both the main llama-cpp-python and llama.cpp seperately into the locations (llama-cpp-python/vendor/llama.cpp) and doing pip install /dir../. .
I've also now as in the screenshot tried to create a make file for MinGW directly and then ./make it (also tried msvc v142, that one gave me errors that said there is a #define bool _Bool, which there is... and it just won't compile)

I'll take any suggestion, for me right now there is only one goal and it is to get llama-cpp-python running with gpus so i can use it with langchain and finish my small project.

Any help is appreciated

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.