abetlen / abetlen/llama-cpp-python

Can't compile llama-cpp-python in any way.

未關閉
#734 1 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
bug build
主要語言
Python
星號
10.6k
分支
1.4k
PR 合併指標
PR 指標待擷取

描述

![image](https://github.com/abetlen/llama-cpp-python/assets/77459670/8b1e28bd-0ef6-43bd-9f9d-861f15a281f5)
Setup:
-Cmake
-MinGW
-Windows 10

I earlier managed to compile llama.cpp on it's own, but It wasn't a shared library and compiled executables instead, but whenever I do the command recommended on llama-cpp-python github for windows It always seems to get stuck on what I have in the picture above.

I've been fighting it for the last 24h and Im running out of energy, I just want llama-cpp-python to be running with clblast so i can use my gpu...

I've tried pip install with cmake args, I've tried cloning both the main llama-cpp-python and llama.cpp seperately into the locations (llama-cpp-python/vendor/llama.cpp) and doing pip install /dir../. .
I've also now as in the screenshot tried to create a make file for MinGW directly and then ./make it (also tried msvc v142, that one gave me errors that said there is a #define bool _Bool, which there is... and it just won't compile)

I'll take any suggestion, for me right now there is only one goal and it is to get llama-cpp-python running with gpus so i can use it with langchain and finish my small project.

Any help is appreciated

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。