abetlen / abetlen/llama-cpp-python

Can't compile llama-cpp-python in any way.

未关闭
#734 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
bug build
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

![image](https://github.com/abetlen/llama-cpp-python/assets/77459670/8b1e28bd-0ef6-43bd-9f9d-861f15a281f5)
Setup:
-Cmake
-MinGW
-Windows 10

I earlier managed to compile llama.cpp on it's own, but It wasn't a shared library and compiled executables instead, but whenever I do the command recommended on llama-cpp-python github for windows It always seems to get stuck on what I have in the picture above.

I've been fighting it for the last 24h and Im running out of energy, I just want llama-cpp-python to be running with clblast so i can use my gpu...

I've tried pip install with cmake args, I've tried cloning both the main llama-cpp-python and llama.cpp seperately into the locations (llama-cpp-python/vendor/llama.cpp) and doing pip install /dir../. .
I've also now as in the screenshot tried to create a make file for MinGW directly and then ./make it (also tried msvc v142, that one gave me errors that said there is a #define bool _Bool, which there is... and it just won't compile)

I'll take any suggestion, for me right now there is only one goal and it is to get llama-cpp-python running with gpus so i can use it with langchain and finish my small project.

Any help is appreciated

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。