abetlen / abetlen/llama-cpp-python

CMAKE config for Ninja unsuitable for compiling on Ryzen 5 6 core cpu

未關閉
#895 1 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
bug build
主要語言
Python
星號
10.6k
分支
1.4k
PR 合併指標
PR 指標待擷取

描述

Hi thanks for all you great work at providing a wrapper with a web server. I got the wrapper working on my cpu but I have a ROCm system. I have llama.cpp fully working on my GPU so I have tried to compile llama_cpp_python with
`
CMAKE_ARGS="-DLLAMA_HIPBLAS=on" pip install llama-cpp-python[server] --force-reinstall --upgrade --no-cache-dir `

However this gets stuck as my cpu has 6 cores and I think Ninja is using 100% of these threads and this results in the following:

` vendor/llama.cpp/CMakeFiles/llama.dir/llama.cpp.o -c /tmp/pip-install-nijs8rwv/llama-cpp-python_6a0e9af7a84f46bd933b9ed621d1d190/vendor/llama.cpp/llama.cpp
ninja: build stopped: subcommand failed.
*** CMake build failed

[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.

ERROR: Failed building wheel for llama-cpp-python

Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects `

Hope you can advise. I need to know how to specify to cmake to use fewer threads I think. Alas the options

`--build -j nthreads`

Doesnt work. I am using a 6 core amd Ryzen 5 setup

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。