abetlen / abetlen/llama-cpp-python
[Workaround] Failed to load shared library (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64'))
Open
bug
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 1.4k
- PR merge metrics
- PR metrics pending
Description
This issue comes up on some Mac M series environments where cmake builds the llama.cpp shared library for the wrong architecture. The solution is to reinstall llama-cpp-python with:
```
CMAKE_ARGS="-DCMAKE_OSX_ARCHITECTURES=arm64" pip install --upgrade --verbose --force-reinstall --no-cache-dir llama-cpp-python
```
If anyone has a good way to automatically detect this in the CMakeLists.txt please let me know.
Contributor guide
Assessment
This issue has not been assessed yet.