abetlen / abetlen/llama-cpp-python
FileNotFoundError: Shared library with base name 'llama' not found #MACOS
- Langage dominant
- Python
- Étoiles
- 10.6k
- Forks
- 1.4k
- Métriques de merge des PR
- Métriques de PR en attente
Description
Hi,
I am trying to run it on my mac, however it shows that cannot find the shared libray "llama"
Here is the error message.
`
(llama) chen@chenshuodeMBP-9 llama-cpp-python % python3 -m llama_cpp.server --model $MODEL --n_gpu_layers 1
Traceback (most recent call last):
File "", line 189, in _run_module_as_main
File "", line 112, in _get_module_details
File "/Users/chen/Desktop/robot/robot_research/llama2/llama-cpp-python/llama_cpp/__init__.py", line 1, in
from .llama_cpp import *
File "/Users/chen/Desktop/robot/robot_research/llama2/llama-cpp-python/llama_cpp/llama_cpp.py", line 80, in
_lib = _load_shared_library(_lib_base_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/chen/Desktop/robot/robot_research/llama2/llama-cpp-python/llama_cpp/llama_cpp.py", line 71, in _load_shared_library
raise FileNotFoundError(
FileNotFoundError: Shared library with base name 'llama' not found`
Can I know how to fix it?
Thanks
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.