abetlen / abetlen/llama-cpp-python

FileNotFoundError: Shared library with base name 'llama' not found #MACOS

未关闭
#739 7 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
bug build
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

Hi,
I am trying to run it on my mac, however it shows that cannot find the shared libray "llama"

Here is the error message.
`
(llama) chen@chenshuodeMBP-9 llama-cpp-python % python3 -m llama_cpp.server --model $MODEL --n_gpu_layers 1
Traceback (most recent call last):
File "", line 189, in _run_module_as_main
File "", line 112, in _get_module_details
File "/Users/chen/Desktop/robot/robot_research/llama2/llama-cpp-python/llama_cpp/__init__.py", line 1, in
from .llama_cpp import *
File "/Users/chen/Desktop/robot/robot_research/llama2/llama-cpp-python/llama_cpp/llama_cpp.py", line 80, in
_lib = _load_shared_library(_lib_base_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/chen/Desktop/robot/robot_research/llama2/llama-cpp-python/llama_cpp/llama_cpp.py", line 71, in _load_shared_library
raise FileNotFoundError(
FileNotFoundError: Shared library with base name 'llama' not found`

Can I know how to fix it?

Thanks

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。