abetlen / abetlen/llama-cpp-python
Getting this Error :RuntimeError: Failed to load shared library '/venv/lib/python3.10/site-packages/llama_cpp/libllama.so': libgomp.so.1: cannot open shared object file: No such file or directory
- Ngôn ngữ chính
- Python
- Star
- 10.6k
- Fork
- 1.4k
- Chỉ số merge pull request
- Chỉ số pull request đang chờ
Mô tả
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.
# Expected Behavior
The Script Should Run Inside a Container
# Current Behavior
I Am Trying to Use Llama CPP Python Inside a LlamaIndex Script within a Docker Container. Here is How I am Doing the Initialisation
```
llm = LlamaCPP(
model_path="/usr/src/app/model/llama-2-7b-chat.Q4_0.gguf",
temperature=0.2,
max_new_tokens=2000,
verbose=True,
context_window=4096,
messages_to_prompt=messagesToPrompt,
completion_to_prompt=completionToPrompt,
)
```
The Model File is Present Inside the `/usr/src/app/model` directory. Now When I try to Run the Script I Get this Following Error while Spinning up the Container
```
raise RuntimeError(f"Failed to load shared library '{_lib_path}': {e}")
RuntimeError: Failed to load shared library '/venv/lib/python3.10/site-packages/llama_cpp/libllama.so': libgomp.so.1: cannot open shared object file: No such file or directory
```
The Same Script When I am Running Locally on My Ubuntu System, it is running fine but running the Script inside a Container is giving me the Above Issue.
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.