abetlen / abetlen/llama-cpp-python

Getting this Error :RuntimeError: Failed to load shared library '/venv/lib/python3.10/site-packages/llama_cpp/libllama.so': libgomp.so.1: cannot open shared object file: No such file or directory

Ouverte
#1,507 3 commentaires 1 réaction 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
10.6k
Forks
1.4k
Métriques de merge des PR
Métriques de PR en attente

Description

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

# Expected Behavior

The Script Should Run Inside a Container

# Current Behavior

I Am Trying to Use Llama CPP Python Inside a LlamaIndex Script within a Docker Container. Here is How I am Doing the Initialisation

```
llm = LlamaCPP(
model_path="/usr/src/app/model/llama-2-7b-chat.Q4_0.gguf",
temperature=0.2,
max_new_tokens=2000,
verbose=True,
context_window=4096,
messages_to_prompt=messagesToPrompt,
completion_to_prompt=completionToPrompt,
)
```
The Model File is Present Inside the `/usr/src/app/model` directory. Now When I try to Run the Script I Get this Following Error while Spinning up the Container

```
raise RuntimeError(f"Failed to load shared library '{_lib_path}': {e}")
RuntimeError: Failed to load shared library '/venv/lib/python3.10/site-packages/llama_cpp/libllama.so': libgomp.so.1: cannot open shared object file: No such file or directory
```

The Same Script When I am Running Locally on My Ubuntu System, it is running fine but running the Script inside a Container is giving me the Above Issue.

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.