abetlen / abetlen/llama-cpp-python

Failed to load shared library 'E:\anaconda\envs\xinference\lib\site-packages\llama_cpp\lib\llama.dll'

Ouverte
#1,685 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
10.6k
Forks
1.4k
Métriques de merge des PR
Métriques de PR en attente

Description

After installing v0.2.88-cu124, I execute the sample code, but an error is reported.Here's the code

```python
from llama_cpp import Llama

llm = Llama(
model_path=r"F:\XinferenceCache\modelscope\hub\LLM-Research\glm-4-9b-chat-GGUF\glm-4-9b-chat.Q2_K.gguf",
# n_gpu_layers=-1, # Uncomment to use GPU acceleration
# seed=1337, # Uncomment to set a specific seed
# n_ctx=2048, # Uncomment to increase the context window
)
output = llm(
"Q: Name the planets in the solar system? A: ", # Prompt
max_tokens=32, # Generate up to 32 tokens, set to None to generate up to the end of the context window
stop=["Q:", "\n"], # Stop generating just before the model would generate a new question
echo=True # Echo the prompt back in the output
) # Generate a completion, can also call create_completion
print(output)
```

This is an error message:
![企业微信截图_17237102242870](https://github.com/user-attachments/assets/3aab4b97-a7df-4ef7-ae59-2559d8cd5842)
This issue still doesn't seem to be fixed,I tried the method in #208 but it didn't work

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.