abetlen / abetlen/llama-cpp-python

Failed to load shared library 'E:\anaconda\envs\xinference\lib\site-packages\llama_cpp\lib\llama.dll'

Aberta
#1,685 0 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Python
Estrelas
10.6k
Forks
1.4k
Métricas de merge de PRs
Métricas de PR pendentes

Descrição

After installing v0.2.88-cu124, I execute the sample code, but an error is reported.Here's the code

```python
from llama_cpp import Llama

llm = Llama(
model_path=r"F:\XinferenceCache\modelscope\hub\LLM-Research\glm-4-9b-chat-GGUF\glm-4-9b-chat.Q2_K.gguf",
# n_gpu_layers=-1, # Uncomment to use GPU acceleration
# seed=1337, # Uncomment to set a specific seed
# n_ctx=2048, # Uncomment to increase the context window
)
output = llm(
"Q: Name the planets in the solar system? A: ", # Prompt
max_tokens=32, # Generate up to 32 tokens, set to None to generate up to the end of the context window
stop=["Q:", "\n"], # Stop generating just before the model would generate a new question
echo=True # Echo the prompt back in the output
) # Generate a completion, can also call create_completion
print(output)
```

This is an error message:
![企业微信截图_17237102242870](https://github.com/user-attachments/assets/3aab4b97-a7df-4ef7-ae59-2559d8cd5842)
This issue still doesn't seem to be fixed,I tried the method in #208 but it didn't work

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.