abetlen / abetlen/llama-cpp-python
Failed to load shared library 'E:\anaconda\envs\xinference\lib\site-packages\llama_cpp\lib\llama.dll'
- Vorherrschende Sprache
- Python
- Sterne
- 10.6k
- Forks
- 1.4k
- PR-Merge-Kennzahlen
- PR-Kennzahlen ausstehend
Beschreibung
After installing v0.2.88-cu124, I execute the sample code, but an error is reported.Here's the code
```python
from llama_cpp import Llama
llm = Llama(
model_path=r"F:\XinferenceCache\modelscope\hub\LLM-Research\glm-4-9b-chat-GGUF\glm-4-9b-chat.Q2_K.gguf",
# n_gpu_layers=-1, # Uncomment to use GPU acceleration
# seed=1337, # Uncomment to set a specific seed
# n_ctx=2048, # Uncomment to increase the context window
)
output = llm(
"Q: Name the planets in the solar system? A: ", # Prompt
max_tokens=32, # Generate up to 32 tokens, set to None to generate up to the end of the context window
stop=["Q:", "\n"], # Stop generating just before the model would generate a new question
echo=True # Echo the prompt back in the output
) # Generate a completion, can also call create_completion
print(output)
```
This is an error message:

This issue still doesn't seem to be fixed,I tried the method in #208 but it didn't work
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.