abetlen / abetlen/llama-cpp-python
Prebuild WHL, Cuda 12.1 win10 python 3.10
Abierto
- Lenguaje dominante
- Python
- Estrellas
- 10.6k
- Forks
- 1.4k
- Métricas de merge de PR
- Métricas de PR pendientes
Descripción
Hello,
I've been trying to build llama-cpp-python latest version (0.3.7)for a week for Deepseek R1. But i failed. Whenever i did succesfully it errors(access violation 0x000000) when import and run.
Please anyone have prebuilt version of this spesifications, share me?
Thanks a lot!
Cuda 12.1
Python 3.10
Windows 10 x64
llama-cpp-python 0.3.7
@abetlen
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.