abetlen / abetlen/llama-cpp-python

Prebuild WHL, Cuda 12.1 win10 python 3.10

Open
#1,960 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

Hello,

I've been trying to build llama-cpp-python latest version (0.3.7)for a week for Deepseek R1. But i failed. Whenever i did succesfully it errors(access violation 0x000000) when import and run.
Please anyone have prebuilt version of this spesifications, share me?
Thanks a lot!

Cuda 12.1
Python 3.10
Windows 10 x64

llama-cpp-python 0.3.7

@abetlen

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.