abetlen / abetlen/ggml-python

Prebuild WHL, Cuda 12.1 win10 python 3.10

Open
#93 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
152
Forks
16
PR merge metrics
No merged PRs in 30d

Description

Hello,

I've been trying to build llama-cpp-python latest version (0.3.7)for a week for Deepseek R1. But i failed. Whenever i did succesfully it errors(access violation 0x000000) when import and run.
Please anyone have prebuilt version of this spesifications, share me?
Thanks a lot!

Cuda 12.1
Python 3.10
Windows 10 x64

llama-cpp-python 0.3.7

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.