abetlen / abetlen/llama-cpp-python

Please add support or tell me if there are ANY wheels for llama.cpp that can run on debian/ubuntu

Open
#2,113 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

So I have been trying to use llama.cpp on huggingface and even withdocker file I cannot because I use both pytorch which requires debian and llama.cpp and I check EVERYWHERE (maybe) and I could not find a single prebuilt wheel for deian/ubuntu that actually works/ is not outdated

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.