abetlen / abetlen/llama-cpp-python
Please add support or tell me if there are ANY wheels for llama.cpp that can run on debian/ubuntu
未關閉
- 主要語言
- Python
- 星號
- 10.6k
- 分支
- 1.4k
- PR 合併指標
- PR 指標待擷取
描述
So I have been trying to use llama.cpp on huggingface and even withdocker file I cannot because I use both pytorch which requires debian and llama.cpp and I check EVERYWHERE (maybe) and I could not find a single prebuilt wheel for deian/ubuntu that actually works/ is not outdated
貢獻指南
評估
這個 Issue 還沒有評估資料。