abetlen / abetlen/llama-cpp-python
Up to date llama.cpp wheel here (native libraries)
- 主要語言
- Python
- 星號
- 10.6k
- 分支
- 1.4k
- PR 合併指標
- PR 指標待擷取
描述
Hi! I made a repo [mdjou/lcpp-lib-python](https://github.com/mdjou/lcpp-lib-python) with automatic up to date wheels of llama.cpp native libraries.
Currently I provide linux-x64 vulkan wheels, but I can add other flavors and OS'es if there is demand - please open issues in my repo.
**Update**: windows-x64-vulkan, linux-x64-vulkan, and macos-arm64-metal are now available.
Note: It is not a replacement of llama-cpp-python, it is intentionally a bare-bones repackage of upstream releases of [llama.cpp](https://github.com/ggml-org/llama.cpp) with minimal lag.
You can use it as a dependency to make your own bindings, without having to worry about native compilation and correct packaging of binaries.
貢獻指南
評估
這個 Issue 還沒有評估資料。