abetlen / abetlen/llama-cpp-python
Why is this not working for the current release. UNABLE TO USE GPU
未關閉
- 主要語言
- Python
- 星號
- 10.6k
- 分支
- 1.4k
- PR 合併指標
- PR 指標待擷取
描述
I got it to works just like instruction, I'm using CUDA 12.3:
`set CMAKE_ARGS="-DLLAMA_CUBLAS=on" && set FORCE_CMAKE=1 && pip install --no-cache-dir llama-cpp-python==0.2.90 --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu123`
_Originally posted by @BinhPQ2 in https://github.com/abetlen/llama-cpp-python/issues/576#issuecomment-2379861701_
貢獻指南
評估
這個 Issue 還沒有評估資料。