abetlen / abetlen/llama-cpp-python
updated from 0.2.90 to 0.3.2 and now my GPU won't load
Đang mở
- Ngôn ngữ chính
- Python
- Star
- 10.6k
- Fork
- 1.4k
- Chỉ số merge pull request
- Chỉ số pull request đang chờ
Mô tả
I've looked through the issues, I do see there are some complaints about this, a lot of different ways to fix it working differently for different users.
Is there a unified, accepted and tested way that can readjust my set up to work with GPUs?
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Wed_Feb__8_05:53:42_Coordinated_Universal_Time_2023
Cuda compilation tools, release 12.1, V12.1.66
Build cuda_12.1.r12.1/compiler.32415258_0
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.