abetlen / abetlen/llama-cpp-python
ggml_new_tensor_impl: not enough space in the context's memory pool
Đang mở
llama.cpp
- Ngôn ngữ chính
- Python
- Star
- 10.6k
- Fork
- 1.4k
- Chỉ số merge pull request
- Chỉ số pull request đang chờ
Mô tả
I believe this is an **llma-cpp-python** issue, please refer to:
[https://github.com/PromtEngineer/localGPT/issues/349#issuecomment-1668891109](https://github.com/PromtEngineer/localGPT/issues/349#issuecomment-1668891109)
I'm trying to run [localGPT](https://github.com/PromtEngineer/localGPT) with **CUDA 12.2** .
but obtained this **ERROR** message:
```console
......
ggml_new_tensor_impl: not enough space in the context's memory pool (needed 18682928, available 10485760)
```
Does it have something to do with [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) with **CUDA 12.2** .
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.