abetlen / abetlen/llama-cpp-python

The llama-cpp-python installed using the following method cannot find llama.dll, but the actual llama.dll exists.

Open
#981 9 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

**installation method:**
https://github.com/lperezmo/clblast-llama-cpp-python
**Download llama_cpp_python:**
![image](https://github.com/abetlen/llama-cpp-python/assets/63001991/77d3273e-e479-492a-8231-9d62cfdf6a64)
**error:**
Traceback (most recent call last):
File "d:\python\Lib\site-packages\llama_cpp\llama_cpp.py", line 72, in _load_shared_library
return ctypes.CDLL(str(_lib_path), **cdll_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\python\Lib\ctypes\__init__.py", line 376, in __init__
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: Could not find module 'd:\python\Lib\site-packages\llama_cpp\llama.dll' (or one of its dependencies). Try using the full path with constructor syntax.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "d:\python\Lib\site-packages\llama_cpp\llama_cpp.py", line 86, in
_lib = _load_shared_library(_lib_base_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "d:\python\Lib\site-packages\llama_cpp\llama_cpp.py", line 75, in _load_shared_library
raise RuntimeError(f"Failed to load shared library '{_lib_path}': {e}")
RuntimeError: Failed to load shared library 'd:\python\Lib\site-packages\llama_cpp\llama.dll': Could not find module 'd:\python\Lib\site-packages\llama_cpp\llama.dll' (or one of its dependencies). Try using the full path with constructor syntax.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.