abetlen / abetlen/llama-cpp-python
ValueError: Failed to create llama_context
- 主要语言
- Python
- 星标
- 10.6k
- 派生
- 1.4k
- PR 合并指标
- PR 指标待抓取
描述
(yuna2) (base) adm@Adms-MacBook-Pro yuna-ai % python index.py
ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
" UserInfo={NSLocalizedDescription=program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
}
llama_new_context_with_model: failed to initialize Metal backend
Traceback (most recent call last):
File "/Users/adm/Desktop/yuna-ai/index.py", line 171, in
yuna_server = YunaServer()
^^^^^^^^^^^^
File "/Users/adm/Desktop/yuna-ai/index.py", line 33, in __init__
self.chat_generator = ChatGenerator(self.config)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/adm/Desktop/yuna-ai/lib/generate.py", line 11, in __init__
self.model = Llama(
^^^^^^
File "/usr/local/lib/python3.12/site-packages/llama_cpp/llama.py", line 328, in __init__
self._ctx = _LlamaContext(
^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/llama_cpp/_internals.py", line 265, in __init__
raise ValueError("Failed to create llama_context")
ValueError: Failed to create llama_context
贡献指南
评估
这个 Issue 还没有评估数据。