abetlen / abetlen/llama-cpp-python

ValueError: Failed to create llama_context

Aperta
#1,304 10 commenti 5 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
10.6k
Fork
1.4k
Metriche di merge delle PR
Metriche PR in attesa

Descrizione

(yuna2) (base) adm@Adms-MacBook-Pro yuna-ai % python index.py
ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
" UserInfo={NSLocalizedDescription=program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
}
llama_new_context_with_model: failed to initialize Metal backend
Traceback (most recent call last):
File "/Users/adm/Desktop/yuna-ai/index.py", line 171, in
yuna_server = YunaServer()
^^^^^^^^^^^^
File "/Users/adm/Desktop/yuna-ai/index.py", line 33, in __init__
self.chat_generator = ChatGenerator(self.config)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/adm/Desktop/yuna-ai/lib/generate.py", line 11, in __init__
self.model = Llama(
^^^^^^
File "/usr/local/lib/python3.12/site-packages/llama_cpp/llama.py", line 328, in __init__
self._ctx = _LlamaContext(
^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/llama_cpp/_internals.py", line 265, in __init__
raise ValueError("Failed to create llama_context")
ValueError: Failed to create llama_context
Screen Shot 2024-03-25 at 23 43 18

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.