abetlen / abetlen/llama-cpp-python

When using LlamaCppEmbeddings to embed a gguf type model, an error is reported

Abierto
#910 10 comentarios 9 reacciones 0 asignados Ver en GitHub
bug
Lenguaje dominante
Python
Estrellas
10.6k
Forks
1.4k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

I used the latest module and while embedding the gguf model into chroma, a critical error occurred
`llamaem= LlamaCppEmbeddings(model_path="D:\models\llama-2-7b-chat.Q4_K_M.gguf")
vectorstore = Chroma.from_documents(documents=all_splits, embedding=llamaem)`

error:
` File "d:/project/python/document-GPT/test.py", line 71, in
vectorstore = Chroma.from_documents(documents=all_splits, embedding=llamaem)#嵌入
File "D:\python\lib\site-packages\langchain\vectorstores\chroma.py", line 771, in from_documents
return cls.from_texts(
File "D:\python\lib\site-packages\langchain\vectorstores\chroma.py", line 729, in from_texts
chroma_collection.add_texts(
File "D:\python\lib\site-packages\langchain\vectorstores\chroma.py", line 275, in add_texts
embeddings = self._embedding_function.embed_documents(texts)
File "D:\python\lib\site-packages\langchain\embeddings\llamacpp.py", line 113, in embed_documents
embeddings = [self.client.embed(text) for text in texts]
File "D:\python\lib\site-packages\langchain\embeddings\llamacpp.py", line 113, in
embeddings = [self.client.embed(text) for text in texts]
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 1292, in embed
return list(map(float, self.create_embedding(input)["data"][0]["embedding"]))
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 1256, in create_embedding
self.eval(tokens)
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 1030, in eval
self._ctx.decode(self._batch)
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 471, in decode
raise RuntimeError(f"llama_decode returned {return_code}")
RuntimeError: llama_decode returned 1`

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.