abetlen / abetlen/llama-cpp-python

When using LlamaCppEmbeddings to embed a gguf type model, an error is reported

未关闭
#910 10 条评论 9 个 reaction 已指派 0 人 在 GitHub 查看
bug
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

I used the latest module and while embedding the gguf model into chroma, a critical error occurred
`llamaem= LlamaCppEmbeddings(model_path="D:\models\llama-2-7b-chat.Q4_K_M.gguf")
vectorstore = Chroma.from_documents(documents=all_splits, embedding=llamaem)`

error:
` File "d:/project/python/document-GPT/test.py", line 71, in
vectorstore = Chroma.from_documents(documents=all_splits, embedding=llamaem)#嵌入
File "D:\python\lib\site-packages\langchain\vectorstores\chroma.py", line 771, in from_documents
return cls.from_texts(
File "D:\python\lib\site-packages\langchain\vectorstores\chroma.py", line 729, in from_texts
chroma_collection.add_texts(
File "D:\python\lib\site-packages\langchain\vectorstores\chroma.py", line 275, in add_texts
embeddings = self._embedding_function.embed_documents(texts)
File "D:\python\lib\site-packages\langchain\embeddings\llamacpp.py", line 113, in embed_documents
embeddings = [self.client.embed(text) for text in texts]
File "D:\python\lib\site-packages\langchain\embeddings\llamacpp.py", line 113, in
embeddings = [self.client.embed(text) for text in texts]
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 1292, in embed
return list(map(float, self.create_embedding(input)["data"][0]["embedding"]))
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 1256, in create_embedding
self.eval(tokens)
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 1030, in eval
self._ctx.decode(self._batch)
File "D:\python\lib\site-packages\llama_cpp\llama.py", line 471, in decode
raise RuntimeError(f"llama_decode returned {return_code}")
RuntimeError: llama_decode returned 1`

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。