abetlen / abetlen/llama-cpp-python

DeepSeek-R1-Distill-Qwen-1.5B inference answer is wrong

未關閉
#1,949 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Python
星號
10.6k
分支
1.4k
PR 合併指標
PR 指標待擷取

描述

I encountered the following problem when using llama cpp python on Mac. The model's answer is completely unreasonable. The red box contains the question and answer.

![Image](https://github.com/user-attachments/assets/7ec01319-ff12-4de8-aab6-77e701de2fc3)

The configuration is as follows:
**model:** DeepSeek-R1-Distill-Qwen-1.5B.gguf
**Quantization:** Q4_K_M
**llama_cpp_python:** 0.3.7
**API:** create_chat_completion
**model input:**[{'role': 'system', 'content': 'you are a helpful assistant'}, {'role': 'user', 'content': 'There are 20 chickens and rabbits in a cage. It is known that these chickens and rabbits have 56 legs in total. Chickens have two legs and rabbits have four legs. How many chickens and rabbits are there in the cage?'}]

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。