abetlen / abetlen/llama-cpp-python

DeepSeek-R1-Distill-Qwen-1.5B inference answer is wrong

Abierto
#1,949 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
10.6k
Forks
1.4k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

I encountered the following problem when using llama cpp python on Mac. The model's answer is completely unreasonable. The red box contains the question and answer.

![Image](https://github.com/user-attachments/assets/7ec01319-ff12-4de8-aab6-77e701de2fc3)

The configuration is as follows:
**model:** DeepSeek-R1-Distill-Qwen-1.5B.gguf
**Quantization:** Q4_K_M
**llama_cpp_python:** 0.3.7
**API:** create_chat_completion
**model input:**[{'role': 'system', 'content': 'you are a helpful assistant'}, {'role': 'user', 'content': 'There are 20 chickens and rabbits in a cage. It is known that these chickens and rabbits have 56 legs in total. Chickens have two legs and rabbits have four legs. How many chickens and rabbits are there in the cage?'}]

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.