abetlen / abetlen/llama-cpp-python
Last message when streaming completion should not be empty
Abierto
bug
- Lenguaje dominante
- Python
- Estrellas
- 10.6k
- Forks
- 1.4k
- Métricas de merge de PR
- Métricas de PR pendientes
Descripción
When streaming completions the last message is sometimes empty to ensure that the last message contains a finish_reason. This is correct according to the OpenAI schema but is not expected by all clients and can cause bugs (noticed this in openplayground).
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.