abetlen / abetlen/llama-cpp-python
chatml-function-callling not adding tool description to the prompt.
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 1.4k
- PR merge metrics
- PR metrics pending
Description
Tool description is missing in `chatml-funcion-calling` prompt format.
https://github.com/abetlen/llama-cpp-python/blob/803924b02cc8ca7531b70e6497d1ff7b83f75737/llama_cpp/llama_chat_format.py#L3417-L3421
Contributor guide
Assessment
This issue has not been assessed yet.