abetlen / abetlen/llama-cpp-python
How do I customize the Chat format?
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 1.4k
- PR merge metrics
- PR metrics pending
Description
I'm trying to run CodeGeeX-4-all-9B, but the chat format it needs is like this:
[gMASK]{{ if .System }}<|system|>
{{ .System }}{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}{{ end }}<|assistant|>
{{ .Response }}
Contributor guide
Assessment
This issue has not been assessed yet.