abetlen / abetlen/llama-cpp-python
Models with multiple chat templates
オープン
enhancement
- 主要言語
- Python
- スター
- 10.6k
- フォーク
- 1.4k
- PR マージ指標
- PR 指標を取得中
説明
Not an issue yet, but will need to be handled once [this](https://github.com/ggerganov/llama.cpp/issues/6484) is implemented based on recent transformers [changes](https://github.com/huggingface/transformers/pull/29658).
Also note the kwargs change in the same PR which will be used by f.ex. C4AI Command R models (new chat template is not merged yet) to pass along `tools` and `documents`, while we already support `tools`, it might be worthwhile to support other things.
コントリビューションガイド
評価
この issue はまだ評価されていません。