abetlen / abetlen/llama-cpp-python
Add Finetune Support
Aberta
enhancement
help wanted
- Linguagem predominante
- Python
- Estrelas
- 10.6k
- Forks
- 1.4k
- Métricas de merge de PRs
- Métricas de PR pendentes
Descrição
In the late versions of llama.cpp there are ways to fine-tune the model using LoRA adapters: https://github.com/ggerganov/llama.cpp/pull/2632
However, either I missed it or are there no functions introduced in this PR imported into this project?
**Describe alternatives you've considered**
Sure it's always an option to use a CLI tool, but I guess Python binding can be useful.
Guia de contribuição
Avaliação
Esta issue ainda não foi avaliada.