abetlen / abetlen/llama-cpp-python
Add Finetune Support
Offen
enhancement
help wanted
- Vorherrschende Sprache
- Python
- Sterne
- 10.6k
- Forks
- 1.4k
- PR-Merge-Kennzahlen
- PR-Kennzahlen ausstehend
Beschreibung
In the late versions of llama.cpp there are ways to fine-tune the model using LoRA adapters: https://github.com/ggerganov/llama.cpp/pull/2632
However, either I missed it or are there no functions introduced in this PR imported into this project?
**Describe alternatives you've considered**
Sure it's always an option to use a CLI tool, but I guess Python binding can be useful.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.