Add a feature to merge the PTH format with the original LLM directly.
Open
feature request
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
I need a LLM in the GGUF format. I have noticed that llama.cpp can convert files from the HF format to the GGUF format, and it can also convert files from the PTH format to the GGUF format. Therefore, I suggest that you add a feature to Xtuner that supports directly merging the PTH format with the original LLM.
Contributor guide
Assessment
This issue has not been assessed yet.