InternLM / InternLM/xtuner

Add a feature to merge the PTH format with the original LLM directly.

Open
#670 0 comments 2 reactions 0 assignees View on GitHub
feature request
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

I need a LLM in the GGUF format. I have noticed that llama.cpp can convert files from the HF format to the GGUF format, and it can also convert files from the PTH format to the GGUF format. Therefore, I suggest that you add a feature to Xtuner that supports directly merging the PTH format with the original LLM.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.