Lightning-AI / Lightning-AI/litgpt
Exporting LoRA to HF format without merging
Open
Nobody has claimed this yet.
help wanted
question
- Dominant language
- Python
- Stars
- 13.7k
- Forks
- 1.5k
- Avg merge
- 15h 37m
- Merged PRs (30d)
- 1
Description
I am using litgpt to finetune LLMs and the results are better than finetuning with HF TRL (which has far more levers to tweak I guess). I understand that litgpt forces you to merge the LoRA with the base model before exporting to HF format. Can someone guide me on how to export only the LoRA to HF format as I would like to experiment with multi-LoRA in vLLM?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Begin by locating the LoRA export path and its Hugging Face conversion behavior; done means producing a standalone LoRA artifact without merging, suitable for multi-LoRA use in vLLM.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, python
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100