Lightning-AI / Lightning-AI/litgpt
Log additional data with LoRA finetuning
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Python
- Stars
- 13.7k
- Forks
- 1.5k
- Avg merge
- 15h 37m
- Merged PRs (30d)
- 1
Description
log_hyperparams is never called when performing LoRA fine tuning. This makes data logged to platforms such as W&B much less useful. Also, final artifacts are not uploaded. It seems like such functionality is available in the Lightning logger interface and this just needs to be wired together.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the LoRA fine-tuning entry point and the Lightning logger interface used by the repository. Trace where hyperparameters and final artifacts should be handled, then verify that log_hyperparams is called and final artifacts are uploaded during LoRA fine tuning.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100