Lightning-AI / Lightning-AI/litgpt

Suggest to use `litgpt chat` after finetuning

Open
#1,106 2 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13.7k
Forks
1.5k
Avg merge
15h 37m
Merged PRs (30d)
1

Description

Our finetuning tutorials end with suggesting to run `litgpt generate` but no mention of `litgpt chat`. I believe chatting is a more intuitive suggestion to immediately use and test the model. So I propose to incluce this as the first step after finetuning in our tutorials.

(this would apply to full and lora only at the moment)

Thoughts @rasbt?

We could even print the commands to the terminal after finetuning ends, so the user can copy paste it.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Locate the full and LoRA finetuning tutorials and compare their current post-finetuning `litgpt generate` guidance with the available `litgpt chat` entry point. Confirm whether the scope is tutorial text only or also printing commands after finetuning; it is done when both applicable tutorials clearly suggest the intended next step.

Written by the indexing model from the issue text.

Assessment

Domain
cli, documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.