OptimalScale / OptimalScale/LMFlow
lora training - Input：Instruction
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 8.5k
- Forks
- 822
- PR merge metrics
- No merged PRs in 30d
Description
您好，利用工程自带数据集对Llama7b进行Lora训练，数据集如下图所示
训练后app.py参数如下设置
对话显示如下所示
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the app.py settings and the built-in dataset shown in the report, then reproduce the LoRA training and conversation output. Trace how the dataset's Instruction input is handled during training and inference, and verify the resulting dialogue against the intended behavior. The issue is resolved when the cause of the displayed output is identified and the expected instruction response is produced.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100