deepspeedai / deepspeedai/DeepSpeedExamples
The reward in step3 seems to be completely random without any noticeable increase.
Open
Nobody has claimed this yet.
deespeed chat
modeling
- Dominant language
- Python
- Stars
- 6.8k
- Forks
- 1.1k
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 1
Description
I am testing the 1.3B training. Steps 1 and 2 have already passed, but there is no change in reward after completing step 3.
I used LoRa to train for one iteration, and the results of steps 1 and 2 are as follows:
step1:
ppl: 2.18959641456604
step2：
Step3：
I let chatgpt extracting the logs for step 3 and comparing them with the demo logs provided in the project. I found that the absolute value of my loss is significantly smaller, and the reward seems to be completely random without any noticeable increase. (stand)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.