huggingface / huggingface/alignment-handbook
Question about DPO learning rate - comparison to neural-chat-7b-v3 training
Open
- Dominant language
- Python
- Stars
- 5.7k
- Forks
- 490
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
The learning rate default in the dpo recipe config is set to 5e-7 and https://huggingface.co/Intel/neural-chat-7b-v3 was trained with a learning rate of 1e-4 (using of course a different data set https://huggingface.co/datasets/Open-Orca/SlimOrca).
However, I am wondering about the significant difference in lr and yet both models seem to perform well. Any insights about that, that you can share?
Thank you
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.