huggingface / huggingface/alignment-handbook
Early Stopping Issue when used with ConstantLengthDataset
Open
- Dominant language
- Python
- Stars
- 5.7k
- Forks
- 490
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
Hello
I modified the code to include the Constant Length Dataset and it's early stopping at around 15% of the training. This issue doesn't occur when not used with the normal code given. Is there an issue with constant length dataset? I used it with SFTTrainer.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.