huggingface / huggingface/alignment-handbook
Misalignment between config_lora.yaml and the model card
Open
- Dominant language
- Python
- Stars
- 5.7k
- Forks
- 490
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
Hi, I noticed that in the [model card](https://huggingface.co/alignment-handbook/zephyr-7b-dpo-lora). It says Adam optimizer is used.
However, in the `config_lora.yaml` file, it uses `optim: rmsprop`. Could you tell me which one is the actual training configuration?
I don't if there are other hyperparameters I didn't notice. Can you align the scripts with the correct model training configuration, please?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.