huggingface / huggingface/alignment-handbook
Why does the alignment-handbook account for user & system Inputs in loss calculation
Open
- Dominant language
- Python
- Stars
- 5.7k
- Forks
- 490
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
I noticed that the alignment-handbook doesn't ignore the loss calculated from both the user and system inputs Based on my knowledge, many SFT choose to ignore these. I'm curious about the reasoning behind this difference.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.