Can gold_trainer support privileged context?
Open
- Dominant language
- Python
- Stars
- 19.3k
- Forks
- 3k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 194
Description
Current gold_trainer(trl/experimental/gold/gold_trainer.py) seems to only support distillation between students and teachers that have the same input. I wonder whether it can support teacher model with privileged context as in sdft_trainer.
Contributor guide
Assessment
This issue has not been assessed yet.