Replace training loop in peft_prompt_tuning with HF Trainer
Open
- Dominant language
- Python
- Stars
- 12
- Forks
- 55
- PR merge metrics
- No merged PRs in 30d
Description
## Description
Currently we use a custom training loop along with HF accelerator for training. This story is to replace that with HF Trainer similar to what we implemented for fine-tuning.
### Tasks
1. Implement HF Trainer in peft prompt tuning module
2. Make sure all unit tests pass and add any unit tests necessary
3. Evaluate newly implemented training loop with RTE and CNN datasets using:
4. Bloom-560m
5. t5-base
## Acceptance Criteria
- [ ] Unit tests cover new/changed code
- [ ] Example modified to expose any new parameter we may need
Contributor guide
Assessment
This issue has not been assessed yet.