caikit / caikit/caikit-nlp

Replace training loop in peft_prompt_tuning with HF Trainer

Open
#175 2 comments 0 reactions 3 assignees Claimed by @ibm-peach-fish View on GitHub
Dominant language
Python
Stars
12
Forks
55
PR merge metrics
No merged PRs in 30d

Description

## Description

Currently we use a custom training loop along with HF accelerator for training. This story is to replace that with HF Trainer similar to what we implemented for fine-tuning.

### Tasks
1. Implement HF Trainer in peft prompt tuning module
2. Make sure all unit tests pass and add any unit tests necessary
3. Evaluate newly implemented training loop with RTE and CNN datasets using:
4. Bloom-560m
5. t5-base

## Acceptance Criteria

- [ ] Unit tests cover new/changed code
- [ ] Example modified to expose any new parameter we may need

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.