Test fine-tuning on various sizes of model
Open
@rawkintrevo is already working on this.
Since Aug 8, 2023.
- Dominant language
- Python
- Stars
- 12
- Forks
- 55
- PR merge metrics
- No merged PRs in 30d
Description
Description
Test training using fine-tuning module on following sizes of the model using different sharding mechanisms:
- < 1B parameters
- 1B> and < 3B parameters
- 3B< and <5B parameters
(Model names to come soon)
Discussion
Provide detailed discussion here
Acceptance Criteria
- Unit tests cover new/changed code
- Examples build against new/changed code
- READMEs are updated
- Type of semantic version change is identified
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.