graykode / graykode/gpt-2-Pytorch

Help Increasing the amount of training/fine-tuning text to about 10k words

Open
#20 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
230
PR merge metrics
No merged PRs in 30d

Description

Hello,
I am trying to train/fine-tune the GPT-2 model using your wrapper, I have successfully made it to train by using a text file, however I would like to train the model with lots of text like 10 thousand words on a specific topic/domain and have it generate from 500-1000 words but I keep getting a strange error when I try it.
Please how do I increase the amount of training/fine-tuning text from the current limit to about 10,000 words?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.